DPC2007 Case Study Zoom & Webwereld (Sander vd Graaf)

Sander van de GraafIDG Nederland

Web 2.0

Topics

• Webwereld / Zoom

• Bottlenecks

• PHP

• MySQL

• Apache

• Caching

• Vragen

Webwereld / Zoom

Webwereld

• 4,5 miljoen pageviews per maand

Webwereld / ZoomBottlenecks

PHPMySQLApache

CachingVragen

Webwereld


• 99% dynamisch


PHPMySQLApache

CachingVragen

Webwereld


• 99% dynamisch

• Virtualhost


PHPMySQLApache

CachingVragen

Webwereld


• 99% dynamisch

• Virtualhost

• PHP 4


PHPMySQLApache

CachingVragen

Webwereld


• 99% dynamisch

• Virtualhost

• PHP 4

• scripts


PHPMySQLApache

CachingVragen

Webwereld


• 99% dynamisch

• Virtualhost

• PHP 4

• scripts

• Smarty


PHPMySQLApache

CachingVragen

Zoom.nl

• 5+ miljoen pageviews


PHPMySQLApache

CachingVragen

Zoom.nl


• 100% dynamisch


PHPMySQLApache

CachingVragen

Zoom.nl


• 100% dynamisch

• 2 webservers


PHPMySQLApache

CachingVragen

Zoom.nl


• 100% dynamisch

• 2 webservers

• 3,8TB data


PHPMySQLApache

CachingVragen

Zoom.nl


• 100% dynamisch

• 2 webservers

• 3,8TB data

• ImageMagick ipv GD


PHPMySQLApache

CachingVragen

Zoom.nl


• 100% dynamisch

• 2 webservers

• 3,8TB data

• ImageMagick ipv GD

• Smarty


PHPMySQLApache

CachingVragen

Bottlenecks

Bottlenecks

• Applicatie

• Database

• NAS


PHPMySQLApache

CachingVragen

PHP

• Optimalisaties

• APD

• Intermediate Code Caching


PHPMySQLApache

CachingVragen

Optimalisaties

for($foo=0;$foo<count($bar);$foo++)

{

// do something

}


PHPMySQLApache

CachingVragen

Optimalisaties

$barCount = count($bar);

for($foo=0;$foo<$barCount;++$foo)

{

// do something

}


PHPMySQLApache

CachingVragen

APD

PProf


PHPMySQLApache

CachingVragen

APD

apd_set_pprof_trace();


PHPMySQLApache

CachingVragen


PHPMySQLApache

CachingVragen

Intermediate code caching

• eAccelerator

• Zend Optimizer

• APC


PHPMySQLApache

CachingVragen

MySQL

• Background

• Optimalisaties


PHPMySQLApache

CachingVragen

Background

• MySQL 4.1.10

• 2 database servers

• MyISAM


PHPMySQLApache

CachingVragen

Optimalisaties• Valkuilen


PHPMySQLApache

CachingVragen

ORDER BY RAND()

SELECT * FROM images ORDER BY RAND() LIMIT 10;


PHPMySQLApache

CachingVragen

ORDER BY RAND()

SELECT * FROM images

WHERE id IN (1243,34234,2341,135465,123,653);


PHPMySQLApache

CachingVragen

WHERE 1

SELECT * FROM images WHERE 1 ORDER BY id DESC LIMIT 10;


PHPMySQLApache

CachingVragen

WHERE 1

SELECT * FROM images ORDER BY id DESC LIMIT 10;


PHPMySQLApache

CachingVragen


• Indexes


PHPMySQLApache

CachingVragen

Force Index

SELECT * FROM images FORCE INDEX(user_id)

WHERE user_id = “12”

ORDER BY created_on DESC

LIMIT 10


PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN


PHPMySQLApache

CachingVragen

EXPLAIN SELECT * FROM images LIMIT 10;


PHPMySQLApache

CachingVragen

EXPLAIN SELECT I.* FROM images I, zoom_profile.users U WHERE I.user_id = U.id AND I.user_id = 1244 LIMIT 10;


PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN

• Connection types


PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN


• Table optimalisaties


PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN



• PROCESSLIST


PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN



• PROCESSLIST

• MTOP


PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN



• PROCESSLIST

• MTOP

• SLOW Query LogWebwereld / ZoomBottlenecks

PHPMySQLApache

CachingVragen


• Indexes

• EXPLAIN



• PROCESSLIST

• MTOP

• SLOW Query Log

• De-normalisatieWebwereld / ZoomBottlenecks

PHPMySQLApache

CachingVragen

Apache

Apache

• Apache 2.0

• htaccess

• mod_expires


PHPMySQLApache

CachingVragen

.htaccess

RewriteCond %{REQUEST_FILENAME} !-f

RewriteCond %{REQUEST_FILENAME} ^.*public_images.*$

RewriteRule ^public_images/([0-9]*)/([0-9]*)/(.*)$

/do_some_magic_stuff.php?user_id=$1&width=$2&filename=$


PHPMySQLApache

CachingVragen

mod_expires

<IfModule mod_expires.c> ExpiresActive ON ExpiresByType image/gif "now plus 1 week" ExpiresByType image/png "now plus 1 week" ExpiresByType image/jpeg "now plus 1 week" ExpiresByType text/css "now plus 15 minute" ExpiresByType application/x-javascript "now plus 15 min" ExpiresDefault "now" </IfModule>


PHPMySQLApache

CachingVragen

Caching

Caching

• (intermediate) Code Caching


PHPMySQLApache

CachingVragen

Caching


• Page caching


PHPMySQLApache

CachingVragen

Caching


• Page caching

• Fragment caching


PHPMySQLApache

CachingVragen

Caching


• Page caching


• Object caching


PHPMySQLApache

CachingVragen

Caching


• Page caching


• Object caching

• Content caching


PHPMySQLApache

CachingVragen

Vragen?

DPC2007 Case Study Zoom & Webwereld (Sander vd Graaf)

Technology

Transcript of DPC2007 Case Study Zoom & Webwereld (Sander vd Graaf)