Luckily it’s 2009 and there have been a bunch of successful websites that have had to deal with large scalability challenges. Many have been kind enough to share their knowledge with the world. Here is a list of the best books, articles, presentations and practices from the likes of Twitter, Facebook, Flickr and more.
Books
Building Scalable Web Sites
Building, scaling, and optimizing the next generation of web applications by Cal Henderson
Cal of Flickr fame has written the definitive resource on scaling web apps.
High Performance MySQL
Another great resource, focused heavily on the MySQL portion of LAMP, which is the hardest part to scale.
Articles
Optimizing with APC
Brian Shire is Facebook’s technical lead for PHP internals and a developer for the Alternative PHP Cache (APC). Learn more at Tekrat his home on the web.
Presentations
Scaling Twitter in Ruby (slightly dated)
Twitter was originally architected in Ruby on Rails and had some pretty serious scalability issues resulting in the now (in)famous fail whale. His presentation is insightful and the basis of many of their inital scalability measures (now failing as twitter has reached a magnitude larger than when this was given). Presentation given by Blaine Cook.
Scaling PHP5 by Rasmus Lerdorf
OSCON has been a major source for scalability presentations. In 2006 Rasmus delivered this presentation. Rasmus is notable for being the creator of the PHP programming language. Niall Kennedy recorded the audio and provided it as an mp3 here.
Scaling Web Apps
Cal, the author of the first book mentioned also put many of the same principles into a talk given at WebExpo 2007.
The same talk given (and updated) about a year later.
Scaling LiveJournal
LiveJournal was the first open source LAMP based Web 2.0 company to hit massive scale problems. They developed many of the strategies and tools, including memcache, that flickr.com, digg.com and facebook.com are using today.
Brad Fitzpatrick gave a good presentation about how they grew, both the challenges they faced, and the solutions they came to.


