Thursday, June 24, 2010

Exploring The Software Behind Facebook

Just blogged about Exploring the software behind Facebook, the world’s largest site in my YALL. I think the article is a must-read for those who are interested in scalability.

Here is a summary links of some of the tools used

  • Memcached, distributed memory caching system
  • HipHop, convert PHP to C++
  • Haystack, high performance object store
  • BigPipe, dynamic web page serving system
  • Cassandra, distributed storage system with no single point of failure.
  • Scribe, flexible logging system
  • Hadoop, open-source map-reduce implementation
  • Thrift, cross-language framework that ties all of these different languages together
  • Varnish, HTTP accelerator which can act as a load balancer and also cache content

Labels: ,