note: 最近一兩年很熱的 Tumblr 數據

2012021716:23
http://www.tumblr.com/

Tumblr Architecture - 15 Billion Page Views A Month And Harder To Scale Than Twitter


Stats

  • 500 million page views a day
  • 15B+ page views month
  • ~20 engineers
  • Peak rate of ~40k requests per second
  • 1+ TB/day into Hadoop cluster
  • Many TB/day into MySQL/HBase/Redis/Memcache
  • Growing at 30% a month
  • ~1000 hardware nodes in production
  • Billions of page visits per month per engineer
  • Posts are about 50GB a day. Follower list updates are about 2.7TB a day.
  • Dashboard runs at a million writes a second, 50K reads a second, and it is growing.

Software

  • OS X for development, Linux (CentOS, Scientific) in production
  • Apache
  • PHP, Scala, Ruby
  • Redis, HBase, MySQL
  • Varnish, HA-Proxy, nginx,
  • Memcache, Gearman, Kafka, Kestrel, Finagle
  • Thrift, HTTP
  • Func - a secure, scriptable remote control framework and API
  • Git, Capistrano, Puppet, Jenkins

Hardware

  • 500 web servers
  • 200 database servers (many of these are part of a spare pool we pulled from for failures)
    • 47 pools
    • 30 shards
  • 30 memcache servers
  • 22 redis servers
  • 15 varnish servers
  • 25 haproxy nodes
  • 8 nginx
  • 14 job queue servers (kestrel + gearman)
  •  


  •   果~果 於 2012-04-02 11:23 6F
  • 沒關係~你可以等下一次再簽(只要樂透不倒、人人都有機會)
  •   果~果 於 2012-03-31 23:06 5F
  • 搞不好 你可以從數據中 找出樂透號碼 
  • 版主於 2012-04-02 11:07 回覆
    太晚了
    美國的 180幾億獎金 已經被中獎了..
  •   魩仔魚 於 2012-03-24 07:51 4F
  • 早安唷~~~~~辛苦了!
  • 版主於 2012-03-31 21:21 回覆
  •   果~果 於 2012-03-16 14:04 3F
  • 看不懂~(路過中)
  • 版主於 2012-03-31 21:21 回覆
    哈哈
    其實我也看不懂
  •   mini 於 2012-03-03 11:30 2F
  • sssssssss
    sssss