Facebook announced at its @Scale 2014 conference in San Francisco Monday that it is open-sourcing mcrouter, a memcached protocol router that it uses to handle all traffic to, from and between thousands of cache servers across dozens of clusters distributed in the social network’s data centers.
Facebook announced the acquisition of secure server technology provider PrivateCore Thursday in a post by Chief Security Officer Joe Sullivan, in which Sullivan said PrivateCore’s vCage technology will eventually be incorporated into the social network’s server stack.
In an effort to reduce the size of JPEG images and speed the loading times of Web pages, Firefox parent Mozilla announced the release of compression technology mozjpeg 2.0, and Facebook announced that it will test mozjpeg 2.0 on Facebook.com.
The average Facebook user has never heard of HydraBase, but the souped-up version of Apache HBase, an open-source distributed key value data store running on top of HDFS, was instrumental in the social network’s move in 2010 to revamp its messages inbox to include Facebook messages, SMS, chat, and email. Since then, the technology has been use to launch other features, as well.
How did Facebook manipulate the Hive storage format to enable it to deal with a data warehouse that stores some 300 petabytes and takes in about 600 terabytes per day? RCFile (record-columnar file format) wasn’t enough, so enter ORCFile.