How did Facebook manipulate the Hive storage format to enable it to deal with a data warehouse that stores some 300 petabytes and takes in about 600 terabytes per day? RCFile (record-columnar file format) wasn’t enough, so enter ORCFile.
In 2007, Facebook open-sourced cross-language framework Thrift, which it had been using internally for the previous year. Thursday, following the addition of several features and a host of performance improvements, Thrift was re-open-sourced as FBThrift.
Facebook overhauled its iOS Developer Center, dividing content into topics and improving navigation, as well as providing sample apps.
Facebook announced that it is open-sourcing its RocksDB embeddable, persistent key-value store, which enables fast storage and global, real-time data fetching of the social network’s massive cache of user data.
Facebook offered some insight into how it handles the more than 300 petabytes of data it stores for its 1.19 billion monthly active users, providing some details on Presto, an interactive query system it created and is open-sourcing, in a note on the Facebook Engineering page.
The plugin for WordPress launched by Facebook in June has been downloaded more than 180,000 times, and Engineer, Developer Relations Matt Kelly, who worked on the project, shared his experience in a note on the Facebook Engineering page.