How did Facebook manipulate the Hive storage format to enable it to deal with a data warehouse that stores some 300 petabytes and takes in about 600 terabytes per day? RCFile (record-columnar file format) wasn’t enough, so enter ORCFile.
Part of being able to combat malware, phishing, and other online threats is gathering and consolidating as much data on those threats as possible, and Facebook took a major step forward on that front with its development of ThreatData.
Facebook Vice President of Hardware Design and Supply Chain Operations and Open Compute Project Chairman and President Frank Frankovsky left the social network to form an optical-storage startup, GigaOM reported, adding that he will continue as OCP chairman and president as an independent member.
When the average person thinks about 10,000 Blu-ray discs, they likely imagine an impressive movie collection, but when Facebook Vice President of Infrastructure Engineering Jay Parikh and Director of Infrastructure Jason Taylor thought about 10,000 Blu-ray discs, data storage came to mind.
With OCP Summit V taking place at the San Jose Convention Center in San Jose, Calif., Tuesday and Wednesday, Open Compute Project Chairman and President Frank Frankovsky, vice president of hardware design and supply chain operations at Facebook, discussed the group’s achievements over the past year in a post on the Open Compute Project blog.
Facebook announced that it is open-sourcing its RocksDB embeddable, persistent key-value store, which enables fast storage and global, real-time data fetching of the social network’s massive cache of user data.
Every operations staffer at one of Facebook’s data centers can manage at least 20,000 servers, with some handling as many as 26,000, Facebook Director of Data Center Operations Delfina Eberly said during her keynote speech Tuesday at the 7×24 Exchange 2013 Fall Conference, as reported by Data Center Knowledge.
Frank Frankovsky, vice president of hardware design and supply chain operations at Facebook and chairman and president of the Open Compute Project, touted the progress made thus far by the Facebook-launched data-storage initiative on the networking-hardware front in a post on the Open Compute Project blog.
Facebook continued to pursue ways of making data storage more efficient with its release of a new version of Flashcache, with Production Database Engineer Domas Mituzas saying in a note on the Facebook Engineering page that the 3.x series boosted average hit rates from 60 percent to 80 percent and cut the social network’s disk operation rate nearly in half.