How did Facebook manipulate the Hive storage format to enable it to deal with a data warehouse that stores some 300 petabytes and takes in about 600 terabytes per day? RCFile (record-columnar file format) wasn’t enough, so enter ORCFile.
Facebook scored high marks in a recent report on the “green Internet” by Greenpeace, as the environmental organization called out the social network’s transparency on environmental issues, its usage of renewable energy at its data centers, and its creation of the Open Compute Project.
From a user standpoint, the A Look Back videos Facebook created to mark its 10th anniversary provided a fun look back at memories on the social network. But from an engineering standpoint, they provided challenges on many levels, and Alexey Spiridonov and Krish Bandaru wrote a post on the Facebook Engineering blog detailing how those challenges were overcome.
The newly announced second building at Facebook’s data center in Luleå, Sweden, will be the first of the social network’s data centers to be built using its new rapid deployment data center concept, which leans on modular and lean construction principles, much like those demonstrated by Swedish furniture giant Ikea.
With OCP Summit V taking place at the San Jose Convention Center in San Jose, Calif., Tuesday and Wednesday, Open Compute Project Chairman and President Frank Frankovsky, vice president of hardware design and supply chain operations at Facebook, discussed the group’s achievements over the past year in a post on the Open Compute Project blog.
Every operations staffer at one of Facebook’s data centers can manage at least 20,000 servers, with some handling as many as 26,000, Facebook Director of Data Center Operations Delfina Eberly said during her keynote speech Tuesday at the 7×24 Exchange 2013 Fall Conference, as reported by Data Center Knowledge.