Facebook's new DataCenter -- This where all your data is stored!

Status
Not open for further replies.
G

Gaurish

Galvanizer
Facebook has a new datacenter up in Prineville, Oregon. the building is HUGE and there’s a sizable solar array out front. Facebook claims that this datacenter is the most energy efficient in the world

The most interesting thing out of all this, that they are sharing all details regarding their server configuration, data center cooling and backups as part of Open source hardware initiative called OpenCompute. you might be amazed to know each server can have 384gb of memory which is Insane! And they use normal consumer Seagate Harddrives which is even more scary

Hit the link to read more:

Photo tour of Facebook’s new datacenter
 
Okay, I am about to hack this, who is in with me ? :P

384GB of RAM ?? :O how much google uses ? any idea
 
Well i have seen servers usitilising 120GB RAM for small applications, they make a RAMdrive for fastest data i/o because millions of queries shhot at any given time so fastest is to build a ram drive.
 
krishnandu said:
But why they have chosen general Seagate HDD's for Data Storage??
Click to expand...
Cause they are more reliable than WD Green drives and WD Black is very expensive :rofl: :rofl:.
 
FaH33m said:
Cause they are more reliable than WD Green drives and WD Black is very expensive :rofl: :rofl:.
Click to expand...
That's ok, but why consumer ones?? I mean they are not meant for Data Centers right??
 
avi said:
how much google uses ? any idea
Click to expand...
If I am not mistaken, Google believes in scale, and has large number of low cost medium configuration hardware working in a distributed farm.
 
Gaurish said:
[...] And they use normal consumer Seagate Harddrives which is even more scary[...]
Click to expand...
google also uses very cheap harddrives even old ones. a google dev told that they write software assuming easy failure of HDDs and that data is very redundant that it will not matter if a few hdds conk off. also the probability of failure between cheap and costly hdds were not much for their application. I guess these things were said when google released a study on hdd failures sometime back :D

_
 
DigitalDude said:
google also uses very cheap harddrives even old ones. a google dev told that they write software assuming easy failure of HDDs and that data is very redundant that it will not matter if a few hdds conk off. also the probability of failure between cheap and costly hdds were not much for their application. I guess these things were said when google released a study on hdd failures sometime back :D

_
Click to expand...

Yes, you are correct. I have learned that Google uses Bigtable and Facebook uses Apache Hadoop. both are fault tolerant by design and store 3copies of data. so they still get enterprise reliability out of consumer grade hardware. so I guess we can stop complaining that consumer HDDs are not reliable:D

Source: Looking at the code behind our three uses of Apache Hadoop - Facebook
 
Are you sure Facebook uses Hadoop? I thought they made "Cassandra" themselves...

--- Updated Post - Automerged ---

Update: Oh nevermind, Cassandra is a "distributed database" while Hadoop is a collection of distributed systems software :)
 
From your own link: "Persistence is done using MySQL, Memcached [3], Facebook's Cassandra [4], Hadoop's HBase [5]. "

So I was right! :D
 
Status
Not open for further replies.
Top Bottom