PDA

View Full Version : Google Processing 20,000 Terabytes A Day, And Growing


buzzsaw
01-09-2008, 12:12 PM
A recent white paper by some Google engineers puts some numbers around the massive amount of computation that Google does every day to index the Web, process search results, and serve up ads, among other things. As oflast September, Google was processing 20,000 terabytes of data (20 petabytes) a day. This large-scale computing [...]

More... (http://feeds.feedburner.com/~r/Techcrunch/~3/213890437/)

Hell Puppy
01-09-2008, 08:07 PM
A recent white paper by some Google engineers puts some numbers around the massive amount of computation that Google does every day to index the Web, process search results, and serve up ads, among other things. As oflast September, Google was processing 20,000 terabytes of data (20 petabytes) a day. This large-scale computing [...]

More... (http://feeds.feedburner.com/%7Er/Techcrunch/%7E3/213890437/)

And they're data centers are top secret about everything...including locations in most cases.

Though one can make some educated guess about the architecture. I can see a whole of processing and pipe "on demand" happening.

Here's the really scary thing. If you truly want to have a completely fault tolerant environment, there should be no single object on the enterprise that is operating at more than 50% capacity.