Quantcast
Channel: Feedblog » crawler
Viewing all articles
Browse latest Browse all 10

Storing the Full Internet

$
0
0

The other day I blogged about Blekko and what it would take to in terms of hardware index the full Internet.

High Scalability responded with some interesting thoughts.

Kevin Burton calculates that Blekko, one of the barbarian hoard storming Google’s search fortress, would need to spend $5 million just to buy enough weapons, er storage.

Kevin estimates storing a deep crawl of the internet would take about 5 petabytes. At a projected $1 million per petabyte that’s a paltry $5 million. Less than expected. Imagine in days of old an ambitious noble itching to raise an army to conquer a land and become its new prince. For a fine land, and the search market is one of the richest, that would be a smart investment for a VC to make.

The comments are interesting.

Read the full post on the Spinn3r blog.


Viewing all articles
Browse latest Browse all 10

Latest Images

Trending Articles





Latest Images