There is a lot of research going on right now surrounding how to create massive databases. Google, Amazon, and other companies are introducing web service APIs designed for data storage and retrieval.
Storage is pretty much solved now. Amazon S3 covers that. But efficiently querying and retrieving that data is an amazing challenge. I’m working with a company now that needs to query literally a trillion database records. How do you build a scalable, distributed system to do that? It’s one of those projects that makes more sense to resell after you have built it for yourself.
What do you think? Is it possible that some good solutions can only be created through collective effort? Are some solutions too expensive for any one organization to justify the cost? Do we have any solutions on the horizon that would take the cooperation of the whole world to distribute the costs?
0 responses so far ↓
There are no comments yet...Kick things off by filling out the form below.
Leave a Comment