Know U R Cloud: Google File System : need

Know U R Cloud:

" Post" ing is the most common of all user activities on social networking site such as FB ,Twitter or Google+. The post feature needs supporting for many "producers" appending (comments, likes, +s) to the same file in parallel, which is also being simultaneously read by many parallell "counsumers". 

Example:
Yesterday Nikhil Huilgol made a post on "Desi Boys" from New York and a comment was made on it from Dharwad even when it was showing " just now"

Google File System (GFS) is designed to manage relatively large files using a very large distributed cluster of commodity servers by a high speed network.

GFS is designed to (a) expect and tolerate hardware failures, even during reading and writing of an indiviual file and (b) supoort parallel reads, writes and appends by multiple client programs.

Know Your Cloud: Google's Work

Although IBM had a phrase ' Solutions for a Small Planet", Google was one of the companies which was destined to address a truly " planetary scale challenge".


In their pursuit of creating a planetary scale web search service, Google developed a massively parallel and fault tolerant distributed file system (GFS) along with a data organization ( BigTable) and a programming paradigm (MapReduce) that is drastically different from the traditional relational model.


This "Managing  Data in the cloud" approach is  particularly suitable for large volume, massively parallel text processing and possibly for analytics.


The public cloud offerings from Google- Gmail, GAE, Blogger and more are available to users as part of this cloud platforms developed.

Know Your Cloud: Apache Cassandra

Know UR Cloud

 Apache Cassandra- an open source distributed database management system. Designed to handle very large amounts of data spread across many commodity servers while providing a highly available service with no single point of failure.
Until 2010, Facebook powered its Inbox search feature using this technology