|

Hadoop 101 by Chris Wensel

Posted on June 22, 2009 by Randy Bias

 

What conversation about cloud computing is complete without a mention of big data, distributing processing, and distributed databases?  There is a recent trend away from relying exclusively on the traditional relational database for everything.  Newer technologies like BigTable and Hadoop provide an alternative mechanism for storing and processing large sets of data that don’t necessarily have extensive relationships needing modeling.  These technologies allow for a much more scalable solution.

In fact, they help in two ways: one by allowing an application to process more data using horizontal scalability (aka ‘elasticity’) and two by reducing load on the primary relational database and hence allowing you to go longer before ‘sharding‘.

Chris Wensel is the man when it comes to understanding Hadoop and he recently gave a couple of talks introducing Hadoop.  Here is one of them:

Building Scale Free Applications with Hadoop and Cascading

View more Microsoft Word documents from cwensel.

This entry was posted in Uncategorized and tagged , , , , , . Bookmark the permalink.

|

  • http://www.roadtofailure.com/ Bradford

    This is a pretty good intro to the Hadoop world! I like how you mention avoiding 'sharding' and the pains of RDBMSs.

    I think you might like an article I wrote on the pitfalls of sharding and RDBMSs on my blog — http://www.roadtofailure.com . Let me know what you think :)

  • Pingback: BotchagalupeMarks for June 27th - 20:48 | IT Management and Cloud Blog

  • tomgullo

    Great slides. I agree, Map-Group-Reduce is more descriptive.

  • OxjdlkTaylor

    You seem to have got the niche from the root, Awesome work

    Regards

  • OrrjdlkLauren

    Woow This is best blog i have read on the tpoic

    Have a nice day
    gibs
    ______________________________________________
    aion gold | aion kina

  • http://gisnap.com gisnap

    Its really cool, I came to know this really worth visiting, just bookmarked your site.

    http://gisnap.com/
    The place where fun never ends

Required Reading

Recent Posts

Categories

Discussion


Tags

Administrivia amazon api audits Automation aws cio cloud Cloud Applications cloud futures series cloudscaling commoditization conferences databases decentralization devops EC2 elastic compute cloud enterprise GoGrid hadoop iaas infrastructure Internet Operations Just Plain Cool Lew Tucker Networking open OpenStack paas performance predictions presentations private cloud Rackspace Randy Bias saas scaling Security standards Storage Swift Virtualization vmware web-scale

Cloudscaling Successes

Cloudscaling delivers on open cloud solutions that meet our customers business needs

Open clouds for cloud storage solutions
Open clouds provide cost-competitive public cloud offerings

Cloudscaling Careers

Open clouds are changing the game. You can too, by joining the world's most innovative cloud engineering team. Hack on OpenStack, work with other brilliant minds, and have fun while doing it!
Take a look at our career openings.

May

21

OSBC

OSBC Hyatt Regency San Francisco
San Francisco CA

The 2012 Computerworld Open Source Business Conference will once again present current ideas and implementation case studies bringing open source technologies to broad application. Cloudscaling's Troy Angrignon will present a session on the lessons that market leaders like AWS have to teach, and how those concepts can be applied in open frameworks.

May

22

Open Storage Summit EMEA

Open Storage Summit EMEA Mercure Hotel Amsterdam Aan de Amstel
1096 CJ Amsterdam

This year's Nexenta EMEA gathering will feature in-depth technical tutorials on OpenStorage. Our talk is titled, "Clouds are Complex, But Simplicity Scales." Join us in Amsterdam May 22-24.

© 2012 Cloudscaling   |  
Simplicity scales.