{"id":20,"date":"2009-03-05T20:09:33","date_gmt":"2009-03-06T01:09:33","guid":{"rendered":"http:\/\/jamesdevine.info\/?page_id=20"},"modified":"2015-01-14T12:40:15","modified_gmt":"2015-01-14T17:40:15","slug":"hadoop-cluster","status":"publish","type":"page","link":"https:\/\/jamesdevine.info\/index.php\/projects\/hadoop-cluster\/","title":{"rendered":"Hadoop Cluster"},"content":{"rendered":"

About<\/h3>\n

Hadoop is a Distributed File System written in Java that supports MapReduce. This project looked at the scalability of Hadoop MapReduce on a growing cluster size with a fixed problem. The study was run on both a real and virtual cluster.<\/p>\n

Results of a Scalability Performance Study<\/h3>\n

\"\"<\/p>\n

Hadoop Scalability Report<\/a><\/p>\n

Hadoop Scalability Slides<\/a><\/p>\n

Source Code<\/h3>\n

The source code consists of several bash scripts that were written to carry out the experimentation.<\/p>\n

\n

Source Code and Scripts<\/a><\/p>\n

Input<\/h3>\n

The input consists of a variety of free ebooks that were downloaded from Project Gutenberg.<\/p>\n

Input<\/a><\/p>\n

Output<\/h3>\n

The output of the experiments can be downloaded below.<\/p>\n

Output<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

About Hadoop is a Distributed File System written in Java that supports MapReduce. This project looked at the scalability of […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":5,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"class_list":["post-20","page","type-page","status-publish","hentry"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t