Introduction to Cloud Computing

Jongwook Woo, California State University, Los Angeles
Introduction to Cloud Computing, the 10th KOCSEA 2009 Symposium, UNLV,
Dec 18-19, 2009

Set up Hadoop in Eclipse

Set up Hadoop in Eclipse


Hadoop on Windows with Eclipse

Hadoop Example: MyMaxTemperatureWithCombiner

1. Set up Hadoop in Eclipse
   
   Hadoop on Windows with Eclipse
   

2. Hadoop Example
   
   MyMaxTemperatureWithCombiner.java,
   MaxTemperatureMapper.java,
   MaxTemperatureReducer.java
   
   
   How to run the example codes:
   
   



1. You need to set up Hadoop as shown above (Set up Hadoop in Eclipse)


2. make a directory named "tempIn" at your hadoop:
   
   bin/hadoop fs -mkdir tempIn
   


3. copy input files 1901 and
   1902 to your HDF:
   
   bin/hadoop fs -cp 1901 tempIn/
   
   bin/hadoop fs -cp 1902 tempIn/


4. In the eclipse IDE, imports three java files above under package named "edu.calstatela.hipic.hadoop.util"
   


5. Start Hadoop cluster as shown above (Set up Hadoop in Eclipse)
   


6. In the eclipse IDE, Right click on
   MyMaxTemperatureWithCombiner.java, choose "Run as" > "Run Hadoop
   Application"


7. You will see the map/reduce results at the HDF folder "tempOut"
   in DFS Location of eclipse IDE