hadoop 설치

페이지 정보

작성자 조희승 댓글 0건 조회 9,286회 작성일 12-08-17 15:13

본문

crazia.tistory.com/742
crazia.tistory.com/743
crazia.tistory.com/822
examples
bin/hadoop jar hadoop-examples-1.0.1.jar
An example program must be given as the first argument.
Valid program names are:
aggregatewordcount: An Aggregate based map/reduce program that counts the words in the input files.
aggregatewordhist: An Aggregate based map/reduce program that computes the histogram of the words in the input files.
dbcount: An example job that count the pageview counts from a database.
grep: A map/reduce program that counts the matches of a regex in the input.
join: A job that effects a join over sorted, equally partitioned datasets
multifilewc: A job that counts words from several files.
pentomino: A map/reduce tile laying program to find solutions to pentomino problems.
pi: A map/reduce program that estimates Pi using monte-carlo method.
randomtextwriter: A map/reduce program that writes 10GB of random textual data per node.
randomwriter: A map/reduce program that writes 10GB of random data per node.
secondarysort: An example defining a secondary sort to the reduce.
sleep: A job that sleeps at each map and reduce task.
sort: A map/reduce program that sorts the data written by the random writer.
sudoku: A sudoku solver.
teragen: Generate data for the terasort
terasort: Run the terasort
teravalidate: Checking results of terasort
wordcount: A map/reduce program that counts the words in the input files.
terasort
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/examples/terasort/package-summary.html
teragen
../bin/hadoop jar ../hadoop-examples-1.0.1.jar teragen 1000 input
../bin/hadoop fs -rmr input
../bin/hadoop fs -get input .
terasort
../bin/hadoop jar ../hadoop-examples-1.0.1.jar terasort input output
../bin/hadoop fs -rmr output
../bin/hadoop fs -get output .

댓글목록

등록된 댓글이 없습니다.