我按照教程學(xué)習(xí)使用 Java 的 Hadoop。我在 中編寫Wordcount程序IntelliJ并且作業(yè)成功,我可以看到正確的輸出文件。現(xiàn)在,我想在 Hadoop 集群中運(yùn)行該應(yīng)用程序,但失敗了。Hadoop 設(shè)置本身很好并且可以正常啟動(dòng)。這是我在目錄中的內(nèi)容,$ hadoop fs -ls 2018-08-18 09:15:44,012 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicableFound 2 itemsdrwxr-xr-x - chaklader supergroup 0 2018-08-17 12:17 Wordcount-rw-r--r-- 1 chaklader supergroup 530989 2018-08-15 13:13 forum_users.tsvpom.xml下面提供了應(yīng)用程序中的文件,<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>com.test</groupId> <artifactId>wordcount</artifactId> <version>0.0.1-SNAPSHOT</version> <packaging>jar</packaging> <name>wordcount</name> <url>http://maven.apache.org</url> <properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> </properties> <dependencies> <!-- Hadoop --> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-core</artifactId> <version>RELEASE</version> </dependency> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>RELEASE</version> <scope>test</scope> </dependency> </dependencies>這是項(xiàng)目設(shè)置,當(dāng)我運(yùn)行該程序時(shí),它會(huì)創(chuàng)建一個(gè)JAR文件wordcount.jar,并將其放入Downloads目錄中。最后,我執(zhí)行命令在Hadoop集群中運(yùn)行作業(yè),$ hadoop jar Downloads/wordcount.jar /Users/chaklader/IdeaProjects/Wordcount/src/main/java/com/test/hadoop/WordCount /user/chaklader/Wordcount/Input/input.txt /user/chaklader/Wordcount/OutputUsage: WordCount needs two arguments <input> <output> files 該錯(cuò)誤表明WordCount needs two arguments <input> <output> files. 我檢查了所有路徑,似乎是正確的。這里有什么問題?
2 回答

拉風(fēng)的咖菲貓
TA貢獻(xiàn)1995條經(jīng)驗(yàn) 獲得超2個(gè)贊
您應(yīng)該提供 WordCount 類的包路徑。改變這個(gè)
$ hadoop jar Downloads/wordcount.jar /Users/chaklader/IdeaProjects/Wordcount/src/main/java/com/test/hadoop/WordCount /user/chaklader/Wordcount/Input/input.txt /user/chaklader/Wordcount/Output
到
$ hadoop jar Downloads/wordcount.jar com.test.hadoop.WordCount /user/chaklader/Wordcount/Input/input.txt /user/chaklader/Wordcount/Output

慕慕森
TA貢獻(xiàn)1856條經(jīng)驗(yàn) 獲得超17個(gè)贊
教程中的命令不正確。它應(yīng)該是
$ hadoop jar wordcount.jar Wordcount/Input/input.txt Wordcount/Output
創(chuàng)建JAR
文件后,首先不需要提供創(chuàng)建它的 Java 類路徑。
添加回答
舉報(bào)
0/150
提交
取消