報(bào)錯(cuò)信息:
2022-11-10 09:36:44,789 INFO mapreduce.Job: Job job_1668043088418_0004 failed with state FAILED due to: Application application_1668043088418_0004 failed 2 times due to AM Container for appattempt_1668043088418_0004_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2022-11-10 09:36:44.190]Exception from container-launch.
Container id: container_1668043088418_0004_02_000001
Exit code: 1
[2022-11-10 09:36:44.193]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
…
報(bào)錯(cuò)信息提示我們找不到main class 可能是環(huán)境變量的問(wèn)題。
解決方法一:
1、在命令行執(zhí)行,復(fù)制路徑信息。
hadoop classpath
2、編輯yarn-site.xml,添加信息:
<configuration>
<property>
<name>yarn.application.classpath</name>
<value>復(fù)制的Hadoop classpath信息</value>
</property>
</configuration>
3、在所有的主機(jī)節(jié)點(diǎn)上進(jìn)行如上設(shè)置,設(shè)置完畢后重啟Hadoop集群,重新運(yùn)行剛才的MapReduce程序,成功運(yùn)行。
解決方法二:
1、編輯yarn-site.xml,添加如下信息(須確保之前的環(huán)境配置正確):
<!-- 環(huán)境變量的繼承 -->
<property>
<name>yarn.nodemanager.env-whitelist</name>
<value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
</property>
??對(duì)于上圖中< value >包裹的內(nèi)容一定要連續(xù),即使分段也只能在逗號(hào)后斷開(kāi)。
2、在所有的主機(jī)節(jié)點(diǎn)進(jìn)行如上設(shè)置,設(shè)置完畢后重啟Hadoop集群即可。文章來(lái)源:http://www.zghlxwxcb.cn/news/detail-412879.html
說(shuō)明:
??其實(shí),在hadoop提供給我們的yarn-default-xml中,已經(jīng)有了相關(guān)的環(huán)境變量配置,只不過(guò)hadoop3.1有個(gè)bug是他沒(méi)加上HADOOP-MAPRED-HOME,這個(gè)問(wèn)題在3.2就解決了。文章來(lái)源地址http://www.zghlxwxcb.cn/news/detail-412879.html
<property>
<description>Environment variables that containers may override rather than use NodeManager's default.</description>
<name>yarn.nodemanager.env-whitelist</name>
<value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_HOME,PATH,LANG,TZ</value>
</property>
到了這里,關(guān)于Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster的文章就介紹完了。如果您還想了解更多內(nèi)容,請(qǐng)?jiān)谟疑辖撬阉鱐OY模板網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章,希望大家以后多多支持TOY模板網(wǎng)!