[2018-10-18 19:40:27.332]Exception from container-launch.
Container id: container_1539853922352_0003_01_000002
Exit code: 1
[2018-10-18 19:40:27.340]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
[2018-10-18 19:40:27.356]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
解决方案:
在mapred-site.xml文件中添加mapreduce所需要用到的classpath。
<property>
<name>mapreduce.application.classpath</name>
<value><hadoop跟目录>/share/hadoop/mapreduce/*, <hadoop跟目录>/share/hadoop/mapreduce/lib/*</value>
</property>
报错:
org.apache.kylin.engine.mr.exception.MapReduceException: Exception: java.net.ConnectException: Call From kylin2/172.26.76.124 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
java.net.ConnectException: Call From kylin2/172.26.76.124 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:234)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:234)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
![image.png](https://upload-images.jianshu.io/upload_images/18022395-40ed4527a24f0f21.png?imageMogr2/auto-orient/strip%7CimageView2/2/w/1240)
解决方案
(老版本)在mapred-site.xml文件中添加
<property>
<name>mapreduce.jobhistory.address</name>
<value>kylin1:10020</value>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>kylin1:19888</value>
</property>
(新版本) yarn-site.xml 中添加
</property>
<!--新版本指定文件-->
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>kylin1</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address.rm2</name>
<value>kylin2</value>
</property>
<property>
报错:
Container [pid=8794,containerID=container_1552484587522_0002_01_000005] is running 431118848B beyond the 'VIRTUAL' memory limit. Current usage: 51.4 MB of 1 GB physical memory used; 2.5 GB of 2.1 GB virtual memory used. Killing container.
解决方案:
hadoop 配置文件 yarn-site.xml 中添加
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>