hadoop 启动 报running beyond virtual memory错误的解决
報(bào)錯(cuò)日志:
[2019-01-04 11:05:50.749]Container [pid=7247,containerID=container_1546564651505_0001_01_000002] is running 219036160B beyond the 'VIRTUAL' memory limit. Current usage: 37.6 MB of 1 GB physical memory used; 2.3 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_1546564651505_0001_01_000002 :
?? ?|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
?? ?|- 7256 7247 7247 7247 (java) 93 79 2464104448 9358 /usr/local/java/jdk1.8.0_171/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -Xmx820m -Djava.io.tmpdir=/usr/local/hadoop/hadoop_tmp/nm-local-dir/usercache/root/appcache/application_1546564651505_0001/container_1546564651505_0001_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/usr/local/hadoop/hadoop-3.1.0/logs/userlogs/application_1546564651505_0001/container_1546564651505_0001_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.59.128 34026 attempt_1546564651505_0001_m_000000_0 2?
解決辦法:在mapred-site.xml文件,設(shè)置如下配置
<property>
<name>mapreduce.map.memory.mb</name>
<value>1536</value>
</property>
<property>
<name>mapreduce.map.java.opts</name>
<value>-Xmx1024M</value>
</property>
<property>
<name>mapreduce.reduce.memory.mb</name>
<value>3072</value>
</property>
<property>
<name>mapreduce.reduce.java.opts</name>
<value>-Xmx2560M</value>
</property>
注意:修改后不用格式化系統(tǒng),重新啟動(dòng)hadoop即可生效
https://blog.csdn.net/AHAU10/article/details/53484770
都看到這里了,就順手點(diǎn)擊左上角的【關(guān)注】按鈕,點(diǎn)擊右上角的小手,給個(gè)評(píng)論,關(guān)注一下,再走唄!?
總結(jié)
以上是生活随笔為你收集整理的hadoop 启动 报running beyond virtual memory错误的解决的全部?jī)?nèi)容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 通过福禄克FI-7000光纤显微摄像机进
- 下一篇: Python之操作HBASE数据库