kafka 出现Java heap space的解决方法
問題:
測試環境異常,經過查看server.log日志,發現:java.lang.OutOfMemoryError: Java heap space,具體如下:
server.log:
[2021-03-03 09:25:17,744] ERROR [ReplicaManager broker=1] Error processing append operation on partition ss-liantong-20210303-2 (kafka.server.ReplicaManager)
java.lang.OutOfMemoryError: Java heap space
[2021-03-03 09:25:24,683] ERROR [ReplicaManager broker=1] Error processing append operation on partition sz-l2-level-20210303-0 (kafka.server.ReplicaManager)
java.lang.OutOfMemoryError: Java heap space
java.io.IOException: Connection to 1 was disconnected before the response was read ? ? ? ?
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:95) ? ? ? ?
at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:96) ? ? ?
?at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:205) ? ? ? ?
at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:41) ? ? ? ?
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:149) ? ? ?
?at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113) ? ? ? ?
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2021-03-03 09:31:13,002] INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)@
[2021-03-03 10:00:03,353] ERROR Processor got uncaught exception. (kafka.network.Processor)
java.lang.OutOfMemoryError: Java heap space
[2021-03-03 10:00:09,669] INFO Opening socket connection to server 172.16.2.179/172.16.2.179:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2021-03-03 10:00:07,487] INFO Updated PartitionLeaderEpoch. New: {epoch:1067, offset:172043}, Current: {epoch:1066, offset172027} for Partition: __consumer_offsets-24. Cache now contains 23 entries. (kafka.server.epoch.LeaderEpochFileCache)
[2021-03-03 10:00:07,484] ERROR Processor got uncaught exception. (kafka.network.Processor)
java.lang.OutOfMemoryError: Java heap space
以下是解決方法:
在kafka的啟動配置文件中去設置,在/bin目錄下找到kafka-run-class文件并編輯?
#vim /bin/kafka-run-class
找到?Memory options處,默認設置是256M,將其修改為如下值
# Memory options
if [ -z "$KAFKA_HEAP_OPTS" ]; then
KAFKA_HEAP_OPTS="-Xmx1024M -Xms512M"
fi
保存退出,再運行連接器,不再出現Java heap space錯誤,解決該問題。
總結
以上是生活随笔為你收集整理的kafka 出现Java heap space的解决方法的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 设计模式C++实现——观察者模式
- 下一篇: HTTPS详解