CDH- Hive HWI 配置
生活随笔
收集整理的這篇文章主要介紹了
CDH- Hive HWI 配置
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
目錄
?
一、HWI安裝
二、其中遇到一些問題:
1.遇到如下問題,將jre環境中的toos.jar 服務到lib目錄下
2.CDH中沒有hwi相關配置參數,手動加入并修改端口為9998,發現并未生效,暫時未找到原因所在。
一、HWI安裝
通過查看《Hadoop權威指南》發現hive有 hwi功能研究一下看看是否方便
執行
[root@test111 lib]# hive --service hwi OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release ls: cannot access /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/hive-hwi-*.war: No such file or directory OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 18/09/21 11:16:03 INFO hwi.HWIServer: HWI is starting up 18/09/21 11:16:03 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 18/09/21 11:16:03 INFO mortbay.log: jetty-6.1.26.cloudera.4 18/09/21 11:16:04 INFO mortbay.log: Started SocketConnector@0.0.0.0:9999訪問鏈接發現根本不是web頁面,媽的。都是文件
后來發現需要編譯相關war包,傳入服務器。?
首先下載相對應的源碼下載地址:http://www.apache.org/dyn/closer.cgi/hive/
進入hwi目錄
apache-hive-1.2.2-src/hwi編譯成war包?
注意打包方式要使用這種,網上很多種方式,使用完之后發現還不是web操作頁面
jar cvfM0 hive-hwi-1.2.1.war -C web/ .?查找hive的目錄安裝在
/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hive/lib?將hive-hwi-1.2.1.war 復制到該目錄下,運行報錯如下
[root@test111 hive]# hive --service hwi OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 18/09/21 11:11:25 INFO hwi.HWIServer: HWI is starting up 18/09/21 11:11:26 ERROR hwi.HWIServer: HWI WAR file not found at /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/hive-hwi-1.1.0.war?提示文件沒有在目錄中找到,cd進這個目錄發現沒有該目錄,手動創建
[root@test111 hive]# mkdir -p /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/將文件?hive-hwi-1.2.1.war 也復制到該目錄下
再次執行
[root@test111 lib]# hive --service hwi OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 18/09/21 11:15:00 INFO hwi.HWIServer: HWI is starting up 18/09/21 11:15:00 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 18/09/21 11:15:00 INFO mortbay.log: jetty-6.1.26.cloudera.4 18/09/21 11:15:00 INFO mortbay.log: Extract /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/hive-hwi-1.1.0.war to /tmp/Jetty_0_0_0_0_9999_hive.hwi.1.1.0.war__hwi__.4otk49/webapp 18/09/21 11:15:00 INFO mortbay.log: Started SocketConnector@0.0.0.0:9999訪問http://192.168.2.111:9999/hwi/? ?一定要加上hwi 否則無法訪問
?
二、其中遇到一些問題:
1.遇到如下問題,將jre環境中的toos.jar 服務到lib目錄下
cp tools.jar /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hive/lib 18/09/21 10:35:21 ERROR mortbay.log: /hwi/hwi/web/ Unable to find a javac compiler; com.sun.tools.javac.Main is not on the classpath. Perhaps JAVA_HOME does not point to the JDK. It is currently set to "/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.181-3.b13.el7_5.x86_64/jre"at org.apache.tools.ant.taskdefs.compilers.CompilerAdapterFactory.getCompiler(CompilerAdapterFactory.java:129)at org.apache.tools.ant.taskdefs.Javac.findSupportedFileExtensions(Javac.java:979)at org.apache.tools.ant.taskdefs.Javac.scanDir(Javac.java:956)at org.apache.tools.ant.taskdefs.Javac.execute(Javac.java:927)at org.apache.jasper.compiler.AntCompiler.generateClass(AntCompiler.java:220)at org.apache.jasper.compiler.Compiler.compile(Compiler.java:298)at org.apache.jasper.compiler.Compiler.compile(Compiler.java:277)at org.apache.jasper.compiler.Compiler.compile(Compiler.java:265)at org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:564)at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:299)at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:315)at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:265)at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:327)at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:126)at org.mortbay.jetty.servlet.DefaultServlet.doGet(DefaultServlet.java:503)at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)at org.mortbay.jetty.handler.RequestLogHandler.handle(RequestLogHandler.java:49)at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)at org.mortbay.jetty.Server.handle(Server.java:326)at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)2.CDH中沒有hwi相關配置參數,修改端口為9991
CDH中修改配置參數,hive-site相關有很多個配置,修改如圖所示的那個參數,其他的修改無法生效。
hive-site.xml 的 Hive 客戶端高級配置代碼段(安全閥) <property><name>hive.hwi.listen.port</name><value>9991</value><final>true</final> </property>HWI 簡單使用 參考:https://blog.csdn.net/zhangshenghang/article/details/82800390?
總結
以上是生活随笔為你收集整理的CDH- Hive HWI 配置的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 暗时间-领悟
- 下一篇: 几个重要库函数的实现