Hive 0.13和HBase 0.98.6.1整合出現錯誤記錄下

hive> CREATE TABLE hbase_table_1(key int, value string) > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")> TBLPROPERTIES ("hbase.table.name" = "xyz1"); FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:java.io.IOException: Attempt to start meta tracker failed.at org.apache.hadoop.hbase.catalog.CatalogTracker.start(CatalogTracker.java:201)at org.apache.hadoop.hbase.client.HBaseAdmin.getCatalogTracker(HBaseAdmin.java:230)at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:277)at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:293)at org.apache.hadoop.hive.hbase.HBaseStorageHandler.preCreateTable(HBaseStorageHandler.java:162)at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:554)at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:547)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:606)at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:89)at com.sun.proxy.$Proxy11.createTable(Unknown Source)at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:613)at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4189)at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:281)at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1503)at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1270)at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1088)at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)at org.apache.hadoop.hive.ql.Driver.run(Driver.java:901)at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:606)at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/meta-region-serverat org.apache.zookeeper.KeeperException.create(KeeperException.java:99)at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:220)at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:425)at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:77)at org.apache.hadoop.hbase.catalog.CatalogTracker.start(CatalogTracker.java:197)... 33 more )

這個問題網上沒找到解決辦法，發現是hbase的錯誤

查了一下hbase的啟動日志，也發現一個錯誤

2014-10-08 14:57:56,261 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=jifeng 2014-10-08 14:57:56,262 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/home/jifeng 2014-10-08 14:57:56,262 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/home/jifeng/hbase-0.98.6.1-hadoop2 2014-10-08 14:57:56,263 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=feng02:2181,feng01:2181,feng03:2181 sessionTimeout=90000 watcher=master:60000, quorum=feng02:2181,feng01:2181,feng03:2181, baseZNode=/hbase 2014-10-08 14:57:56,293 INFO [main-SendThread(feng02:2181)] zookeeper.ClientCnxn: Opening socket connection to server feng02/10.6.3.201:2181. Will not attempt to authenticate using SASL (unknown error) 2014-10-08 14:57:56,300 WARN [main-SendThread(feng02:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.NoRouteToHostException: 沒有到主機的路由at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 2014-10-08 14:57:56,411 INFO [main-SendThread(feng01:2181)] zookeeper.ClientCnxn: Opening socket connection to server feng01/10.6.3.84:2181. Will not attempt to authenticate using SASL (unknown error) 2014-10-08 14:57:56,412 INFO [main-SendThread(feng01:2181)] zookeeper.ClientCnxn: Socket connection established to feng01/10.6.3.84:2181, initiating session 2014-10-08 14:57:56,419 WARN [main] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=feng02:2181,feng01:2181,feng03:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase 2014-10-08 14:57:56,419 INFO [main] util.RetryCounter: Sleeping 1000ms before retry #0... 2014-10-08 14:57:56,438 INFO [main-SendThread(feng01:2181)] zookeeper.ClientCnxn: Session establishment complete on server feng01/10.6.3.84:2181, sessionid = 0x48ee8cbea40000, negotiated timeout = 90000 2014-10-08 14:57:57,489 INFO [RpcServer.responder] ipc.RpcServer: RpcServer.responder: starting 2014-10-08 14:57:57,492 INFO [RpcServer.listener,port=60000] ipc.RpcServer: RpcServer.listener,port=60000: starting 2014-10-08 14:57:57,586 INFO [master:feng01:60000] mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2014-10-08 14:57:57,715 INFO [master:feng01:60000] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter) 2014-10-08 14:57:57,720 INFO [master:feng01:60000] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2014-10-08 14:57:57,721 INFO [master:feng01:60000] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2014-10-08 14:57:57,744 INFO [master:feng01:60000] http.HttpServer: Jetty bound to port 60010 2014-10-08 14:57:57,744 INFO [master:feng01:60000] mortbay.log: jetty-6.1.26 2014-10-08 14:57:58,225 INFO [master:feng01:60000] mortbay.log: Started SelectChannelConnector@0.0.0.0:60010 2014-10-08 14:57:58,350 DEBUG [main-EventThread] master.ActiveMasterManager: A master is now available 2014-10-08 14:57:58,353 INFO [master:feng01:60000] master.ActiveMasterManager: Registered Active Master=feng01,60000,1412751474911 2014-10-08 14:57:58,360 INFO [master:feng01:60000] Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS 2014-10-08 14:57:58,692 INFO [master:feng01:60000] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2014-10-08 14:57:58,715 INFO [master:feng01:60000] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2014-10-08 14:57:58,731 INFO [master:feng01:60000] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2014-10-08 14:57:58,753 INFO [master:feng01:60000] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2014-10-08 14:57:58,772 INFO [master:feng01:60000] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available 2014-10-08 14:57:58,798 DEBUG [master:feng01:60000] util.FSTableDescriptors: Current tableInfoPath = hdfs://feng01:9000/hbase/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2014-10-08 14:57:58,825 DEBUG [master:feng01:60000] util.FSTableDescriptors: TableInfo already exists.. Skipping creation 2014-10-08 14:57:58,875 INFO [master:feng01:60000] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2014-10-08 14:57:58,883 DEBUG [master:feng01:60000] master.SplitLogManager: Distributed log replay=false, hfile.format.version=2 2014-10-08 14:57:58,889 INFO [master:feng01:60000] master.SplitLogManager: Timeout=120000, unassigned timeout=180000, distributedLogReplay=false 2014-10-08 14:57:58,892 INFO [master:feng01:60000] master.SplitLogManager: Found 0 orphan tasks and 0 rescan nodes 2014-10-08 14:57:58,921 INFO [master:feng01:60000] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7f963b79 connecting to ZooKeeper ensemble=feng02:2181,feng01:2181,feng03:2181 2014-10-08 14:57:58,921 INFO [master:feng01:60000] zookeeper.ZooKeeper: Initiating client connection, connectString=feng02:2181,feng01:2181,feng03:2181 sessionTimeout=90000 watcher=hconnection-0x7f963b79, quorum=feng02:2181,feng01:2181,feng03:2181, baseZNode=/hbase 2014-10-08 14:57:58,922 INFO [master:feng01:60000-SendThread(feng02:2181)] zookeeper.ClientCnxn: Opening socket connection to server feng02/10.6.3.201:2181. Will not attempt to authenticate using SASL (unknown error) 2014-10-08 14:57:58,923 WARN [master:feng01:60000-SendThread(feng02:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.NoRouteToHostException: 沒有到主機的路由at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735)at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 2014-10-08 14:57:59,025 WARN [master:feng01:60000] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=feng02:2181,feng01:2181,feng03:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid 2014-10-08 14:57:59,026 INFO [master:feng01:60000] util.RetryCounter: Sleeping 1000ms before retry #0... 2014-10-08 14:57:59,026 INFO [master:feng01:60000-SendThread(feng03:2181)] zookeeper.ClientCnxn: Opening socket connection to server feng03/10.6.3.202:2181. Will not attempt to authenticate using SASL (unknown error) 2014-10-08 14:57:59,027 INFO [master:feng01:60000-SendThread(feng03:2181)] zookeeper.ClientCnxn: Socket connection established to feng03/10.6.3.202:2181, initiating session 2014-10-08 14:57:59,030 INFO [master:feng01:60000-SendThread(feng03:2181)] zookeeper.ClientCnxn: Session establishment complete on server feng03/10.6.3.202:2181, sessionid = 0x248ee8c90290001, negotiated timeout = 90000 2014-10-08 14:58:00,055 DEBUG [master:feng01:60000] catalog.CatalogTracker: Starting catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@5f872ecf
發現配置的時候，feng02,feng03沒有?zookeeper-3.4.6

scp -r ./zookeeper-3.4.6 jifeng@feng02:/home/jifeng

scp -r ./zookeeper-3.4.6 jifeng@feng03:/home/jifeng

停止Hbase：bin/stop-hbase.sh

重新啟動： ? ??bin/start-hbase.sh

沒有問題了，不過還不清楚什么原因

總結

以上是生活随笔為你收集整理的hive.ql.exec.DDLTask. MetaException(message:java.io.IOException: Attempt to start meta tracker faile的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。