hive metastore日志中報(bào)錯(cuò)：
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
????? at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:444)
????? at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:672)
????? at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
????? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
????? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
????? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
????? at java.lang.reflect.Method.invoke(Method.java:606)
????? at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
???? at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
?Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
???? at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1449)
???? at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:63)
???? at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:73)
???? at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2661)
???? at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2680)
???? at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:425)
???? ... 8 more
?Caused by: java.lang.reflect.InvocationTargetException
???? at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
???? at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
???? at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
???? at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
???? at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1447)
???? ... 13 more
?Caused by: MetaException(message:Metastore contains multiple versions)
???? at org.apache.hadoop.hive.metastore.ObjectStore.getMSchemaVersion(ObjectStore.java:6643)
???? at org.apache.hadoop.hive.metastore.ObjectStore.getMetaStoreSchemaVersion(ObjectStore.java:6605)
???? at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:6564)
???? at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:6552)
???? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
???? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
???? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
???? at java.lang.reflect.Method.invoke(Method.java:606)
???? at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98)
???? at com.sun.proxy.$Proxy5.verifySchema(Unknown Source)
???? at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:539)
???? at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:587)
???? at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:429)
???? at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66)
???? at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72)
???? at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5554)
???? at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:178)
???? at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:73)

因?yàn)閔ive metastore存儲(chǔ)在mysql中，所以登錄mysql，use hive所使用的DB，然后 查詢下VERSION表
mysql> select * from VERSION;
+--------+----------------+------------------+
| VER_ID | SCHEMA_VERSION | VERSION_COMMENT? |
+--------+----------------+------------------+
|????? 1 | 0.14.0???????? | Set by MetaStore |
+--------+----------------+—————————+
|???? 16 | 0.14.0???????? | Set by MetaStore |
+--------+----------------+—————————+

問題已經(jīng)通過刪除多余的版本記錄解決，

保留第一條記錄，其他記錄全部刪除
delete from VERSION where VER_ID=16;
或者
delete from VERSION where VER_ID !=1;

出現(xiàn)這類異常問題原因,hive 是不支持并發(fā)的，估計(jì)不小心啟動(dòng)多個(gè)hive，也可能是網(wǎng)絡(luò)問題，反正很詭異;

網(wǎng)上有些解決方法，為了避免這種問題再次出現(xiàn)，請?jiān)趆ive客戶端開啟以下配置項(xiàng)：

<property>
? <name>hive.metastore.schema.verification</name>
? <value>true</value>
</property>

開啟該選項(xiàng)后，重啟hive客戶端和MetaStore Server。

hive.metastore.schema.verification：
強(qiáng)制metastore的schema一致性，開啟的話會(huì)校驗(yàn)在metastore中存儲(chǔ)的信息的版本和hive的jar包中的版本一致性，并且關(guān)閉自動(dòng)schema遷移，用戶必須手動(dòng)的升級hive并且遷移schema，關(guān)閉的話只會(huì)在版本不一致時(shí)給出警告，默認(rèn)是false不開啟；

但是以上方法為證明可以解決這個(gè)問題，而且我的環(huán)境下存在多版本hive客戶端，如果設(shè)置為True可能會(huì)影響hive客戶端提交任務(wù)，為采用這個(gè)方式。

網(wǎng)上查到有鎖表lock tables VERSION read;的命令，但是退出終端或者重啟mysql就會(huì)失效，無法使用
開始嘗試想讓這個(gè)VERSION表只讀，但是沒有好的方法。
mysql沒有對單一表進(jìn)行查詢權(quán)限及其他所有表進(jìn)行所有權(quán)限設(shè)置。
mysql設(shè)置只能針對沒一個(gè)表逐一設(shè)置下權(quán)限，這樣的風(fēng)險(xiǎn)太大不建議線上hive表操作。
hive表有53個(gè)，想對VERSION設(shè)置只讀，那就需要?jiǎng)h除現(xiàn)有hive用戶權(quán)限，對VERSION表設(shè)置select權(quán)限，其他52個(gè)表一個(gè)個(gè)設(shè)置GRANT ALL權(quán)限，這可是生產(chǎn)環(huán)境，不建議這么操作。

現(xiàn)在想到解決方法：
寫個(gè)shell定時(shí)去刪除VERSION表中VER_ID 不等于1的數(shù)據(jù)，這個(gè)方法就比較難維護(hù)，時(shí)間長就忘記了。

其實(shí)這樣的情況很少出現(xiàn)，一次刪除多余的數(shù)據(jù)，也是可以的，有時(shí)候不要較真。
這個(gè)問題是hive版本的bug在新版本中不存在，我在測試環(huán)境hive1.1.0，建立多條數(shù)據(jù)也沒有問題

腳本：
cat check_hive.sh
#!/bin/bash
export PATH=/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin:/root/bin

#用戶和密碼
DBUSER="hive"
DBPW="123456789"
DATE=`date +%Y%m%d%H%m%S`
OUTFILE=/tmp/check_hive.log
#讀取第二行，因?yàn)榈谝恍惺莄ount(*)
st=$(/usr/bin/mysql -u$DBUSER -p$DBPW? -e 'select count(*) from hive.VERSION;'|sed -n '2p')
echo "$st"
#判斷下如何是一行顯示正常，不是一行就刪除VER_ID不等于1的
if [ "$st" == 1 ]
then
??? echo "$DATE hive.VERSION count = 1" >> $OUTFILE
else
??? /usr/bin/mysql -u$DBUSER -p$DBPW? -e 'delete from hive.VERSION where VER_ID !=1;' && echo "$DATE hive.VERSION count != 1 , delete table data!" >> $OUTFILE
fi

查看數(shù)據(jù)
mysql> select * from VERSION;
+--------+----------------+------------------+
| VER_ID | SCHEMA_VERSION | VERSION_COMMENT? |
+--------+----------------+------------------+
|????? 1 | 0.14.0???????? | Set by MetaStore |
+--------+----------------+------------------+

參考命令：
use hive;
鎖表
lock tables VERSION read;
解鎖表
mysql>unlock tables;
LOCK TABLES為當(dāng)前線程鎖定表。 UNLOCK TABLES釋放被當(dāng)前線程持有的任何鎖。當(dāng)線程發(fā)出另外一個(gè)LOCK TABLES時(shí)，或當(dāng)服務(wù)器的連接被關(guān)閉時(shí)，當(dāng)前線程鎖定的所有表會(huì)自動(dòng)被解鎖。
insert into VERSION? values('1.1.0','Hive release version 1.1.0');

查看是否有鎖表
SHOW PROCESSLIST;

查看鎖
mysql> show global status like "table_locks%";

查看表級鎖的征用情況
mysql> show status like 'table%';

mysql> show grants for 'hive'@'%';
show grants for hive;

插入數(shù)據(jù)
insert into VERSION values(2,'1.1.0','Hive release version 1.1.0');

刪除數(shù)據(jù)
delete from VERSION where VER_ID=2;

刪除權(quán)限
revoke ALL PRIVILEGES ON `hive`.* TO 'hive'@'%'

設(shè)置權(quán)限
grant select ON hive.VERSION TO 'hive'@'%';

刷新授權(quán)
flush privileges ;

hive庫中表
mysql> show tables;
+---------------------------+
| Tables_in_hive??????????? |
+---------------------------+
| BUCKETING_COLS??????????? |
| CDS?????????????????????? |
| COLUMNS_V2??????????????? |
| COMPACTION_QUEUE????????? |
| COMPLETED_TXN_COMPONENTS? |
| DATABASE_PARAMS?????????? |
| DBS?????????????????????? |
| DB_PRIVS????????????????? |
| DELEGATION_TOKENS???????? |
| DELETEME1480404975708???? |
| FUNCS???????????????????? |
| FUNC_RU?????????????????? |
| GLOBAL_PRIVS????????????? |
| HIVE_LOCKS??????????????? |
| IDXS????????????????????? |
| INDEX_PARAMS????????????? |
| MASTER_KEYS?????????????? |
| NEXT_COMPACTION_QUEUE_ID? |
| NEXT_LOCK_ID????????????? |
| NEXT_TXN_ID?????????????? |
| NUCLEUS_TABLES??????????? |
| PARTITIONS??????????????? |
| PARTITION_EVENTS????????? |
| PARTITION_KEYS??????????? |
| PARTITION_KEY_VALS??????? |
| PARTITION_PARAMS????????? |
| PART_COL_PRIVS??????????? |
| PART_COL_STATS??????????? |
| PART_PRIVS??????????????? |
| ROLES???????????????????? |
| ROLE_MAP????????????????? |
| SDS?????????????????????? |
| SD_PARAMS???????????????? |
| SEQUENCE_TABLE??????????? |
| SERDES??????????????????? |
| SERDE_PARAMS????????????? |
| SKEWED_COL_NAMES????????? |
| SKEWED_COL_VALUE_LOC_MAP? |
| SKEWED_STRING_LIST??????? |
| SKEWED_STRING_LIST_VALUES |
| SKEWED_VALUES???????????? |
| SORT_COLS???????????????? |
| TABLE_PARAMS????????????? |
| TAB_COL_STATS???????????? |
| TBLS????????????????????? |
| TBL_COL_PRIVS???????????? |
| TBL_PRIVS???????????????? |
| TXNS????????????????????? |
| TXN_COMPONENTS??????????? |
| TYPES???????????????????? |
| TYPE_FIELDS?????????????? |
| VERSION?????????????????? |

+---------------------------+
參考：
http://blog.csdn.net/wisgood/article/details/45742039
http://blog.chinaunix.net/uid-21505614-id-289450.html
https://my.oschina.net/ghostmanyue/blog/500684
http://blog.csdn.net/youngqj/article/details/19987727

總結(jié)

以上是生活随笔為你收集整理的hive metastore日志中报错message:Metastore contains multiple versions的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。