Oozie中允许hive程序xml配置
生活随笔
收集整理的這篇文章主要介紹了
Oozie中允许hive程序xml配置
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
<?xml version="1.0" encoding="UTF-8"?>
<!--Licensed to the Apache Software Foundation (ASF) under oneor more contributor license agreements. See the NOTICE filedistributed with this work for additional informationregarding copyright ownership. The ASF licenses this fileto you under the Apache License, Version 2.0 (the"License"); you may not use this file except in compliancewith the License. You may obtain a copy of the License athttp://www.apache.org/licenses/LICENSE-2.0Unless required by applicable law or agreed to in writing, softwaredistributed under the License is distributed on an "AS IS" BASIS,WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.See the License for the specific language governing permissions andlimitations under the License.
-->
<workflow-app xmlns="uri:oozie:workflow:0.5" name="wf-hive-select"><start to="hive-node"/><action name="hive-node"><hive xmlns="uri:oozie:hive-action:0.5"><job-tracker>${jobTracker}</job-tracker><name-node>${nameNode}</name-node><prepare><delete path="${nameNode}/${oozieDataRoot}/${outputDir}"/></prepare><job-xml>${nameNode}/${oozieAppsRoot}/hive-select/hive-site.xml</job-xml><configuration><property>--hive中使用的是老的API 不需要改動<name>mapred.job.queue.name</name><value>${queueName}</value></property></configuration>--SQL 腳本 select-student.sql<script>select-student.sql</script>--輸出目錄<param>OUTPUT=${nameNode}/${oozieDataRoot}/${outputDir}</param></hive><ok to="end"/><error to="fail"/></action><kill name="fail"><message>Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message></kill><end name="end"/>
</workflow-app>
?
?
job.propeties 文件
?
nameNode=hdfs://hadoop-senior.iIT.com:8020
jobTracker=hadoop-senior.iIT.com:8032
queueName=default
oozieAppsRoot=user/IT/oozie-apps
oozieDataRoot=user/IT/oozie/datas
oozie.use.system.libpath=true
oozie.wf.application.path=${nameNode}/${oozieAppsRoot}/hive-select/
outputDir=hive-select/output
?
?
select-student.sql? ?SQL腳本文件
?
insert overwrite directory '${OUTPUT}'
select
count(1) cnt
from default.student ;
?
轉載于:https://www.cnblogs.com/itBulls/articles/9348091.html
總結
以上是生活随笔為你收集整理的Oozie中允许hive程序xml配置的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: centOS 6.5 yum升级 gcc
- 下一篇: Flex布局及其应用