apache kylin 2.1.0+CDH5.8 安裝部署教程

作爲一個kylin的初學者來說,首要任務是需要安裝kylin,本文將給大家講述如何安裝kylin 2.1.0 ,本文參考了kylin的官方文檔寫的,官方文檔

由於目前kylin 2.0開始支持spark,這裏會加上spark的詳細配置

由於hadoop,hive,hbase版本是cdh5.8 ,我們下載的時候下載cdh的包

1、下載kylin 2.1.0

下載地址:http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-2.1.0/apache-kylin-2.1.0-bin-cdh57.tar.gz

2、解壓文件

tar zxvf apache-kylin-2.1.0-bin-cdh57.tar.gz  /usr/share/apache-kylin/apache-kylin-2.1.0-bin-cdh57
cd /usr/share/apache-kylin/apache-kylin-2.1.0-bin-cdh57

3、添加kylin用戶,專門用來執行

useradd -g kylin kylin
su kylin

4、配置文件

用戶目錄下新建hadoop_conf目錄,將hadoop,yarn,hive,hbase的site.xml複製到該目錄下面

mkdir hadoop_conf
cp /usr/share/hadoop/conf/*-site.xml /usr/share/apache-kylin/apache-kylin-2.1.0-bin-cdh57/hadoop_conf/
cp /usr/share/hbase/conf/hbase-site.xml /usr/share/apache-kylin/apache-kylin-2.1.0-bin-cdh57/hadoop_conf/
export KYLIN_HOME=/usr/share/apache-kylin/apache-kylin-2.1.0-bin-cdh57
修改conf/kylin.properties

kylin.env.hadoop-conf-dir=/usr/share/apache-kylin/apache-kylin-2.1.0-bin-cdh57/hadoop_conf/
kylin.engine.spark-conf.spark.master=yarn
kylin.engine.spark-conf.spark.submit.deployMode=cluster
kylin.engine.spark-conf.spark.yarn.queue=default
kylin.engine.spark-conf.spark.executor.memory=4G
kylin.engine.spark-conf.spark.executor.cores=2
kylin.engine.spark-conf.spark.executor.instances=1
kylin.engine.spark-conf.spark.eventLog.enabled=true
kylin.engine.spark-conf.spark.eventLog.dir=hdfs\:///kylin/spark-history
kylin.engine.spark-conf.spark.history.fs.logDirectory=hdfs\:///kylin/spark-history
kylin.engine.spark-conf.spark.hadoop.yarn.timeline-service.enabled=false
kylin.engine.spark-conf.spark.yarn.jar=hdfs://localhost:8020/kylin/spark/spark-assembly-1.6.3-hadoop2.6.0-cdh5.8.2.jar
5、啓動kylin

當上面的操作執行完成,首先執行check-env.sh 腳本檢查環境變量有沒有問題

bin/check-env.sh  //檢查環境變量
bin/kylin.sh start  //啓動kylin
bin/kylin.sh stop  //停止kylin
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章