linux中的MySQL安装部署及hive搭建

linux中mysql安装部署：

1、查看当前的centos系统中有没有已经安装的mysql
rpm、yum
[root@hadoop1 ~]# rpm -qa | grep mysql*
mysql-libs-5.1.71-1.el6.x86_64

2、卸载已经安装mysql
[root@hadoop1 ~]# rpm -e --nodeps mysql-libs-5.1.71-1.el6.x86_64 -->|–nodeps 不依赖

3、安装mysql
a、查看linux操作系统中有哪些mysql安装包
[root@hadoop1 ~]# yum list |grep mysql
apr-util-mysql.x86_64 1.3.9-3.el6_0.1 base
bacula-director-mysql.x86_64 5.0.0-13.el6 base
bacula-storage-mysql.x86_64 5.0.0-13.el6 base
dovecot-mysql.x86_64 1:2.0.9-22.el6 base
freeradius-mysql.x86_64 2.2.6-7.el6_9 base
libdbi-dbd-mysql.x86_64 0.8.3-5.1.el6 base
mod_auth_mysql.x86_64 1:3.0.0-11.el6_0.1 base
mysql.x86_64 5.1.73-8.el6_8 base
mysql-bench.x86_64 5.1.73-8.el6_8 base
mysql-connector-java.noarch 1:5.1.17-6.el6 base
mysql-connector-odbc.x86_64 5.1.5r1144-7.el6 base
mysql-devel.i686 5.1.73-8.el6_8 base
mysql-devel.x86_64 5.1.73-8.el6_8 base
mysql-embedded.i686 5.1.73-8.el6_8 base
mysql-embedded.x86_64 5.1.73-8.el6_8 base
mysql-embedded-devel.i686 5.1.73-8.el6_8 base
mysql-embedded-devel.x86_64 5.1.73-8.el6_8 base
mysql-libs.i686 5.1.73-8.el6_8 base
mysql-libs.x86_64 5.1.73-8.el6_8 base
mysql-server.x86_64 5.1.73-8.el6_8 base
mysql-test.x86_64 5.1.73-8.el6_8 base
pcp-pmda-mysql.x86_64 3.10.9-9.el6 base
php-mysql.x86_64 5.3.3-49.el6 base
qt-mysql.i686 1:4.6.2-28.el6_5 base
qt-mysql.x86_64 1:4.6.2-28.el6_5 base
rsyslog-mysql.x86_64 5.8.10-12.el6 base
rsyslog7-mysql.x86_64 7.4.10-7.el6 base
b、选择安装mysql安装包
安装mysql的客户端：mysql.x86_64
[root@hadoop1 ~]# yum install mysql.x86_64 -y
安装mysql服务端：mysql-server.x86_64
[root@hadoop1 ~]# yum install mysql-server.x86_64 -y
安装mysql的依赖：mysql-devel.x86_64
[root@hadoop1 ~]# yum install mysql-devel.x86_64 -y
c、启动mysqld服务
[root@hadoop1 ~]# service mysqld start —启动mysql服务
/usr/bin/mysqladmin -u root password ‘new-password’
/usr/bin/mysqladmin -u root -h hadoop1 password ‘new-password’
[root@hadoop1 ~]# service mysqld stop —关闭mysql服务
mysql简单配置—执行引擎，默认编码格式
[root@hadoop1 ~]# vi /etc/my.cnf
default-storage-engine=InnoDB
default-character-set=utf8
重启mysql服务
[root@hadoop1 ~]# service mysqld start
[root@hadoop1 ~]# mysqladmin -u root password ‘123456’
[root@hadoop1 ~]# mysqladmin -u root -h hadoop1 password ‘123456’
[root@hadoop1 ~]# mysql -uroot -p123456
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.1.73 Source distribution

 Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.

 Oracle is a registered trademark of Oracle Corporation and/or its
 affiliates. Other names may be trademarks of their respective
 owners.

 Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
 mysql> 

hive的搭建：

hive数据仓库-----主要利用HDFS做存储，利用MapReduce做计算。
hive主要解决不会写代码会sql语句人群也想要是用MapReduce。
hive运行的本质：把HQL语句转化为MapReduce

https://hive.apache.org/ ------hive官网
hive的安装包-----apache-hive-2.1.1-bin.tar.gz
1、解压apache-hive-2.1.1-bin.tar.gz安装包
[root@hadoop1 ~]# tar -zxvf /tmp/apache-hive-2.1.1-bin.tar.gz -C /bigdata
2、配置hive的环境变量
[root@hadoop1 ~]# vi /etc/profile
#hive
export HIVE_HOME=/bigdata/apache-hive-2.1.1-bin
export PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HIVE_HOME/bin:$PATH:$HOME/bin
3、修改hive配置
[root@hadoop1 ~]# cp /bigdata/apache-hive-2.1.1-bin/conf/hive-env.sh.template /bigdata/apache-hive-2.1.1-bin/conf/hive-env.sh
[root@hadoop1 ~]# vi /bigdata/apache-hive-2.1.1-bin/conf/hive-site.xml
修改hive-env.sh文件：
HADOOP_HOME=/bigdata/hadoop-2.7.3
export HIVE_CONF_DIR=/bigdata/apache-hive-2.1.1-bin/conf
修改hive-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> javax.jdo.option.ConnectionURL jdbc:mysql://hadoop1:3306/hive_db javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver javax.jdo.option.ConnectionUserName root javax.jdo.option.ConnectionPassword *斜体样式* 123456 **4、初始化hive数据库** *a、创建hive_db数据库* [root@hadoop1 ~]# mysql -uroot -hhadoop1 -p123456 mysql> create database hive_db; mysql> exit; *b、把mysql驱动包放入hive安装目录下的lib文件夹中* [root@hadoop1 ~]# cp /tmp/mysql-connector-java-5.1.7-bin.jar /bigdata/apache-hive-2.1.1-bin/lib/ *c、启动hadoop集群* [root@hadoop1 ~]# start-all.sh [root@hadoop4 ~]# yarn-daemon.sh start resourcemanager 在namenode所在的节点上： [root@hadoop2 ~]# hadoop fs -mkdir /tmp [root@hadoop2 ~]# hadoop fs -chmod 777 /tmp [root@hadoop2 ~]# hadoop fs -mkdir -p /user/hive/warehouse [root@hadoop2 ~]# hadoop fs -chmod 777 /user/hive/warehouse *d、初始化元数据库* [root@hadoop1 ~]# schematool -dbType mysql -initSchema