Hive的下载和安装

下载地址：https://hive.apache.org/downloads.html

启动hive前，先启动zookeeper、hdfs和yarn

安装Hive

上传压缩包 路径：E:\大数据开发课程\大数据\大数据组件\apache-hive-1.2.2-bin.tar.gz

解压

[hadoop@hadoop101 installPkg]$ tar -zxvf apache-hive-1.2.2-bin.tar.gz -C ../apps/

创建软连接

[hadoop@hadoop101 apps]$ ln -s apache-hive-1.2.2-bin/ hive

编辑hive-env.sh

[hadoop@hadoop101 conf]$ mv hive-env.sh.template hive-env.shHADOOP_HOME=/home/hadoop/apps/hadoop # Hive Configuration Directory can be controlled by: export HIVE_CONF_DIR=/home/hadoop/apps/hive/conf

在hdfs上创建相关目录，并设置权限

[hadoop@hadoop101 conf]$ hdfs dfs -mkdir /tmp [hadoop@hadoop101 conf]$ hdfs dfs -mkdir -p /user/hive/warehouse [hadoop@hadoop101 conf]$ hdfs dfs -chmod g+w /tmp [hadoop@hadoop101 conf]$ hdfs dfs -chmod g+w /user/hive/warehouse

配置hive（conf目录没有hive-site.xml，是自己创建的）

[hadoop@hadoop101 conf]$ vim hive-site.xml <?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <!--hive数据数据库存储的路径--> <property><name>hive.metastore.warehouse.dir</name><value>/user/hive/warehouse</value><description>location of default database for the warehouse</description> </property> </configuration>

配置环境变量

[hadoop@hadoop101 conf]$ sudo vim /etc/profile ## Hive的环境变量 export HIVE_HOME=/home/hadoop/apps/hive export PATH=$PATH:$HIVE_HOME/bin[hadoop@hadoop101 conf]$ . /etc/profile

启动hive

[hadoop@hadoop101 bin]$ hive hive>

hive交互式命令配置

[hadoop@hadoop101 conf]$ vim hivesite.xml <property> <name>hive.cli.print.header</name> <value>true</value> </property><property> <name>hive.cli.print.current.db</name> <value>true</value> </property>

derby数据库的弊端

安装MySQL

上传MySQL服务端和客户端的安装包到installPkg目录下

位置：E:\大数据开发课程\大数据\Source\MySQL-client-5.5.28-1.linux2.6.x86_64.rpm

​ E:\大数据开发课程\大数据\Source\MySQL-server-5.5.28-1.linux2.6.x86_64.rpm

检查是否安装过MySQL

[hadoop@hadoop101 ~]$ rpm -qa | grep -i mysql

卸载自带的MySQL

[hadoop@hadoop101 ~]$ sudo rpm -e --nodeps mysql-libs-5.1.71-1.el6.x86_64

安装MySQL服务，需要将MySQL安装成系统服务，开机启动。需要root权限。

[hadoop@hadoop101 installPkg]$ sudo rpm -ivh MySQL-server-5.5.28-1.linux2.6.x86_64.rpm

安装完成后会有一些提示信息，最好记下来，很重要

PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER !
To do so, start the server, then issue the following commands:

/usr/bin/mysqladmin -u root password ‘new-password’
/usr/bin/mysqladmin -u root -h hadoop101 password ‘new-password’

Alternatively you can run:
/usr/bin/mysql_secure_installation

which will also give you the option of removing the test
databases and anonymous user created by default. This is
strongly recommended for production servers.

See the manual for more instructions.

Please report any problems with the /usr/bin/mysqlbug script!

安装MySQL客户端

[hadoop@hadoop101 installPkg]$ sudo rpm -ivh MySQL-client-5.5.28-1.linux2.6.x86_64.rpm

启动MySQL服务（设置为开机启动）

[hadoop@hadoop101 installPkg]$ sudo service mysql start [hadoop@hadoop101 installPkg]$ sudo service mysql status MySQL running (6145) [ OK ] [hadoop@hadoop101 installPkg]$ sudo chkconfig mysql on

运行MySQL服务的脚本，对MySQL进行配置

[hadoop@hadoop101 installPkg]$ /usr/bin/mysql_secure_installation Enter current password for root (enter for none): Set root password? [Y/n] y New password: Re-enter new password: Password updated successfully! Reloading privilege tables.. ... Success! Remove anonymous users? [Y/n] y Disallow root login remotely? [Y/n] n Remove test database and access to it? [Y/n] y Reload privilege tables now? [Y/n] y## 有这段提示则表示设置成功 All done! If you've completed all of the above steps, your MySQL installation should now be secure. Thanks for using MySQL!

配置Hive，将元数据信息存储在MySQL上

编辑 hive-site.xml

[hadoop@hadoop101 conf]$ vim hive-site.xml <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://hadoop101:3306/hive?createDatabaseIfNotExist=true</value> <description>JDBC connect string for a JDBC metastore</description> </property><property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> <description>Driver class name for a JDBC metastore</description> </property><property> <name>javax.jdo.option.ConnectionUserName</name> <value>root</value> <description>Username to use againstmetastore database</description> </property><property> <name>javax.jdo.option.ConnectionPassword</name> <value>123456</value> <description>password to use againstmetastore database</description> </property>

将mysql的驱动jar包上传到hive的lib目录下 （classpath）

位置：E:\大数据开发课程\大数据\大数据组件\mysql-connector-java-5.1.39.jar

配置MySQL远程连接(无主机登录)

• 方式一（用%代表所有主机）：

mysql> show databases; mysql> use mysql; mysql> show tables; mysql> select Host,User from user;+-----------+------+ | Host | User | +-----------+------+ | 127.0.0.1 | root | | ::1 | root | | hadoop101 | root | | localhost | root | +-----------+------+mysql> update user set Host='%' where Host='hadoop101'; mysql> select Host,User from user;+-----------+------+ | Host | User | +-----------+------+ | % | root | | 127.0.0.1 | root | | ::1 | root | | localhost | root | +-----------+------+mysql> delete from user where Host != '%'; mysql> select Host,User from user; +-----------+------+ | Host | User | +-----------+------+ | % | root | +-----------+------+ mysql> flush privileges;

• 方式二：

mysql> grant all privileges on *.* to 'root'@'%' identified by '密码'; mysql> flush privileges;

配置Hive日志目录

[hadoop@hadoop101 hive]$ mkdir logs [hadoop@hadoop101 conf]$ mv hivelog4j.properties.template hivelog4j.properties [hadoop@hadoop101 conf]$ vim hivelog4j.properties hive.log.dir=/home/hadoop/apps/hive/logs

如果想在console控制台显示log信息，使用以下参数： 只有当前会话有效。

[hadoop@hadoop101 conf]$ hive -help ##查看帮助 [hadoop@hadoop101 conf]$ hive --hiveconf hive.root.logger=INFO,console

hive交互式客户端

• 执行HQL

  [hadoop@hadoop101 bin]$ hive hive>

• 操作hdfs

  hive> dfs -ls /;

• 操作本地文件系统

  hive> ! ls /home/hadoop;

hive非交互式客户端

[hadoop@hadoop101 conf]$ hive -help -e <quoted-query-string> SQL from command line -f <filename> SQL from files[hadoop@hadoop101 conf]$ hive -e 'show databases;' [hadoop@hadoop101 conf]$ hive -f /home/hadoop/data/mysql.sql ## mysql.sql是本地sql文件

启动hive的服务，使用客户端 连接服务操作HQL

• 后台启动hive的服务

  [hadoop@hadoop101 bin]$ hiveserver2 &

• 使用beeline客户端连接

  beeline> !help beeline> !connect Usage: connect <url> <username> <password> [driver]## <username> 是hdfs的用户，因为没设置过密码，所以密码不用写或者顺便写 beeline> !connect jdbc:hive2://hadoop101:10000 hadoop

• 使用beeline客户端连接

  [hadoop@hadoop101 bin]$ beeline -xxxxx -u <database url> the JDBC URL to connect to -n <username> the username to connect as -p <password> the password to connect as [hadoop@hadoop101 bin]$ beeline -u jdbc:hive2://hadoop101:10000 -n hadoop -p### 也可以操作hdfs文件系统；但是不能操作本地文件系统 0: jdbc:hive2://hadoop101:10000> dfs -ls /;

总结

以上是生活随笔为你收集整理的Hive的下载和安装的全部内容，希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错，欢迎将生活随笔推荐给好友。