UDH 常见问题及解决方案
Q1 :确认主机时,主机无法安装
A :各个服务器需要建立针对自身的免密码登陆服务
# cd ~/.ssh
# cat id_rsa.pub >>authorized_keys
Q2 :无法连接到 master 的 8440 端口
A : Openssl 版本过低导致连接失败,将 Openssl 升级
Q3 : Install DataNode 超时,报错: Python script has been killed due to timeout
A :超时问题一般重新操作即可, ReTry 。
Q4 : NameNode 启动报错: UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 221: ordinal not in range(128)
A: 这是由于编码不一致导致的,修改 ambari-server 的格式,修改为 en_US.UTF_8.
# vim /etc/sysconfig/i18n
修改编码格式为 en_US.UTF_8
# source /etc/sysconfig/i18n
Q5 : # /usr/bin/yum -d 0 -e 0 -y install udh-zookeeper-rest
Error: Package: glibc-2.12-1.107.el6.i686 (local-centos)
Requires: glibc-common = 2.12-1.107.el6
Installed: glibc-common-2.12-1.132.el6.x86_64 (@rhel)
glibc-common = 2.12-1.132.el6
Available: glibc-common-2.12-1.107.el6.x86_64 (local-centos)
glibc-common = 2.12-1.107.el6
Error: Package: libgcj-devel-4.4.7-3.el6.x86_64 (local-centos)
Requires: libgcj(x86-64) = 4.4.7-3.el6
Installed: libgcj-4.4.7-4.el6.x86_64 (@rhel)
libgcj(x86-64) = 4.4.7-4.el6
Available: libgcj-4.4.7-3.el6.x86_64 (local-centos)
libgcj(x86-64) = 4.4.7-3.el6
Error: Package: gcc-java-4.4.7-3.el6.x86_64 (local-centos)
Requires: gcc = 4.4.7-3.el6
Installed: gcc-4.4.7-4.el6.x86_64 (@rhel)
gcc = 4.4.4-15.el6
gcc = 4.4.7-4.el6
Available: gcc-4.4.7-3.el6.x86_64 (local-centos)
gcc = 4.4.7-3.el6
gcc = 4.4.4-15.el6
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
yum.repos.d
☆
rpm -e glibc-common-2.12-1.132.el6.x86_64
error: Failed dependencies:
glibc-common = 2.12-1.132.el6 is needed by (installed) glibc-2.12-1.132.el6.x86_64
/usr/bin/gencat is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/getconf is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/iconv is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/locale is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/localedef is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
A : # /usr/bin/yum --enablerepo=rhel -y install udh-zookeeper-rest
中间加入 –enablerepo=rhel 执行其他安装
Q6 : WARN: Oozie WAR has not been set up at ''/usr/lib/oozie/oozie-server/webapps'', doing default set up
setting OOZIE_CONFIG=${OOZIE_CONFIG:-/etc/oozie/conf}
setting CATALINA_BASE=${CATALINA_BASE:-/var/lib/oozie/tomcat-deployment}
setting CATALINA_TMPDIR=${CATALINA_TMPDIR:-/var/lib/oozie}
setting OOZIE_CATALINA_HOME=/usr/lib/bigtop-tomcat
setting JAVA_HOME=/usr/jdk64/jdk1.7.0_45
setting JRE_HOME=${JAVA_HOME}
setting OOZIE_LOG=/var/log/oozie
setting CATALINA_PID=/var/run/oozie/oozie.pid
setting OOZIE_DATA=/hadoop/oozie/data
setting OOZIE_HTTPS_PORT=11443
setting OOZIE_HTTPS_KEYSTORE_PASS=password
setting CATALINA_OPTS="$CATALINA_OPTS -Doozie.https.port=${OOZIE_HTTPS_PORT}"
setting CATALINA_OPTS="$CATALINA_OPTS -Doozie.https.keystore.pass=${OOZIE_HTTPS_KEYSTORE_PASS}"
setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
setting JAVA_LIBRARY_PATH=/usr/lib/hadoop/lib/native/Linux-amd64-64
A : # cd /usr/lib/oozie/oozie-server/webapps
# cp /var/lib/oozie/tomcat-deployment/webapps/* ./
Q7: # /usr/lib/oozie/bin/oozied.sh: line 105: /usr/lib/oozie/oozie-server/bin/catalina.sh: 没有那个文件或目录
# /usr/lib/oozie/bin/oozied.sh: line 105: exec: /usr/lib/oozie/oozie-server/bin/catalina.sh: cannot execute: 没有那个文件或目录
A :按照 tomcat 安装包文件结构建立相应文件夹及安放文件
Q8 : raise Fail("Applying %s failed, parent directory %s doesn't exist" % (self.resource, dirname))
Fail: Applying File['/etc/hadoop/conf/core-site.xml'] failed, parent directory /etc/hadoop/conf doesn't exist
A :手动建立 conf 目录 # mkdir /etc/hadoop/conf
Q9 :找不到 /usr/lib/bigtop-utils/bigtop-detect-javahome 下的 JAVA_HOME
A : # mkdir /usr/lib/bigtop-utils
# vi /usr/lib/bigtop-utils/bigtop-detect-javahome
加入:
# export JAVA_HOME=/usr/jdk64/jdk1.7.0_45
Q10 :在组件安装过程中遇到 MySQl 安装失败, 错误提示 :
/usr/jdk64/jdk1.7.0_45/bin/java no such file or directory
A :代码中 JAVA_HOME 路径与系统环境中 $JAVA_HOME 路径不一致 ,可以通过软连接指定已有的路径
# ln -s /usr/jdk64/jdk1.7.0_45 /usr/java/jdk1.7.0_45
Q11: Execution of 'mysql -u root hive -e 'SOURCE /usr/lib/hive/scripts/metastore/upgrade/mysql/hive-schema-0.12.0.mysql.sql''
returned 1. ERROR 1062 (23000) at line 764 in file: '/usr/lib/hive/scripts/metastore/upgrade/mysql/hive-schema-0.12.0.mysql.sql':
Duplicate entry '1' for key 'PRIMARY'
A : # mysql -uhive -p123456
mysql> drop database hive;
mysql> create database hive;
mysql> use hive;
mysql> show tables;
正常 show tables 的结果会返回 Empty set
mysql> Ctrl-C -- exit!
Q12: [19/Nov/2014 20:28:34 ] supervisor WARNING Supervisor shutting down!
[19/Nov/2014 20:28:34 ] supervisor WARNING Waiting for children to exit for 5 seconds...
[19/Nov/2014 20:29:30 ] supervisor INFO Starting process /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:30 ] supervisor INFO Starting process /usr/lib/hue/build/env/bin/hue kt_renewer
[19/Nov/2014 20:29:30 ] supervisor INFO Started proceses (pid 11414) /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:30 ] supervisor INFO Started proceses (pid 11415) /usr/lib/hue/build/env/bin/hue kt_renewer
[19/Nov/2014 20:29:36 ] supervisor INFO Command "/usr/lib/hue/build/env/bin/hue kt_renewer" exited normally.
[19/Nov/2014 20:29:39 ] supervisor WARNING Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1
[19/Nov/2014 20:29:39 ] supervisor ERROR Process /usr/lib/hue/build/env/bin/hue runcpserver exited abnormally. Restarting it.
[19/Nov/2014 20:29:39 ] supervisor INFO Starting process /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:39 ] supervisor INFO Started proceses (pid 11497) /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:44 ] supervisor WARNING Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1
[19/Nov/2014 20:29:44 ] supervisor ERROR Process /usr/lib/hue/build/env/bin/hue runcpserver exited abnormally. Restarting it.
[19/Nov/2014 20:29:44 ] supervisor INFO Starting process /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:44 ] supervisor INFO Started proceses (pid 11568) /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:50 ] supervisor WARNING Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1
[19/Nov/2014 20:29:50 ] supervisor ERROR Process /usr/lib/hue/build/env/bin/hue runcpserver exited abnormally. Restarting it.
[19/Nov/2014 20:29:50 ] supervisor INFO Starting process /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:50 ] supervisor INFO Started proceses (pid 11712) /usr/lib/hue/build/env/bin/hue runcpserver
[19/Nov/2014 20:29:54 ] supervisor WARNING Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1
[19/Nov/2014 20:29:54 ] supervisor ERROR Process /usr/lib/hue/build/env/bin/hue runcpserver has restarted more than 3 times in the last 15 seconds
[19/Nov/2014 20:29:55 ] supervisor WARNING Supervisor shutting down!
[19/Nov/2014 20:29:55 ] supervisor WARNING Waiting for children to exit for 5 seconds...
[19/Nov/2014 20:29:55 ] supervisor ERROR Exception in supervisor main loop
Traceback (most recent call last):
File "/usr/lib/hue/desktop/core/src/desktop/supervisor.py", line 386, in main
wait_loop(sups, options)
File "/usr/lib/hue/desktop/core/src/desktop/supervisor.py", line 403, in wait_loop
shutdown(sups) # shutdown() exits the process
File "/usr/lib/hue/desktop/core/src/desktop/supervisor.py", line 215, in shutdown
sys.exit(1)
Q13: 在 HUE 中打开 HIVE 查询编辑器报错 Could not start SASL: Error in sasl_client_start (-4) SASL(-4): no mechanism available: No worthy mechs found
A:#rpm -qa |grep sasl 检查是否已安装以下库:
cyrus-sasl-lib-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-gssapi-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-devel-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-plain-2.1.23-13.el6_3.1.x86_64
Q14: 启动 keberos 安全 impala 报错
A fatal error has been detected by the Java Runtime Environment:
# SIGSEGV (0xb) at pc=0x00007f9c1350585f, pid=27759, tid=140308356614144
# JRE version: Java(TM) SE Runtime Environment (7.0_45-b18) (build 1.7.0_45-b18)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.45-b08 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [libc.so.6+0x13385f] __strlen_sse42+0xf
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting
Java again
# An error report file with more information is saved as:
# /home/impala/hs_err_pid27759.log
A: yum install cyrus-sasl-gssapi –y
Q15: 在开启安全下, HUE 界面进入 hive 查询界面出现
Bad Status: 3 (Unsupported Mechanism Type PLAIN)
A: 由于 hue 所在机器 hive-site.xml 配置不全,指定 hive-site.xml 位置。
Q16:INFO 2014-08-27 10:37:58,094 main.py:83 - loglevel=logging.INFO
INFO 2014-08-27 10:37:58,095 DataCleaner.py:36 - Data cleanup thread started
ERROR 2014-08-27 10:37:58,096 PingPortListener.py:44 - Failed to start ping port listener of:[Errno 98] Address already in use
INFO 2014-08-27 10:37:58,097 PingPortListener.py:52 - Ping port listener killed
A: netstat -antp|grep 8441 # 获得进程号
kill -9 进程号
# 对 ambari-agent 进行重装