知识库 : UDH常见问题及解决方案

Edit Document

UDH 常见问题及解决方案

 

Q1 :确认主机时,主机无法安装

A :各个服务器需要建立针对自身的免密码登陆服务

# cd ~/.ssh

# cat id_rsa.pub >>authorized_keys

 

Q2 :无法连接到 master 8440 端口

A Openssl 版本过低导致连接失败,将 Openssl 升级

 

 

Q3 Install DataNode 超时,报错: Python script has been killed due to timeout

A :超时问题一般重新操作即可, ReTry

 

Q4 NameNode 启动报错: UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 221: ordinal not in range(128)

A: 这是由于编码不一致导致的,修改 ambari-server 的格式,修改为 en_US.UTF_8.

# vim /etc/sysconfig/i18n    

修改编码格式为 en_US.UTF_8

# source /etc/sysconfig/i18n

 

Q5 # /usr/bin/yum -d 0 -e 0 -y install udh-zookeeper-rest  

Error: Package: glibc-2.12-1.107.el6.i686 (local-centos)
Requires: glibc-common = 2.12-1.107.el6
Installed: glibc-common-2.12-1.132.el6.x86_64 (@rhel)
glibc-common = 2.12-1.132.el6
Available: glibc-common-2.12-1.107.el6.x86_64 (local-centos)
glibc-common = 2.12-1.107.el6
Error: Package: libgcj-devel-4.4.7-3.el6.x86_64 (local-centos)
Requires: libgcj(x86-64) = 4.4.7-3.el6
Installed: libgcj-4.4.7-4.el6.x86_64 (@rhel)
libgcj(x86-64) = 4.4.7-4.el6
Available: libgcj-4.4.7-3.el6.x86_64 (local-centos)
libgcj(x86-64) = 4.4.7-3.el6
Error: Package: gcc-java-4.4.7-3.el6.x86_64 (local-centos)
Requires: gcc = 4.4.7-3.el6
Installed: gcc-4.4.7-4.el6.x86_64 (@rhel)
gcc = 4.4.4-15.el6
gcc = 4.4.7-4.el6
Available: gcc-4.4.7-3.el6.x86_64 (local-centos)
gcc = 4.4.7-3.el6
gcc = 4.4.4-15.el6
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
yum.repos.d rpm -e glibc-common-2.12-1.132.el6.x86_64  
error: Failed dependencies:
glibc-common = 2.12-1.132.el6 is needed by (installed) glibc-2.12-1.132.el6.x86_64
/usr/bin/gencat is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/getconf is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/iconv is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/locale is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64
/usr/bin/localedef is needed by (installed) redhat-lsb-core-4.0-7.el6.centos.x86_64

A # /usr/bin/yum --enablerepo=rhel -y install udh-zookeeper-rest

中间加入 –enablerepo=rhel 执行其他安装

 

Q6 WARN: Oozie WAR has not been set up at ''/usr/lib/oozie/oozie-server/webapps'', doing default set up

setting OOZIE_CONFIG=${OOZIE_CONFIG:-/etc/oozie/conf}
setting CATALINA_BASE=${CATALINA_BASE:-/var/lib/oozie/tomcat-deployment}
setting CATALINA_TMPDIR=${CATALINA_TMPDIR:-/var/lib/oozie}
setting OOZIE_CATALINA_HOME=/usr/lib/bigtop-tomcat
setting JAVA_HOME=/usr/jdk64/jdk1.7.0_45
setting JRE_HOME=${JAVA_HOME}
setting OOZIE_LOG=/var/log/oozie
setting CATALINA_PID=/var/run/oozie/oozie.pid
setting OOZIE_DATA=/hadoop/oozie/data
setting OOZIE_HTTPS_PORT=11443
setting OOZIE_HTTPS_KEYSTORE_PASS=password
setting CATALINA_OPTS="$CATALINA_OPTS -Doozie.https.port=${OOZIE_HTTPS_PORT}"
setting CATALINA_OPTS="$CATALINA_OPTS -Doozie.https.keystore.pass=${OOZIE_HTTPS_KEYSTORE_PASS}"
setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
setting JAVA_LIBRARY_PATH=/usr/lib/hadoop/lib/native/Linux-amd64-64

A # cd /usr/lib/oozie/oozie-server/webapps

        # cp /var/lib/oozie/tomcat-deployment/webapps/* ./

 

Q7: # /usr/lib/oozie/bin/oozied.sh: line 105: /usr/lib/oozie/oozie-server/bin/catalina.sh: 没有那个文件或目录

# /usr/lib/oozie/bin/oozied.sh: line 105: exec: /usr/lib/oozie/oozie-server/bin/catalina.sh: cannot execute: 没有那个文件或目录

A :按照 tomcat 安装包文件结构建立相应文件夹及安放文件

 

Q8 raise Fail("Applying %s failed, parent directory %s doesn't exist" % (self.resource, dirname))

          Fail: Applying File['/etc/hadoop/conf/core-site.xml'] failed, parent directory /etc/hadoop/conf doesn't exist

A :手动建立 conf 目录 # mkdir /etc/hadoop/conf  

 

Q9 :找不到 /usr/lib/bigtop-utils/bigtop-detect-javahome 下的 JAVA_HOME

A # mkdir /usr/lib/bigtop-utils

# vi /usr/lib/bigtop-utils/bigtop-detect-javahome

加入:

# export JAVA_HOME=/usr/jdk64/jdk1.7.0_45

 

Q10 :在组件安装过程中遇到 MySQl 安装失败, 错误提示 :

              /usr/jdk64/jdk1.7.0_45/bin/java no such file or directory

A :代码中 JAVA_HOME 路径与系统环境中 $JAVA_HOME 路径不一致 ,可以通过软连接指定已有的路径

            # ln -s /usr/jdk64/jdk1.7.0_45 /usr/java/jdk1.7.0_45

 

Q11: Execution of 'mysql -u root hive -e 'SOURCE /usr/lib/hive/scripts/metastore/upgrade/mysql/hive-schema-0.12.0.mysql.sql''

returned 1. ERROR 1062 (23000) at line 764 in file: '/usr/lib/hive/scripts/metastore/upgrade/mysql/hive-schema-0.12.0.mysql.sql':

Duplicate entry '1' for key 'PRIMARY'

A # mysql -uhive -p123456

            mysql> drop database hive;

            mysql> create database hive;

            mysql> use hive;

            mysql> show tables;

            正常 show tables 的结果会返回 Empty set

            mysql> Ctrl-C -- exit!

 

Q12: [19/Nov/2014 20:28:34 ] supervisor     WARNING   Supervisor shutting down!

[19/Nov/2014 20:28:34 ] supervisor     WARNING   Waiting for children to exit for 5 seconds...

[19/Nov/2014 20:29:30 ] supervisor     INFO         Starting process /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:30 ] supervisor     INFO         Starting process /usr/lib/hue/build/env/bin/hue kt_renewer

[19/Nov/2014 20:29:30 ] supervisor     INFO         Started proceses (pid 11414) /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:30 ] supervisor     INFO         Started proceses (pid 11415) /usr/lib/hue/build/env/bin/hue kt_renewer

[19/Nov/2014 20:29:36 ] supervisor     INFO         Command "/usr/lib/hue/build/env/bin/hue kt_renewer" exited normally.

[19/Nov/2014 20:29:39 ] supervisor     WARNING   Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1

[19/Nov/2014 20:29:39 ] supervisor     ERROR       Process /usr/lib/hue/build/env/bin/hue runcpserver exited abnormally. Restarting it.

[19/Nov/2014 20:29:39 ] supervisor     INFO         Starting process /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:39 ] supervisor     INFO         Started proceses (pid 11497) /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:44 ] supervisor     WARNING   Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1

[19/Nov/2014 20:29:44 ] supervisor     ERROR       Process /usr/lib/hue/build/env/bin/hue runcpserver exited abnormally. Restarting it.

[19/Nov/2014 20:29:44 ] supervisor     INFO         Starting process /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:44 ] supervisor     INFO         Started proceses (pid 11568) /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:50 ] supervisor     WARNING   Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1

[19/Nov/2014 20:29:50 ] supervisor     ERROR       Process /usr/lib/hue/build/env/bin/hue runcpserver exited abnormally. Restarting it.

[19/Nov/2014 20:29:50 ] supervisor     INFO         Starting process /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:50 ] supervisor     INFO         Started proceses (pid 11712) /usr/lib/hue/build/env/bin/hue runcpserver

[19/Nov/2014 20:29:54 ] supervisor     WARNING   Exit code for /usr/lib/hue/build/env/bin/hue runcpserver: 1

[19/Nov/2014 20:29:54 ] supervisor     ERROR       Process /usr/lib/hue/build/env/bin/hue runcpserver has restarted more than 3 times in the last 15 seconds

[19/Nov/2014 20:29:55 ] supervisor     WARNING   Supervisor shutting down!

[19/Nov/2014 20:29:55 ] supervisor     WARNING   Waiting for children to exit for 5 seconds...

[19/Nov/2014 20:29:55 ] supervisor     ERROR       Exception in supervisor main loop

Traceback (most recent call last):

  File "/usr/lib/hue/desktop/core/src/desktop/supervisor.py", line 386, in main

      wait_loop(sups, options)

  File "/usr/lib/hue/desktop/core/src/desktop/supervisor.py", line 403, in wait_loop

      shutdown(sups)               # shutdown() exits the process

  File "/usr/lib/hue/desktop/core/src/desktop/supervisor.py", line 215, in shutdown

      sys.exit(1)

Q13: HUE 中打开 HIVE 查询编辑器报错 Could not start SASL: Error in sasl_client_start (-4) SASL(-4): no mechanism available: No worthy mechs found

A:#rpm -qa |grep sasl 检查是否已安装以下库:

cyrus-sasl-lib-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-gssapi-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-devel-2.1.23-13.el6_3.1.x86_64  
cyrus-sasl-2.1.23-13.el6_3.1.x86_64
cyrus-sasl-plain-2.1.23-13.el6_3.1.x86_64    

 

Q14: 启动 keberos 安全 impala 报错  

A fatal error has been detected by the Java Runtime Environment:
# SIGSEGV (0xb) at pc=0x00007f9c1350585f, pid=27759, tid=140308356614144
# JRE version: Java(TM) SE Runtime Environment (7.0_45-b18) (build 1.7.0_45-b18)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.45-b08 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [libc.so.6+0x13385f] __strlen_sse42+0xf
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting
Java again
# An error report file with more information is saved as:
# /home/impala/hs_err_pid27759.log

A: yum install cyrus-sasl-gssapi –y

 

Q15: 在开启安全下, HUE 界面进入 hive 查询界面出现

Bad Status: 3 (Unsupported Mechanism Type PLAIN)

A: 由于 hue 所在机器 hive-site.xml 配置不全,指定 hive-site.xml 位置。

 

Q16:INFO 2014-08-27 10:37:58,094 main.py:83 - loglevel=logging.INFO

              INFO 2014-08-27 10:37:58,095 DataCleaner.py:36 - Data cleanup thread started

              ERROR 2014-08-27 10:37:58,096 PingPortListener.py:44 - Failed to start ping port listener of:[Errno 98] Address already in use

              INFO 2014-08-27 10:37:58,097 PingPortListener.py:52 - Ping port listener killed

A:               netstat -antp|grep 8441    # 获得进程号

              kill -9 进程号

              # ambari-agent 进行重装

 

 

Attachments:

UDH常见问题及解决方案.docx (application/vnd.openxmlformats-officedocument.wordprocessingml.document)