签到成功

知道了

CNDBA社区CNDBA社区

Sqoop 连接Mysql org.apache.commons.lang.StringUtils 解决方法

2019-03-02 23:45 6051 0 原创 Sqoop
作者: dave

Sqoop 连接Mysql,报错,如下:

http://www.cndba.cn/cndba/dave/article/3303
http://www.cndba.cn/cndba/dave/article/3303

[dave@www.cndba.cn lib]$ sqoop-version 
Warning: /home/hadoop/sqoop/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
2019-03-02 23:43:06,489 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
Sqoop 1.4.7
git commit id 2328971411f57f0cb683dfb79d19d4d19d185dd8
Compiled by maugli on Thu Dec 21 15:59:58 STD 2017
[dave@www.cndba.cn lib]$

[dave@www.cndba.cn lib]$ sqoop list-databases --connect jdbc:mysql://192.168.56.2:3306/ --username root -P
Warning: /home/hadoop/sqoop/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
2019-03-02 22:58:22,304 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
Enter password: 
2019-03-02 22:58:24,738 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/lang/StringUtils
    at org.apache.sqoop.manager.MySQLManager.initOptionDefaults(MySQLManager.java:73)
    at org.apache.sqoop.manager.SqlManager.<init>(SqlManager.java:89)
    at com.cloudera.sqoop.manager.SqlManager.<init>(SqlManager.java:33)
    at org.apache.sqoop.manager.GenericJdbcManager.<init>(GenericJdbcManager.java:51)
    at com.cloudera.sqoop.manager.GenericJdbcManager.<init>(GenericJdbcManager.java:30)
    at org.apache.sqoop.manager.CatalogQueryManager.<init>(CatalogQueryManager.java:46)
    at com.cloudera.sqoop.manager.CatalogQueryManager.<init>(CatalogQueryManager.java:31)
    at org.apache.sqoop.manager.InformationSchemaManager.<init>(InformationSchemaManager.java:38)
    at com.cloudera.sqoop.manager.InformationSchemaManager.<init>(InformationSchemaManager.java:31)
    at org.apache.sqoop.manager.MySQLManager.<init>(MySQLManager.java:65)
    at org.apache.sqoop.manager.DefaultManagerFactory.accept(DefaultManagerFactory.java:67)
    at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:184)
    at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:272)
    at org.apache.sqoop.tool.ListDatabasesTool.run(ListDatabasesTool.java:44)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 20 more
[dave@www.cndba.cn lib]$

解决方法:
在apache 上下载commons-lang-2.6.jar包并上传到lib下即可,下载地址:
http://mirrors.tuna.tsinghua.edu.cn/apache//commons/lang/binaries/commons-lang-2.6-bin.ziphttp://www.cndba.cn/cndba/dave/article/3303

http://www.cndba.cn/cndba/dave/article/3303
http://www.cndba.cn/cndba/dave/article/3303

[dave@www.cndba.cn lib]$ pwd
/home/hadoop/sqoop/lib
[dave@www.cndba.cn lib]$ ll commons-lang-2.6.jar
-rw-r--r--. 1 hadoop hadoop 284220 Jan 13  2011 commons-lang-2.6.jar
[dave@www.cndba.cn lib]$

然后使用正常:http://www.cndba.cn/cndba/dave/article/3303

[dave@www.cndba.cn lib]$ sqoop list-databases --connect jdbc:mysql://192.168.56.2:3306 --username dave -P
Warning: /home/hadoop/sqoop/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /home/hadoop/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /home/hadoop/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
da2019-03-02 23:34:14,058 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
Enter password: 
2019-03-02 23:34:15,409 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
Sat Mar 02 23:34:15 CST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
information_schema
cndba
mysql
performance_schema
sys
[dave@www.cndba.cn lib]$

这里还有2个小插曲,参考:

http://www.cndba.cn/cndba/dave/article/3303

Sqoop jdbc连接Mysql Connection timed out (Connection timed out) 解决方法
https://www.cndba.cn/dave/article/3301

http://www.cndba.cn/cndba/dave/article/3303
http://www.cndba.cn/cndba/dave/article/3303

Sqoop jdbc 连接 MySQL 驱动包com.mysql.cj.jdbc.Driver 问题解决方法
https://www.cndba.cn/dave/article/3302http://www.cndba.cn/cndba/dave/article/3303

版权声明:本文为博主原创文章,未经博主允许不得转载。

用户评论
* 以下用户言论只代表其个人观点,不代表CNDBA社区的观点或立场
dave

dave

关注

人的一生应该是这样度过的:当他回首往事的时候,他不会因为虚度年华而悔恨,也不会因为碌碌无为而羞耻;这样,在临死的时候,他就能够说:“我的整个生命和全部精力,都已经献给世界上最壮丽的事业....."

  • 2262
    原创
  • 3
    翻译
  • 578
    转载
  • 192
    评论
  • 访问:8064211次
  • 积分:4349
  • 等级:核心会员
  • 排名:第1名
精华文章
    最新问题
    查看更多+
    热门文章
      热门用户
      推荐用户
        Copyright © 2016 All Rights Reserved. Powered by CNDBA · 皖ICP备2022006297号-1·

        QQ交流群

        注册联系QQ