{"id":1818,"date":"2020-07-01T05:54:49","date_gmt":"2020-06-30T21:54:49","guid":{"rendered":"http:\/\/39.97.231.10\/?p=1818"},"modified":"2020-07-01T05:54:49","modified_gmt":"2020-06-30T21:54:49","slug":"sqoop%e5%9f%ba%e6%9c%ac%e4%bd%bf%e7%94%a8","status":"publish","type":"post","link":"http:\/\/www.weijing.co\/?p=1818","title":{"rendered":"Sqoop\u57fa\u672c\u4f7f\u7528"},"content":{"rendered":"
\n
\n
\n
1.\u67e5\u770b\u547d\u4ee4\u5e2e\u52a9<\/div>\n<\/div>\n<\/div>\n<\/div>\n
\n
\n
[hadoop@hadoop000 ~]$ sqoop help\nusage: sqoop COMMAND [ARGS]\nAvailable commands:\n  codegen            Generate code to interact with database records\n  create-hive-table  Import a table definition into Hive\n  eval               Evaluate a SQL statement and display the results\n  export             Export an HDFS directory to a database table\n  help               List available commands\n  import             Import a table from a database to HDFS\n  import-all-tables  Import tables from a database to HDFS\n  import-mainframe   Import datasets from a mainframe server to HDFS\n  job                Work with saved jobs\n  list-databases     List available databases on a server\n  list-tables        List available tables in a database\n  merge              Merge results of incremental imports\n  metastore          Run a standalone Sqoop metastore\n  version            Display version information\nSee \\'sqoop help COMMAND\\' for information on a specific command.\n# \u8fd9\u91cc\u63d0\u793a\u6211\u4eec\u4f7f\u7528sqoop help command\uff08\u8981\u67e5\u8be2\u7684\u547d\u4ee4\uff09\u8fdb\u884c\u8be5\u547d\u4ee4\u7684\u8be6\u7ec6\u67e5\u8be2\n<\/pre>\n<\/div>\n
2.list-databases<\/h5>\n
\n
# \u67e5\u770blist-databases\u547d\u4ee4\u5e2e\u52a9\n[hadoop@hadoop000 ~]$ sqoop help list-databases\nusage: sqoop list-databases [GENERIC-ARGS] [TOOL-ARGS]\nCommon arguments:\n   --connect <jdbc-uri>                         Specify JDBC connect\n                                                string\n   --connection-manager <class-name>            Specify connection manager\n                                                class name\n   --connection-param-file <properties-file>    Specify connection\n                                                parameters file\n   --driver <class-name>                        Manually specify JDBC\n                                                driver class to use\n   --hadoop-home <hdir>                         Override\n                                                $HADOOP_MAPRED_HOME_ARG\n   --hadoop-mapred-home <dir>                   Override\n                                                $HADOOP_MAPRED_HOME_ARG\n   --help                                       Print usage instructions\n-P                                              Read password from console\n   --password <password>                        Set authentication\n                                                password\n   --password-alias <password-alias>            Credential provider\n                                                password alias\n   --password-file <password-file>              Set authentication\n                                                password file path\n   --relaxed-isolation                          Use read-uncommitted\n                                                isolation for imports\n   --skip-dist-cache                            Skip copying jars to\n                                                distributed cache\n   --username <username>                        Set authentication\n                                                username\n   --verbose                                    Print more information\n                                                while working\n# \u7b80\u5355\u4f7f\u7528\n[hadoop@oradb3 ~]$ sqoop list-databases \\\\\n> --connect jdbc:mysql:\/\/localhost:3306 \\\\\n> --username root \\\\\n> --password 123456\n# \u7ed3\u679c\ninformation_schema\nmysql\nperformance_schema\nslow_query_log\nsys\ntest\n<\/pre>\n<\/div>\n
3.list-tables<\/h5>\n
\n
# \u547d\u4ee4\u5e2e\u52a9\n[hadoop@hadoop000 ~]$ sqoop help list-tables\nusage: sqoop list-tables [GENERIC-ARGS] [TOOL-ARGS]\nCommon arguments:\n   --connect <jdbc-uri>                         Specify JDBC connect\n                                                string\n   --connection-manager <class-name>            Specify connection manager\n                                                class name\n   --connection-param-file <properties-file>    Specify connection\n                                                parameters file\n   --driver <class-name>                        Manually specify JDBC\n                                                driver class to use\n   --hadoop-home <hdir>                         Override\n                                                $HADOOP_MAPRED_HOME_ARG\n   --hadoop-mapred-home <dir>                   Override\n                                                $HADOOP_MAPRED_HOME_ARG\n   --help                                       Print usage instructions\n-P                                              Read password from console\n   --password <password>                        Set authentication\n                                                password\n   --password-alias <password-alias>            Credential provider\n                                                password alias\n   --password-file <password-file>              Set authentication\n                                                password file path\n   --relaxed-isolation                          Use read-uncommitted\n                                                isolation for imports\n   --skip-dist-cache                            Skip copying jars to\n                                                distributed cache\n   --username <username>                        Set authentication\n                                                username\n   --verbose                                    Print more information\n                                                while working\n# \u4f7f\u7528\u65b9\u6cd5\n[hadoop@hadoop000 ~]$ sqoop list-tables \\\\\n> --connect jdbc:mysql:\/\/localhost:3306\/test \\\\\n> --username root \\\\\n> --password 123456\n# \u7ed3\u679c\nt_order\ntest0001\ntest_1013\ntest_dyc\ntest_tb\n<\/pre>\n<\/div>\n
4.\u5c06mysql\u5bfc\u5165HDFS\u4e2d(import)<\/h5>\n
(\u9ed8\u8ba4\u5bfc\u5165\u5f53\u524d\u7528\u6237\u76ee\u5f55\u4e0b\/user\/\u7528\u6237\u540d\/\u8868\u540d)
\n\u8bf4\u5230\u8fd9\u91cc\u6269\u5c55\u4e00\u4e2a\u5c0f\u77e5\u8bc6\u70b9\uff1a<\/p>\n