{"id":5411,"date":"2020-07-30T12:58:07","date_gmt":"2020-07-30T04:58:07","guid":{"rendered":"http:\/\/39.97.231.10\/?p=5411"},"modified":"2022-03-27T00:52:18","modified_gmt":"2022-03-26T16:52:18","slug":"hadoophbase-%e9%9b%86%e7%be%a4%e6%90%ad%e5%bb%ba","status":"publish","type":"post","link":"http:\/\/www.weijing.co\/?p=5411","title":{"rendered":"Hadoop+HBase \u96c6\u7fa4\u642d\u5efa"},"content":{"rendered":"<div>1. \u73af\u5883\u51c6\u5907<\/div>\n<div>\n<div id=\"\\&quot;cnblogs_post_body\\&quot;\">\n\u8bf4\u660e\uff1a\u672c\u6b21\u96c6\u7fa4\u642d\u5efa\u4f7f\u7528\u7cfb\u7edf\u7248\u672cCentos 7.5 \uff0c\u8f6f\u4ef6\u7248\u672c V3.1.1\u3002<\/p>\n<h3 id=\"\\&quot;11-\u914d\u7f6e\u8bf4\u660e\\&quot;\">1.1 \u914d\u7f6e\u8bf4\u660e<\/h3>\n<p>\u672c\u6b21\u96c6\u7fa4\u642d\u5efa\u5171\u4e09\u53f0\u673a\u5668\uff0c\u5177\u4f53\u8bf4\u660e\u4e0b:<\/p>\n<div>\n<table>\n<colgroup>\n<col width=\"\\&quot;111px\\&quot;\">\n<col width=\"\\&quot;115px\\&quot;\">\n<col width=\"\\&quot;523px\\&quot;\"><\/colgroup>\n<tbody>\n<tr>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">\u4e3b\u673a\u540d<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">IP<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">\u8bf4\u660e<\/div>\n<\/div>\n<\/td>\n<\/tr>\n<tr>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">hadoop01<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">10.0.0.10<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">DataNode\u3001NodeManager\u3001NameNode<\/div>\n<\/td>\n<\/tr>\n<tr>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">hadoop02<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">10.0.0.11<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">DataNode\u3001NodeManager\u3001ResourceManager\u3001SecondaryNameNode<\/div>\n<\/td>\n<\/tr>\n<tr>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">hadoop03<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;alignment\\&quot;\" data-value=\"\\&quot;center\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">10.0.0.12<\/div>\n<\/div>\n<\/td>\n<td colspan=\"\\&quot;1\\&quot;\" rowspan=\"\\&quot;1\\&quot;\">\n<div data-type=\"\\&quot;p\\&quot;\">DataNode\u3001NodeManager<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<h3 id=\"\\&quot;12-\u673a\u5668\u914d\u7f6e\u8bf4\u660e\\&quot;\">1.2 \u673a\u5668\u914d\u7f6e\u8bf4\u660e<\/h3>\n<pre>[clsn@hadoop01 \/home\/clsn]\n$cat  \/etc\/redhat-release\nCentOS Linux release 7.5.1804 (Core)\n[clsn@hadoop01 \/home\/clsn]\n$uname  -r\n3.10.0-862.el7.x86_64\n[clsn@hadoop01 \/home\/clsn]\n$sestatus\nSELinux status:                 disabled\n[clsn@hadoop01 \/home\/clsn]\n$systemctl  status  firewalld.service\n\u25cf firewalld.service - firewalld - dynamic firewall daemon\n   Loaded: loaded (\/usr\/lib\/systemd\/system\/firewalld.service; disabled; vendor preset: enabled)\n   Active: inactive (dead)\n     Docs: man:firewalld(1)\n[clsn@hadoop01 \/home\/clsn]\n$id clsn\nuid=1000(clsn) gid=1000(clsn) \u7ec4=1000(clsn)\n[clsn@hadoop01 \/home\/clsn]\n$cat  \/etc\/hosts\n127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4\n::1         localhost localhost.localdomain localhost6 localhost6.localdomain6\n10.0.0.10   hadoop01\n10.0.0.11   hadoop02\n10.0.0.12   hadoop03\n<\/pre>\n<p>\u6ce8\uff1a\u672c\u96c6\u7fa4\u5185\u6240\u6709\u8fdb\u7a0b\u5747\u7531clsn\u7528\u6237\u542f\u52a8<\/p>\n<h3 id=\"\\&quot;13-ssh\u4e92\u4fe1\u914d\u7f6e\\&quot;\">1.3 ssh\u4e92\u4fe1\u914d\u7f6e<\/h3>\n<pre>ssh-keygen\nssh-copy-id -i ~\/.ssh\/id_rsa.pub  127.0.0.1\nscp -rp ~\/.ssh hadoop02:\/home\/clsn\nscp -rp ~\/.ssh hadoop03:\/home\/clsn\n<\/pre>\n<h3 id=\"\\&quot;14--\u914d\u7f6ejdk\\&quot;\">1.4 \u914d\u7f6ejdk<\/h3>\n<p>\u5728\u4e09\u53f0\u673a\u5668\u4e0a\u90fd\u9700\u8981\u64cd\u4f5c<\/p>\n<pre>tar xf jdk-8u191-linux-x64.tar.gz -C  \/usr\/local\/\nln -s \/usr\/local\/jdk1.8.0_191 \/usr\/local\/jdk\nsed -i.ori \\'$a export JAVA_HOME=\/usr\/local\/jdk\\\\nexport PATH=$JAVA_HOME\/bin:$JAVA_HOME\/jre\/bin:$PATH\\\\nexport CLASSPATH=.:$JAVA_HOME\/lib:$JAVA_HOME\/jre\/lib:$JAVA_HOME\/lib\/tools.jar\\' \/etc\/profile\n. \/etc\/profile\n<\/pre>\n<h2 id=\"\\&quot;2-\u5b89\u88c5hadoop\\&quot;\">2. \u5b89\u88c5hadoop<\/h2>\n<h3 id=\"\\&quot;21-\u5b89\u88c5\u5305\u4e0b\u8f7d\uff08binary\uff09\\&quot;\">2.1 \u5b89\u88c5\u5305\u4e0b\u8f7d\uff08Binary\uff09<\/h3>\n<pre>wget http:\/\/mirrors.tuna.tsinghua.edu.cn\/apache\/hadoop\/common\/hadoop-3.1.1\/hadoop-3.1.1.tar.gz\n<\/pre>\n<h3 id=\"\\&quot;22-\u5b89\u88c5\\&quot;\">2.2 \u5b89\u88c5<\/h3>\n<pre>tar xf hadoop-3.1.1.tar.gz -C \/usr\/local\/\nln -s \/usr\/local\/hadoop-3.1.1  \/usr\/local\/hadoop\nsudo  chown  -R clsn.clsn \/usr\/local\/hadoop-3.1.1\/\n<\/pre>\n<h2 id=\"\\&quot;3\u4fee\u6539hadoop\u914d\u7f6e\\&quot;\">3.\u4fee\u6539hadoop\u914d\u7f6e<\/h2>\n<p>\u914d\u7f6e\u6587\u4ef6\u5168\u90e8\u4f4d\u4e8e \/usr\/local\/hadoop\/etc\/hadoop \u6587\u4ef6\u5939\u4e0b<\/p>\n<h3 id=\"\\&quot;31-hadoop-envsh\\&quot;\">3.1 hadoop-env.sh<\/h3>\n<pre>[clsn@hadoop01 \/usr\/local\/hadoop\/etc\/hadoop]\n$ head hadoop-env.sh\n.  \/etc\/profile\n#\n# Licensed to the Apache Software Foundation (ASF) under one\n# or more contributor license agreements.  See the NOTICE file\n# distributed with this work for additional information\n# regarding copyright ownership.  The ASF licenses this file\n# to you under the Apache License, Version 2.0 (the\n# \\\"License\\\"); you may not use this file except in compliance\n# with the License.  You may obtain a copy of the License at\n<\/pre>\n<h3 id=\"\\&quot;32-core-sitexml\\&quot;\">3.2 core-site.xml<\/h3>\n<pre>[clsn@hadoop01 \/usr\/local\/hadoop\/etc\/hadoop]\n$ cat core-site.xml\n&lt;?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?&gt;\n&lt;?xml-stylesheet type=\\\"text\/xsl\\\" href=\\\"configuration.xsl\\\"?&gt;\n&lt;!-- Put site-specific property overrides in this file. --&gt;\n&lt;configuration&gt;\n    &lt;!-- \u6307\u5b9aHDFS\u8001\u5927\uff08namenode\uff09\u7684\u901a\u4fe1\u5730\u5740 --&gt;\n    &lt;property&gt;\n        &lt;name&gt;fs.defaultFS&lt;\/name&gt;\n        &lt;value&gt;hdfs:\/\/hadoop01:9000&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;!-- \u6307\u5b9ahadoop\u8fd0\u884c\u65f6\u4ea7\u751f\u6587\u4ef6\u7684\u5b58\u50a8\u8def\u5f84 --&gt;\n    &lt;property&gt;\n        &lt;name&gt;hadoop.tmp.dir&lt;\/name&gt;\n        &lt;value&gt;\/data\/tmp&lt;\/value&gt;\n    &lt;\/property&gt;\n&lt;\/configuration&gt;\n<\/pre>\n<h3 id=\"\\&quot;33-hdfs-sitexml\\&quot;\">3.3 hdfs-site.xml<\/h3>\n<pre>[clsn@hadoop01 \/usr\/local\/hadoop\/etc\/hadoop]\n$ cat hdfs-site.xml\n&lt;?xml version=\\\"1.0\\\" encoding=\\\"UTF-8\\\"?&gt;\n&lt;?xml-stylesheet type=\\\"text\/xsl\\\" href=\\\"configuration.xsl\\\"?&gt;\n&lt;!-- Put site-specific property overrides in this file. --&gt;\n&lt;configuration&gt;\n    &lt;!-- \u8bbe\u7f6enamenode\u7684http\u901a\u8baf\u5730\u5740 --&gt;\n    &lt;property&gt;\n        &lt;name&gt;dfs.namenode.http-address&lt;\/name&gt;\n        &lt;value&gt;hadoop01:50070&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;!-- \u8bbe\u7f6esecondarynamenode\u7684http\u901a\u8baf\u5730\u5740 --&gt;\n    &lt;property&gt;\n        &lt;name&gt;dfs.namenode.secondary.http-address&lt;\/name&gt;\n        &lt;value&gt;hadoop02:50090&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;!-- \u8bbe\u7f6enamenode\u5b58\u653e\u7684\u8def\u5f84 --&gt;\n    &lt;property&gt;\n        &lt;name&gt;dfs.namenode.name.dir&lt;\/name&gt;\n        &lt;value&gt;\/data\/name&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;!-- \u8bbe\u7f6ehdfs\u526f\u672c\u6570\u91cf --&gt;\n    &lt;property&gt;\n        &lt;name&gt;dfs.replication&lt;\/name&gt;\n        &lt;value&gt;2&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;!-- \u8bbe\u7f6edatanode\u5b58\u653e\u7684\u8def\u5f84 --&gt;\n    &lt;property&gt;\n        &lt;name&gt;dfs.datanode.data.dir&lt;\/name&gt;\n        &lt;value&gt;\/data\/datanode&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;name&gt;dfs.permissions&lt;\/name&gt;\n        &lt;value&gt;false&lt;\/value&gt;\n    &lt;\/property&gt;\n&lt;\/configuration&gt;\n<\/pre>\n<h3 id=\"\\&quot;34-mapred-sitexml\\&quot;\">3.4 mapred-site.xml<\/h3>\n<pre>[clsn@hadoop01 \/usr\/local\/hadoop\/etc\/hadoop]\n$ cat mapred-site.xml\n&lt;?xml version=\\\"1.0\\\"?&gt;\n&lt;?xml-stylesheet type=\\\"text\/xsl\\\" href=\\\"configuration.xsl\\\"?&gt;\n&lt;!-- Put site-specific property overrides in this file. --&gt;\n&lt;configuration&gt;\n    &lt;!-- \u901a\u77e5\u6846\u67b6MR\u4f7f\u7528YARN --&gt;\n    &lt;property&gt;\n        &lt;name&gt;mapreduce.framework.name&lt;\/name&gt;\n        &lt;value&gt;yarn&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;name&gt;mapreduce.application.classpath&lt;\/name&gt;\n        &lt;value&gt;\n        \/usr\/local\/hadoop\/etc\/hadoop,\n        \/usr\/local\/hadoop\/share\/hadoop\/common\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/common\/lib\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/hdfs\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/hdfs\/lib\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/mapreduce\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/mapreduce\/lib\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/yarn\/*,\n        \/usr\/local\/hadoop\/share\/hadoop\/yarn\/lib\/*\n        &lt;\/value&gt;\n    &lt;\/property&gt;\n&lt;\/configuration&gt;\n<\/pre>\n<h3 id=\"\\&quot;35-yarn-sitexml\\&quot;\">3.5 yarn-site.xml<\/h3>\n<pre>[clsn@hadoop01 \/usr\/local\/hadoop\/etc\/hadoop]\n$ cat yarn-site.xml\n&lt;?xml version=\\\"1.0\\\"?&gt;\n&lt;configuration&gt;\n    &lt;property&gt;\n        &lt;name&gt;yarn.resourcemanager.hostname&lt;\/name&gt;\n        &lt;value&gt;hadoop02&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;description&gt;The http address of the RM web application.&lt;\/description&gt;\n        &lt;name&gt;yarn.resourcemanager.webapp.address&lt;\/name&gt;\n        &lt;value&gt;${yarn.resourcemanager.hostname}:8088&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;description&gt;The address of the applications manager interface in the RM.&lt;\/description&gt;\n        &lt;name&gt;yarn.resourcemanager.address&lt;\/name&gt;\n        &lt;value&gt;${yarn.resourcemanager.hostname}:8032&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;description&gt;The address of the scheduler interface.&lt;\/description&gt;\n        &lt;name&gt;yarn.resourcemanager.scheduler.address&lt;\/name&gt;\n        &lt;value&gt;${yarn.resourcemanager.hostname}:8030&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;name&gt;yarn.resourcemanager.resource-tracker.address&lt;\/name&gt;\n        &lt;value&gt;${yarn.resourcemanager.hostname}:8031&lt;\/value&gt;\n    &lt;\/property&gt;\n    &lt;property&gt;\n        &lt;description&gt;The address of the RM admin interface.&lt;\/description&gt;\n        &lt;name&gt;yarn.resourcemanager.admin.address&lt;\/name&gt;\n        &lt;value&gt;${yarn.resourcemanager.hostname}:8033&lt;\/value&gt;\n    &lt;\/property&gt;\n&lt;\/configuration&gt;\n<\/pre>\n<h3 id=\"\\&quot;36-masters--slaves\\&quot;\">3.6 masters &amp; slaves<\/h3>\n<pre>echo \\'hadoop02\\' &gt;&gt; \/usr\/local\/hadoop\/etc\/hadoop\/masters\necho \\'hadoop03\nhadoop01\\'  &gt;&gt; \/usr\/local\/hadoop\/etc\/hadoop\/slaves\n<\/pre>\n<h3 id=\"\\&quot;37-\u542f\u52a8\u811a\u672c\u4fee\u6539\\&quot;\">3.7 \u542f\u52a8\u811a\u672c\u4fee\u6539<\/h3>\n<p>\u542f\u52a8\u811a\u672c\u6587\u4ef6\u5168\u90e8\u4f4d\u4e8e \/usr\/local\/hadoop\/sbin \u6587\u4ef6\u5939\u4e0b\uff1a<br \/>\n\uff081\uff09\u4fee\u6539 start-dfs.sh stop-dfs.sh \u6587\u4ef6\u6dfb\u52a0\uff1a<\/p>\n<pre>HDFS_DATANODE_USER=clsn\nHADOOP_SECURE_DN_USER=hdfs\nHDFS_NAMENODE_USER=clsn\nHDFS_SECONDARYNAMENODE_USER=clsn\n<\/pre>\n<p>\uff082\uff09\u4fee\u6539start-yarn.sh \u548c stop-yarn.sh\u6587\u4ef6\u6dfb\u52a0\uff1a<\/p>\n<pre>YARN_RESOURCEMANAGER_USER=clsn\nHADOOP_SECURE_DN_USER=yarn\nYARN_NODEMANAGER_USER=clsn\n<\/pre>\n<h2 id=\"\\&quot;4-\u542f\u52a8\u524d\u51c6\u5907\\&quot;\">4. \u542f\u52a8\u524d\u51c6\u5907<\/h2>\n<h3 id=\"\\&quot;41-\u521b\u5efa\u6587\u4ef6\u76ee\u5f55\\&quot;\">4.1 \u521b\u5efa\u6587\u4ef6\u76ee\u5f55<\/h3>\n<pre>mkdir -p \/data\/tmp\nmkdir -p \/data\/name\nmkdir -p \/data\/datanode\nchown -R clsn.clsn \/data\n<\/pre>\n<p>\u5728\u96c6\u7fa4\u5185\u6240\u6709\u673a\u5668\u4e0a\u90fd\u8fdb\u884c\u521b\u5efa\uff0c\u4e5f\u53ef\u4ee5\u590d\u5236\u6587\u4ef6\u5939<\/p>\n<pre>for i in hadoop02 hadoop03\n    do\n        sudo scp -rp \/data $i:\/\ndone\n<\/pre>\n<h3 id=\"\\&quot;42-\u590d\u5236hadoop\u914d\u7f6e\u5230\u5176\u4ed6\u673a\u5668\\&quot;\">4.2 \u590d\u5236hadoop\u914d\u7f6e\u5230\u5176\u4ed6\u673a\u5668<\/h3>\n<pre>for i in hadoop02 hadoop03\n    do\n        sudo scp -rp  \/usr\/local\/hadoop-3.1.1 $i:\/usr\/local\/\ndone\n<\/pre>\n<h3 id=\"\\&quot;43-\u542f\u52a8hadoop\u96c6\u7fa4\\&quot;\">4.3 \u542f\u52a8hadoop\u96c6\u7fa4<\/h3>\n<p>(1)\u7b2c\u4e00\u6b21\u542f\u52a8\u524d\u9700\u8981\u683c\u5f0f\u5316<\/p>\n<pre>\/usr\/local\/hadoop\/bin\/hdfs namenode -format\n<\/pre>\n<p>(2)\u542f\u52a8\u96c6\u7fa4<\/p>\n<pre>cd \/usr\/local\/hadoop\/sbin\n.\/start-all.sh\n<\/pre>\n<h2 id=\"\\&quot;5\u96c6\u7fa4\u542f\u52a8\u6210\u529f\\&quot;\">5.\u96c6\u7fa4\u542f\u52a8\u6210\u529f<\/h2>\n<p>\uff081\uff09\u4f7f\u7528jps\u67e5\u770b\u96c6\u7fa4\u4e2d\u5404\u4e2a\u89d2\u8272\uff0c\u662f\u5426\u4e0e\u9884\u671f\u76f8\u4e00\u81f4<\/p>\n<pre>[clsn@hadoop01 \/home\/clsn]\n$ pssh  -ih  cluster  \\\"`which jps`\\\"\n[1] 11:30:31 [SUCCESS] hadoop03\n7947 DataNode\n8875 Jps\n8383 NodeManager\n[2] 11:30:31 [SUCCESS] hadoop01\n20193 DataNode\n20665 NodeManager\n21017 NameNode\n22206 Jps\n[3] 11:30:31 [SUCCESS] hadoop02\n8896 DataNode\n9427 NodeManager\n10883 Jps\n9304 ResourceManager\n10367 SecondaryNameNode\n<\/pre>\n<p>\uff082\uff09\u6d4f\u89c8\u5668\u8bbf\u95ee<a href=\"\\&quot;http:\/\/hadoop02:8088\/cluster\/nodes\\&quot;\">http:\/\/hadoop02:8088\/cluster\/nodes<\/a><br \/>\n\u8be5\u9875\u9762\u4e3aResourceManager \u7ba1\u7406\u754c\u9762\uff0c\u5728\u4e0a\u9762\u53ef\u4ee5\u770b\u5230\u96c6\u7fa4\u4e2d\u7684\u4e09\u53f0Active Nodes\u3002<br \/>\n<img src=\"\\&quot;https:\/\/cdn.nlark.com\/yuque\/0\/2018\/png\/206952\/1545622408816-c6e4a343-1d60-47dc-bfee-e2e71a5c38e0.png\\&quot;\" alt=\"\\&quot;\u56fe\u7247.png\" |=\"\" center=\"\" 747x378\\\"=\"\"><br \/>\n(3) \u6d4f\u89c8\u5668\u8bbf\u95ee<a href=\"\\&quot;http:\/\/hadoop01:50070\/dfshealth.html#tab-datanode\\&quot;\">http:\/\/hadoop01:50070\/dfshealth.html#tab-datanode<\/a><br \/>\n\u8be5\u9875\u9762\u4e3aNameNode\u7ba1\u7406\u9875\u9762<br \/>\n<img src=\"\\&quot;https:\/\/cdn.nlark.com\/yuque\/0\/2018\/png\/206952\/1545622631989-e939563d-1b0a-4219-a7a8-79bf62489b8c.png\\&quot;\" alt=\"\\&quot;\u56fe\u7247.png\" |=\"\" center=\"\" 747x438\\\"=\"\"><\/p>\n<h2 id=\"\\&quot;6hbase\u914d\u7f6e\\&quot;\">6.Hbase\u914d\u7f6e<\/h2>\n<p><img src=\"\\&quot;https:\/\/cdn.nlark.com\/yuque\/0\/2018\/png\/206952\/1545710952464-634a68e8-15b1-460c-aacc-47bdf0927641.png\\&quot;\" alt=\"\\&quot;image.png\" |=\"\" center=\"\" 300x73.88059701492537\\\"=\"\"><\/p>\n<h3 id=\"\\&quot;61-\u90e8\u7f72hbase\u5305\\&quot;\">6.1 \u90e8\u7f72Hbase\u5305<\/h3>\n<pre>cd \/opt\/\nwget  http:\/\/mirrors.tuna.tsinghua.edu.cn\/apache\/hbase\/1.4.9\/hbase-1.4.9-bin.tar.gz\ntar xf  hbase-1.4.9-bin.tar.gz -C  \/usr\/local\/\nln -s \/usr\/local\/hbase-1.4.9 \/usr\/local\/hbase\n<\/pre>\n<h3 id=\"\\&quot;62-\u4fee\u6539\u914d\u7f6e\u6587\u4ef6\\&quot;\">6.2 \u4fee\u6539\u914d\u7f6e\u6587\u4ef6<\/h3>\n<h4 id=\"\\&quot;621-hbase-envsh\\&quot;\">6.2.1 hbase-env.sh<\/h4>\n<pre># \u6dfb\u52a0\u4e00\u884c\n. \/etc\/profile\n<\/pre>\n<p>6.2.2<\/p>\n<pre>[clsn@hadoop01 \/usr\/local\/hbase\/conf]\n$ cat  hbase-site.xml\n&lt;?xml version=\\\"1.0\\\"?&gt;\n&lt;?xml-stylesheet type=\\\"text\/xsl\\\" href=\\\"configuration.xsl\\\"?&gt;\n&lt;configuration&gt;\n&lt;property&gt;\n\t&lt;name&gt;hbase.rootdir&lt;\/name&gt;\n &nbsp; &nbsp;&lt;!-- hbase\u5b58\u653e\u6570\u636e\u76ee\u5f55 --&gt;\n\t&lt;value&gt;hdfs:\/\/hadoop01:9000\/hbase\/hbase_db&lt;\/value&gt;\n\t&lt;!-- \u7aef\u53e3\u8981\u548cHadoop\u7684fs.defaultFS\u7aef\u53e3\u4e00\u81f4--&gt;\n&lt;\/property&gt;\n&lt;property&gt;\n\t&lt;name&gt;hbase.cluster.distributed&lt;\/name&gt;\n &nbsp; &nbsp;&lt;!-- \u662f\u5426\u5206\u5e03\u5f0f\u90e8\u7f72 --&gt;\n\t&lt;value&gt;true&lt;\/value&gt;\n&lt;\/property&gt;\n&lt;property&gt;\n\t&lt;name&gt;hbase.zookeeper.quorum&lt;\/name&gt;\n\t&lt;!-- zookooper \u670d\u52a1\u542f\u52a8\u7684\u8282\u70b9\uff0c\u53ea\u80fd\u4e3a\u5947\u6570\u4e2a --&gt;\n\t&lt;value&gt;hadoop01,hadoop02,hadoop03&lt;\/value&gt;\n&lt;\/property&gt;\n&lt;property&gt;\n\t&lt;!--zookooper\u914d\u7f6e\u3001\u65e5\u5fd7\u7b49\u7684\u5b58\u50a8\u4f4d\u7f6e\uff0c\u5fc5\u987b\u4e3a\u4ee5\u5b58\u5728 --&gt;\n\t&lt;name&gt;hbase.zookeeper.property.dataDir&lt;\/name&gt;\n\t&lt;value&gt;\/data\/hbase\/zookeeper&lt;\/value&gt;\n&lt;\/property&gt;\n&lt;property&gt;\n\t&lt;!--hbase web \u7aef\u53e3 --&gt;\n\t&lt;name&gt;hbase.master.info.port&lt;\/name&gt;\n\t&lt;value&gt;16610&lt;\/value&gt;\n&lt;\/property&gt;\n&lt;\/configuration&gt;\n<\/pre>\n<p>\u6ce8\u610f:<\/p>\n<blockquote><p>zookeeper\u6709\u8fd9\u6837\u4e00\u4e2a\u7279\u6027\uff1a<br \/>\n\u96c6\u7fa4\u4e2d\u53ea\u8981\u6709\u8fc7\u534a\u7684\u673a\u5668\u662f\u6b63\u5e38\u5de5\u4f5c\u7684\uff0c\u90a3\u4e48\u6574\u4e2a\u96c6\u7fa4\u5bf9\u5916\u5c31\u662f\u53ef\u7528\u7684\u3002<br \/>\n\u4e5f\u5c31\u662f\u8bf4\u5982\u679c\u67092\u4e2azookeeper\uff0c\u90a3\u4e48\u53ea\u8981\u67091\u4e2a\u6b7b\u4e86zookeeper\u5c31\u4e0d\u80fd\u7528\u4e86\uff0c\u56e0\u4e3a1\u6ca1\u6709\u8fc7\u534a\uff0c\u6240\u4ee52\u4e2azookeeper\u7684\u6b7b\u4ea1\u5bb9\u5fcd\u5ea6\u4e3a0\uff1b<br \/>\n\u540c\u7406\uff0c\u8981\u662f\u67093\u4e2azookeeper\uff0c\u4e00\u4e2a\u6b7b\u4e86\uff0c\u8fd8\u5269\u4e0b2\u4e2a\u6b63\u5e38\u7684\uff0c\u8fc7\u534a\u4e86\uff0c\u6240\u4ee53\u4e2azookeeper\u7684\u5bb9\u5fcd\u5ea6\u4e3a1\uff1b<br \/>\n\u518d\u591a\u5217\u4e3e\u51e0\u4e2a\uff1a2-&gt;0 ; 3-&gt;1 ; 4-&gt;1 ; 5-&gt;2 ; 6-&gt;2 \u4f1a\u53d1\u73b0\u4e00\u4e2a\u89c4\u5f8b\uff0c2n\u548c2n-1\u7684\u5bb9\u5fcd\u5ea6\u662f\u4e00\u6837\u7684\uff0c\u90fd\u662fn-1\uff0c\u6240\u4ee5\u4e3a\u4e86\u66f4\u52a0\u9ad8\u6548\uff0c\u4f55\u5fc5\u589e\u52a0\u90a3\u4e00\u4e2a\u4e0d\u5fc5\u8981\u7684zookeeper<\/p><\/blockquote>\n<h4 id=\"\\&quot;623-regionservers\\&quot;\">6.2.3 regionservers<\/h4>\n<pre>[clsn@hadoop01 \/usr\/local\/hbase\/conf]\n$ cat regionservers\nhadoop01\nhadoop02\nhadoop03\n<\/pre>\n<h4 id=\"\\&quot;624-\u5206\u53d1\u914d\u7f6e\u5230\u5176\u4ed6\u8282\u70b9\\&quot;\">6.2.4 \u5206\u53d1\u914d\u7f6e\u5230\u5176\u4ed6\u8282\u70b9<\/h4>\n<pre>for i in hadoop02 hadoop03\n    do\n        sudo scp -rp  \/usr\/local\/hbase-1.4.9 $i:\/usr\/local\/\ndone\n<\/pre>\n<h3 id=\"\\&quot;63-\u542f\u52a8hbase\u96c6\u7fa4\\&quot;\">6.3 \u542f\u52a8hbase\u96c6\u7fa4<\/h3>\n<h4 id=\"\\&quot;631-\u542f\u52a8hbase\\&quot;\">6.3.1 \u542f\u52a8hbase<\/h4>\n<pre>[clsn@hadoop01 \/usr\/local\/hbase\/bin]\n$ sudo  .\/start-hbase.sh\nhadoop03: running zookeeper, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-zookeeper-hadoop03.out\nhadoop02: running zookeeper, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-zookeeper-hadoop02.out\nhadoop01: running zookeeper, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-zookeeper-hadoop01.out\nrunning master, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-master-hadoop01.out\nhadoop02: running regionserver, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-regionserver-hadoop02.out\nhadoop03: running regionserver, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-regionserver-hadoop03.out\nhadoop01: running regionserver, logging to \/usr\/local\/hbase-1.4.9\/bin\/..\/logs\/hbase-root-regionserver-hadoop01.out\n<\/pre>\n<p>\u8bbf\u95ee<a href=\"\\&quot;http:\/\/hadoop01:16610\/master-status\\&quot;\">&nbsp;http:\/\/hadoop01:16610\/master-status&nbsp;<\/a>\u67e5\u770bhbase\u72b6\u6001<br \/>\n<img src=\"\\&quot;https:\/\/cdn.nlark.com\/yuque\/0\/2018\/png\/206952\/1545710312002-60c440c8-ebe8-448e-800f-9d089c79ddce.png\\&quot;\" alt=\"\\&quot;image.png\" |=\"\" center=\"\" 747x445\\\"=\"\"><\/p>\n<h4 id=\"\\&quot;632-\u542f\u52a8hbase-\u5ba2\u6237\u7aef\\&quot;\">6.3.2 \u542f\u52a8hbase \u5ba2\u6237\u7aef<\/h4>\n<pre>[clsn@hadoop01 \/usr\/local\/hbase\/bin]\n$ .\/hbase shell  #\u542f\u52a8hbase\u5ba2\u6237\u7aef\nSLF4J: Class path contains multiple SLF4J bindings.\nSLF4J: Found binding in [jar:file:\/usr\/local\/hbase-1.4.9\/lib\/slf4j-log4j12-1.7.10.jar!\/org\/slf4j\/impl\/StaticLoggerBinder.class]\nSLF4J: Found binding in [jar:file:\/usr\/local\/hadoop-3.1.1\/share\/hadoop\/common\/lib\/slf4j-log4j12-1.7.25.jar!\/org\/slf4j\/impl\/StaticLoggerBinder.class]\nSLF4J: See http:\/\/www.slf4j.org\/codes.html#multiple_bindings for an explanation.\nSLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]\nHBase Shell\nUse \\\"help\\\" to get list of supported commands.\nUse \\\"exit\\\" to quit this interactive shell.\nVersion 1.4.9, rd625b212e46d01cb17db9ac2e9e927fdb201afa1, Wed Dec  5 11:54:10 PST 2018\nhbase(main):001:0&gt; create \\'clsn\\',\\'cf\\'   #\u521b\u5efa\u4e00\u4e2aclsn\u8868\uff0c\u4e00\u4e2acf \u5217\u7c07\n0 row(s) in 7.8790 seconds\n=&gt; Hbase::Table - clsn\nhbase(main):003:0&gt; list    #\u67e5\u770bhbase \u6240\u6709\u8868\nTABLE\nclsn\n1 row(s) in 0.0860 seconds\n=&gt; [\\\"clsn\\\"]\nhbase(main):004:0&gt; put \\'clsn\\',\\'1000000000\\',\\'cf:name\\',\\'clsn\\'    #put\u4e00\u6761\u8bb0\u5f55\u5230\u8868clsn\uff0crowkey \u4e3a 1000000000\uff0c\u653e\u5230 name\u5217\u4e0a\n0 row(s) in 0.3390 seconds\nhbase(main):005:0&gt; put \\'clsn\\',\\'1000000000\\',\\'cf:sex\\',\\'male\\'    #put\u4e00\u6761\u8bb0\u5f55\u5230\u8868clsn\uff0crowkey \u4e3a 1000000000\uff0c\u653e\u5230sex\u5217\u4e0a\n0 row(s) in 0.0300 seconds\nhbase(main):006:0&gt; put \\'clsn\\',\\'1000000000\\',\\'cf:age\\',\\'24\\'     #put\u4e00\u6761\u8bb0\u5f55\u5230\u8868clsn\uff0crowkey \u4e3a 1000000000\uff0c\u653e\u5230age\u5217\u4e0a\n0 row(s) in 0.0290 seconds\nhbase(main):007:0&gt; count  \\'clsn\\'\n1 row(s) in 0.2100 seconds\n=&gt; 1\nhbase(main):008:0&gt;  get \\'clsn\\',\\'cf\\'\nCOLUMN                        CELL\n0 row(s) in 0.1050 seconds\nhbase(main):009:0&gt; get \\'clsn\\',\\'1000000000\\'      #\u83b7\u53d6\u6570\u636e\nCOLUMN                        CELL\n cf:age                       timestamp=1545710530665, value=24\n cf:name                      timestamp=1545710495871, value=clsn\n cf:sex                       timestamp=1545710509333, value=male\n1 row(s) in 0.0830 seconds\nhbase(main):010:0&gt; list\nTABLE\nclsn\n1 row(s) in 0.0240 seconds\n=&gt; [\\\"clsn\\\"]\nhbase(main):011:0&gt; drop  clsn\nNameError: undefined local variable or method `clsn\\' for #&lt;Object:0x6f731759&gt;\nhbase(main):012:0&gt; drop  \\'clsn\\'\nERROR: Table clsn is enabled. Disable it first.\nHere is some help for this command:\nDrop the named table. Table must first be disabled:\n  hbase&gt; drop \\'t1\\'\n  hbase&gt; drop \\'ns1:t1\\'\nhbase(main):013:0&gt; list\nTABLE\nclsn\n1 row(s) in 0.0330 seconds\n=&gt; [\\\"clsn\\\"]\nhbase(main):015:0&gt; disable \\'clsn\\'\n0 row(s) in 2.4710 seconds\nhbase(main):016:0&gt; list\nTABLE\nclsn\n1 row(s) in 0.0210 seconds\n=&gt; [\\\"clsn\\\"]<\/pre>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>1. \u73af\u5883\u51c6\u5907 \u8bf4\u660e\uff1a\u672c\u6b21\u96c6\u7fa4\u642d\u5efa\u4f7f\u7528\u7cfb\u7edf\u7248\u672cCentos 7.5 \uff0c\u8f6f\u4ef6\u7248\u672c V3.1.1\u3002 1.1 \u914d\u7f6e\u8bf4 &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"\" href=\"http:\/\/www.weijing.co\/?p=5411\"> <span class=\"screen-reader-text\">Hadoop+HBase \u96c6\u7fa4\u642d\u5efa<\/span> \u67e5\u770b\u5168\u6587 &raquo;<\/a><\/p>\n","protected":false},"author":4,"featured_media":5705,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":""},"categories":[114,118],"tags":[],"uagb_featured_image_src":{"full":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa.jpg",600,400,false],"thumbnail":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-150x150.jpg",150,150,true],"medium":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-300x200.jpg",300,200,true],"medium_large":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa.jpg",600,400,false],"large":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa.jpg",600,400,false],"1536x1536":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa.jpg",600,400,false],"2048x2048":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa.jpg",600,400,false],"mailpoet_newsletter_max":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa.jpg",600,400,false],"woocommerce_thumbnail":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-50x50.jpg",50,50,true],"woocommerce_single":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-80x53.jpg",80,53,true],"woocommerce_gallery_thumbnail":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-100x100.jpg",100,100,true],"shop_catalog":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-50x50.jpg",50,50,true],"shop_single":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-80x53.jpg",80,53,true],"shop_thumbnail":["http:\/\/www.weijing.co\/wp-content\/uploads\/2020\/07\/HadoopHBase-\u96c6\u7fa4\u642d\u5efa-100x100.jpg",100,100,true]},"uagb_author_info":{"display_name":"weijing","author_link":"http:\/\/www.weijing.co\/?author=4"},"uagb_comment_info":0,"uagb_excerpt":"1. \u73af\u5883\u51c6\u5907 \u8bf4\u660e\uff1a\u672c\u6b21\u96c6\u7fa4\u642d\u5efa\u4f7f\u7528\u7cfb\u7edf\u7248\u672cCentos 7.5 \uff0c\u8f6f\u4ef6\u7248\u672c V3.1.1\u3002 1.1 \u914d\u7f6e\u8bf4&hellip;","_links":{"self":[{"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/posts\/5411"}],"collection":[{"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/www.weijing.co\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5411"}],"version-history":[{"count":2,"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/posts\/5411\/revisions"}],"predecessor-version":[{"id":5716,"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/posts\/5411\/revisions\/5716"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/www.weijing.co\/index.php?rest_route=\/wp\/v2\/media\/5705"}],"wp:attachment":[{"href":"http:\/\/www.weijing.co\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5411"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.weijing.co\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5411"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.weijing.co\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5411"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}