{"id":1774,"date":"2020-07-01T04:49:43","date_gmt":"2020-06-30T20:49:43","guid":{"rendered":"http:\/\/39.97.231.10\/?p=1774"},"modified":"2020-07-01T04:49:43","modified_gmt":"2020-06-30T20:49:43","slug":"hbase-region%e8%a7%a3%e6%9e%90","status":"publish","type":"post","link":"http:\/\/www.weijing.co\/?p=1774","title":{"rendered":"HBase Region\u89e3\u6790"},"content":{"rendered":"
\n
\n
\n
\u4ec0\u4e48\u662fRegion \uff1f<\/span><\/div>\n<\/div>\n<\/div>\n<\/div>\n
\n
\n
\n
<\/div>\n
<\/div>\n<\/div>\n
image.png<\/div>\n<\/div>\n

Region\u662fHBase\u6570\u636e\u7ba1\u7406\u7684\u57fa\u672c\u5355\u4f4d\u3002\u6570\u636e\u7684move,\u6570\u636e\u7684balance\uff0c\u6570\u636e\u7684split\uff0c\u90fd\u662f\u6309\u7167region\u6765\u8fdb\u884c\u64cd\u4f5c\u7684\u3002
\nregion\u4e2d\u5b58\u50a8\u8fd9\u7528\u6237\u7684\u771f\u5b9e\u6570\u636e\uff0c\u800c\u4e3a\u4e86\u7ba1\u7406\u8fd9\u4e9b\u6570\u636e\uff0cHBase\u4f7f\u7528\u4e86RegionSever\u6765\u7ba1\u7406region\u3002
\n\u4e00\u4e2a\u8868\u4e2d\u53ef\u4ee5\u5305\u542b\u4e00\u4e2a\u6216\u591a\u4e2aRegion\u3002
\n\u6bcf\u4e2aRegion\u53ea\u80fd\u901a\u8fc7\u4e00\u4e2aRS\uff08RegionServer\uff09\u63d0\u4f9b\u670d\u52a1\uff0c\u4e00\u4e2aRS\u53ef\u4ee5\u540c\u65f6\u5bf9\u591a\u4e2aRegion\u63d0\u4f9b\u670d\u52a1\uff0c\u6765\u81ea\u4e0d\u540cRS\u4e0a\u7684Region\u7ec4\u5408\u6210\u8868\u683c\u7684\u6574\u4f53\u903b\u8f91\u89c6\u56fe\u3002
\nregionServer\u5176\u5b9e\u662fhbase\u7684\u670d\u52a1\uff0c\u90e8\u7f72\u5728\u4e00\u53f0\u7269\u7406\u670d\u52a1\u5668\u4e0a\uff0cregion\u6709\u4e00\u70b9\u50cf\u5173\u7cfb\u578b\u6570\u636e\u7684\u5206\u533a\uff0c\u6570\u636e\u5b58\u653e\u5728region\u4e2d\uff0c\u5f53\u7136region\u4e0b\u9762\u8fd8\u6709\u5f88\u591a\u7ed3\u6784\uff0c\u786e\u5207\u6765\u8bf4\u6570\u636e\u5b58\u653e\u5728memstore\u548chfile\u4e2d\u3002\u6211\u4eec\u8bbf\u95eehbase\u7684\u65f6\u5019\uff0c\u5148\u53bbhbase\u7cfb\u7edf\u8868\u67e5\u627e\u5b9a\u4f4d\u8fd9\u6761\u8bb0\u5f55\u5c5e\u4e8e\u54ea\u4e2aregion\uff0c\u7136\u540e\u5b9a\u4f4d\u5230\u8fd9\u4e2aregion\u5c5e\u4e8e\u54ea\u4e2a\u670d\u52a1\u5668\uff0c\u7136\u540e\u5c31\u5230\u54ea\u4e2a\u670d\u52a1\u5668\u91cc\u9762\u67e5\u627e\u5bf9\u5e94region\u4e2d\u7684\u6570\u636e
\n\u6bcf\u4e2aregion\u6709\u4e09\u4e2a\u4e3b\u8981\u8981\u7d20:<\/p>\n

    \n
  • \u5b83\u6240\u5c5e\u4e8e\u54ea\u5f20\u8868<\/li>\n
  • \u5b83\u6240\u5305\u542b\u7684\u7684\u7b2c\u4e00\u884c(\u7b2c\u4e00\u4e2aregion\u6ca1\u6709\u9996\u884c)<\/li>\n
  • \u5b83\u6240\u5305\u542b\u7684\u6700\u540e\u4e00\u884c(\u672b\u4e00\u4e2aregion\u6ca1\u6709\u672b\u884c)<\/li>\n<\/ul>\n

    \u5f53\u8868\u521d\u5199\u6570\u636e\u65f6\uff0c\u6b64\u65f6\u8868\u53ea\u6709\u4e00\u4e2aregion ,\u5f53\u968f\u7740\u6570\u636e\u7684\u589e\u591a\uff0cregion\u5f00\u59cb\u53d8\u5927\uff0c\u7b49\u5230\u5b83\u8fbe\u5230\u9650\u5b9a\u7684\u9600\u503c\u5927\u5c0f\u65f6\uff0c\u53d8\u5316\u628aregion\u5206\u88c2\u4e3a\u4e24\u4e2a\u5927\u5c0f\u57fa\u672c\u76f8\u540c\u7684region,\u800c\u8fd9\u4e2a\u9600\u503c\u5c31\u662fstorefile\u7684\u8bbe\u5b9a\u5927\u5c0f(\u53c2\u6570:hbase.hregion.max.filesize\u65b0\u7248\u672c\u9ed8\u8ba410G) ,\u5728\u7b2c\u4e00\u6b21\u5206\u88c2region\u4e4b\u524d\uff0c\u6240\u6709\u52a0\u8f7d\u7684\u6570\u636e\u90fd\u653e\u5728\u539f\u59cb\u533a\u57df\u7684\u90a3\u53f0\u670d\u52a1\u5668\u4e0a\uff0c\u968f\u7740\u8868\u7684\u53d8\u5927region\u7684\u4e2a\u6570\u4e5f\u4f1a\u76f8\u5e94\u7684\u589e\u52a0\uff0c\u800cregion\u662fHbase\u96c6\u7fa4\u5206\u5e03\u6570\u636e\u7684\u6700\u5c0f\u5355\u4f4d\u3002(\u4f46region\u4e5f\u662f\u7531block\u7ec4\u6210\uff0c\u5177\u4f53\u8fd9\u4e2ablock\u548chdfs block\u4ec0\u4e48\u6837\u7684\u5173\u7cfb\u540e\u9762\u518d\u8bf4\uff0cregion\u662f\u5c5e\u4e8e\u5355\u4e00\u7684regionserver\uff0c\u9664\u975e\u8fd9\u4e2aregionserver\u5b95\u673a\uff0c\u6216\u8005\u5176\u5b83\u65b9\u5f0f\u6302\u6389\uff0c\u518d\u6216\u8005\u6267\u884cbalance\u65f6\uff0c\u624d\u53ef\u80fd\u4f1a\u5c06\u8fd9\u90e8\u5206region\u7684\u4fe1\u606f\u8f6c\u79fb\u5230\u5176\u5b83\u673a\u5668\u4e0a\u3002)
    \n\u8fd9\u4e5f\u5c31\u662f\u4e3a\u4ec0\u4e48region\u6bd4\u8f83\u5c11\u7684\u65f6\u5019\uff0c\u5bfc\u81f4region\u5206\u914d\u4e0d\u5747\uff0c\u603b\u662f\u5206\u6d3e\u5230\u5c11\u6570\u7684\u8282\u70b9\u4e0a\uff0c\u8bfb\u5199\u5e76\u53d1\u6548\u679c\u4e0d\u663e\u8457\uff0c\u8fd9\u5c31\u662fhbase\u8bfb\u5199\u6548\u7387\u6bd4\u8f83\u4f4e\u7684\u539f\u56e0\u3002<\/p>\n

    Region \u7684\u7ed3\u6784\uff1f<\/h2>\n
    \n
    \n
    <\/div>\n
    <\/div>\n<\/div>\n
    <\/div>\n<\/div>\n
      \n
    1. \u5c42\u7ea7\u7ed3\u6784<\/li>\n<\/ol>\n
        \n
      • Table (HBase \u8868)<\/li>\n
      • Region(\u8868\u7684Regions)\n
          \n
        • Store(Region\u4e2d\u4ee5\u5217\u65cf\u4e3a\u5355\u4f4d\u7684\u5355\u5143)\n
            \n
          • MemStore (\u7528\u4e8e\u5199\u7f13\u5b58)\n
              \n
            • StoreFile (StoreFiles for each Store for each Region for the table)\n
                \n
              • Block (\u8bfb\u5199\u7684\u6700\u5c0f\u5355\u5143)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n
                  \n
                1. \u91cd\u8981\u6210\u5458<\/li>\n<\/ol>\n

                  2.1 Region<\/h2>\n

                  Region\u662fHBase\u6570\u636e\u5b58\u50a8\u548c\u7ba1\u7406\u7684\u57fa\u672c\u5355\u4f4d<\/p>\n

                  2.1.1 Region\u7684\u6570\u91cf\u8bbe\u8ba1<\/h3>\n

                  \u8bbe\u8ba1\u7684\u672c\u610f\u662f\u6bcf\u4e2aServer\u8fd0\u884c\u5c0f\u6570\u91cf\uff082-200\uff09\u4e2a\u5927\u5bb9\u91cf\uff085-20Gb\uff09\u7684Region\uff0c\u7406\u7531\u5982\u4e0b\uff1a<\/p>\n

                    \n
                  • \u6bcf\u4e2aMemStore\u9700\u89812MB\u7684\u5806\u5185\u5b58\uff0c2MB\u662f\u914d\u7f6e\u7684\uff0c\u5047\u5982\u67091000\u62e5\u6709\u4e24\u4e2a\u5217\u65cf\u7684Region\uff0c\u90a3\u4e48\u5c31\u9700\u89813.9GB\u7684\u5806\u5185\u5b58\uff0c\u8fd8\u662f\u6ca1\u6709\u5b58\u50a8\u4efb\u4f55\u6570\u636e\u7684\u60c5\u51b5\u4e0b<\/li>\n
                  • HMaster\u8981\u82b1\u5927\u91cf\u7684\u65f6\u95f4\u6765\u5206\u914d\u548c\u79fb\u52a8Region<\/li>\n
                  • \u8fc7\u591aRegion\u4f1a\u589e\u52a0ZooKeeper\u7684\u8d1f\u62c5<\/li>\n
                  • \u6bcf\u4e2aRegion\u4f1a\u5bf9\u5e94\u4e00\u4e2aMapReduce\u4efb\u52a1\uff0c\u8fc7\u591aRegion\u4f1a\u4ea7\u751f\u592a\u591a\u4efb\u52a1<\/li>\n<\/ul>\n

                    2.1.2 Region\u7684\u5206\u914d<\/h3>\n

                    2.1.2.1 \u542f\u52a8\u65f6\u7684\u5206\u914d\u6b65\u9aa4<\/h4>\n
                      \n
                    1. Master\u542f\u52a8\u65f6\u8c03\u7528 AssignmentManager\u3002<\/li>\n
                    2. AssignmentManager \u67e5\u770bhbase:meta\u4e2d\u5df2\u7ecf\u5206\u914d\u597d\u7684Region<\/li>\n
                    3. \u5982\u679cRegiond\u7684\u5206\u914d\u4f9d\u7136\u6709\u6548\u7684\u8bdd (\u5982\u679cRegionServer \u4ecd\u7136\u5728\u7ebf\u7684\u8bdd) \u7ef4\u6301\u5f53\u524d\u5206\u914d<\/li>\n
                    4. \u5982\u679c\u5206\u914d\u5931\u6548,LoadBalancerFactory \u4f1a\u88ab\u8c03\u7528\u6765\u5206\u914dregion. \u8d1f\u8f7d\u5747\u8861\u5668(HBase 1.0\u9ed8\u8ba4\u4f7f\u7528StochasticLoadBalancer ) \u5206\u914d\u4efb\u52a1\u5230Region Server\u4e2d<\/li>\n
                    5. \u5982\u679c\u9700\u8981\u7684\u8bdd\uff0cRegion Server\u5206\u914d\u4fe1\u606f\u4f1a\u66f4\u65b0\u5230hbase:meta\u4e2d\u3002RegionServer\u542f\u52a8\u65f6\u8c03\u7528\u542f\u52a8\u4ee3\u7801\u6765\u542f\u52a8region\u3002<\/li>\n<\/ol>\n

                      2.1.2.2 RegionServer\u5931\u6548\u65f6\u7684\u5206\u914d\u6b65\u9aa4<\/h4>\n
                        \n
                      1. Region Server\u6302\u6389\u540e\u5b83\u4e0a\u9762\u7684regions\u53d8\u5f97\u4e0d\u53ef\u7528\u3002<\/li>\n
                      2. Master\u68c0\u6d4b\u5230Region Server\u6302\u6389\u4e86\u3002<\/li>\n
                      3. \u5931\u6548Region Server\u4e0a\u7684region\u5206\u914d\u4f1a\u88ab\u8ba4\u4e3a\u65e0\u6548\u5e76\u91c7\u7528\u8ddf\u542f\u52a8\u65f6\u540c\u6837\u987a\u5e8f\u7684\u6b65\u9aa4\u5206\u914dregion<\/li>\n
                      4. \u6b63\u5728\u8fdb\u884c\u7684\u67e5\u8be2\u64cd\u4f5c\u4f1a\u91cd\u65b0\u6267\u884c\uff0c\u4e0d\u4f1a\u4e22\u5931<\/li>\n
                      5. \u5207\u6362\u52a8\u4f5c\u8981\u5728\u4ee5\u4e0b\u65f6\u95f4\u5185\u5b8c\u6210\uff1a ZooKeeper session timeout + split time + assignment\/replay time<\/li>\n<\/ol>\n

                        2.1.3 Region\u7684\u4f4d\u7f6e\u9009\u62e9<\/h3>\n

                        Region\u7684\u4f4d\u7f6e\u9009\u62e9\u901a\u8fc7HDFS\u7684\u590d\u5236\u673a\u5236\u5b8c\u6210
                        \n1\uff09\u6b65\u9aa4\uff1a<\/p>\n

                          \n
                        1. \u7b2c\u4e00\u4e2a\u526f\u672c\u5199\u5728\u672c\u5730\u8282\u70b9<\/li>\n
                        2. \u7b2c\u4e8c\u526f\u672c\u5199\u5230\u53e6\u4e00\u4e2a\u673a\u4e0a\u4efb\u610f\u8282\u70b9<\/li>\n
                        3. \u7b2c\u4e09\u4e2a\u526f\u672c\u5199\u5230\u8ddf\u7b2c\u4e8c\u526f\u672c\u76f8\u540c\u673a\u67b6\u4e0d\u540c\u8282\u70b9\u7684\u5176\u4ed6\u8282\u70b9<\/li>\n
                        4. \u540e\u9762\u7684\u526f\u672c\u5c06\u5199\u5230\u96c6\u7fa4\u4e2d\u7684\u4efb\u610f\u8282\u70b9\u4e2d\u3002<\/li>\n<\/ol>\n
                          \n
                          \n
                          <\/div>\n
                          <\/div>\n<\/div>\n
                          <\/div>\n<\/div>\n

                          2\uff09\u8981\u70b9\uff1a<\/p>\n