在上篇我们看了Hadoop的集群节点配置:
Hadoop 集群角色和节点数规划建议
https://www.cndba.cn/dave/article/3372
CDH 官方文档有一份更详细的节点和角色配置,官网将主机分成以下四种类型:
1) Master hosts run Hadoop master processes such as the HDFS NameNode and YARN Resource Manager.
2) Utility hosts run other cluster processes that are not master processes such as Cloudera Manager and the Hive Metastore.
3) Gateway hosts are client access points for launching jobs in the cluster. The number of gateway hosts required varies depending on the type and size of the workloads.
4) Worker hosts primarily run DataNodes and other distributed processes such as Impalad.
根据不同节点,角色分配也不一样。
1、 3 - 10 Worker Hosts without High Availability
2、 3 - 20 Worker Hosts with High Availability
3、 20 - 80 Worker Hosts with High Availability
4、 80 - 200 Worker Hosts with High Availability
5、 200 - 500 Worker Hosts with High Availability
6、 500 -1000 Worker Hosts with High Availability
版权声明:本文为博主原创文章,未经博主允许不得转载。