google-cloud-dataproc - 在 Google Cloud Python SDK create_cluster() 函数中添加机器类型参数

Question

谷歌云的 python 文档有一个脚本（python-docs-samples/dataproc/submit_job_to_cluster.py），它具有以下功能：

def create_cluster(dataproc, project, zone, region, cluster_name):
      print('Creating cluster...')
      zone_uri = 'https://www.googleapis.com/compute/v1/projects/{}/zones/{}'.format(
        project, zone)
      cluster_data = {
         'projectId': project,
         'clusterName': cluster_name,
         'config': {
             'gceClusterConfig': {
                'zoneUri': zone_uri
             }
         }
      }
      result = dataproc.projects().regions().clusters().create(
         projectId=project,
         region=region,
         body=cluster_data).execute()
      return result

我想知道是否可以在此函数中为集群的主节点和工作节点指定机器类型？

Answer 1

以下应该有效：

def create_cluster(dataproc, project, zone, region, cluster_name):
      print('Creating cluster...')
      zone_uri = 'https://www.googleapis.com/compute/v1/projects/{}/zones/{}'.format(
        project, zone)
      cluster_data = {
         'projectId': project,
         'clusterName': cluster_name,
         'config': {
             'gceClusterConfig': {
                'zoneUri': zone_uri
              },
              'masterConfig': {
                'machineTypeUri' : 'n1-standard-1',
              },
              'workerConfig': {
                'machineTypeUri' : 'n1-standard-4',
              },
             }
         }
      }
      result = dataproc.projects().regions().clusters().create(
         projectId=project,
         region=region,
         body=cluster_data).execute()
      return result

https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.clusters#ClusterConfig