OpsCanary
kubernetesschedulingPractitioner

Mastering Workload-Aware Scheduling in Kubernetes v1.37

5 min read Kubernetes BlogSep 8, 2026Reviewed for accuracy
Share
PractitionerHands-on experience recommended

Kubernetes v1.37 marks a pivotal moment in workload-aware scheduling, addressing the need for more sophisticated resource management in diverse workloads. The introduction of the CompositePodGroup API enables you to express multi-level topology constraints, gang scheduling, and preemption policies for complex groups of Pods. This means you can now manage dependencies and scheduling requirements more effectively, ensuring that related Pods are deployed together, which is vital for applications that require tight coordination.

The scheduling mechanism evaluates the entire group tree as a unified unit. When scheduling a hierarchical workload, kube-scheduler traverses from the root CompositePodGroup down to the leaf PodGroup objects. Each level must satisfy its own policies, such as ensuring a minimum number of child groups or Pods are scheduled together. For instance, using the minGroupCount parameter ensures that a parent group only schedules when its child groups meet the specified criteria. This structured approach allows for more predictable and efficient resource utilization, especially in environments with heterogeneous workloads.

In practice, understanding the parameters like minCount and minGroupCount is essential for effective scheduling. The recent promotion of the core Workload and PodGroup APIs to v1beta1 indicates a commitment to stability and usability. However, be mindful of the complexity this introduces; misconfigurations can lead to scheduling failures or resource contention. Always test your configurations in a staging environment before rolling them out to production to avoid disruptions.

Key takeaways

  • Utilize CompositePodGroup for complex scheduling scenarios involving multiple Pods.
  • Leverage Workload-Aware Preemption to optimize resource allocation based on workload needs.
  • Ensure minimum scheduling requirements using minCount and minGroupCount parameters.
  • Evaluate the entire group tree for unified scheduling decisions.
  • Test configurations in staging to prevent production disruptions.

Why it matters

Effective workload-aware scheduling can significantly enhance application performance and resource utilization, reducing costs and improving reliability in production environments.

Code examples

YAML
1apiVersion: scheduling.k8s.io/v1beta1
2kind: Workload
3metadata:
4  name: example-workload
5  annotations:
6    kubernetes.io/description: "Two-level workload hierarchy requiring 4 worker Pods and 1 driver Pod to schedule together."
7spec:
8  compositePodGroupTemplates:
9  - name: workload-root
10    schedulingPolicy:
11      gang:
12        minGroupCount: 2
13    podGroupTemplates:
14    - name: workers
15      schedulingPolicy:
16        gang:
17          minCount: 4
18    - name: driver
19      schedulingPolicy:
20        gang:
21          minCount: 1
YAML
1apiVersion: scheduling.k8s.io/v1alpha3
2kind: CompositePodGroup
3metadata:
4  name: example-root-group
5  annotations:
6    kubernetes.io/description: "Root group coordinating gang scheduling across child worker and driver PodGroups."
7spec:
8  workloadRef:
9    workloadName: example-workload
10    templateName: workload-root
11  schedulingPolicy:
12    gang:
13      minGroupCount: 2
YAML
1apiVersion: scheduling.k8s.io/v1beta1
2kind: PodGroup
3metadata:
4  name: example-workload-workers
5  annotations:
6    kubernetes.io/description: "Worker group requiring at least 4 Pods to be scheduled together."
7spec:
8  parentCompositePodGroupName: example-root-group
9  workloadRef:
10    workloadName: example-workload
11    templateName: workers
12  schedulingPolicy:
13    gang:
14      minCount: 4

When NOT to use this

The official docs don't call out specific anti-patterns here. Use your judgment based on your scale and requirements.

Want the complete reference?

Read official docs

Test what you just learned

Quiz questions written from this article

Take the quiz →
Linux FoundationSponsor

Industry-standard certifications built by the people behind Linux and Kubernetes. Earn the CKA — the gold standard Kubernetes administrator cert. OpsCanary readers get 30% off year-round with code OPSCANARY3.

Get CKA certified →

Get the daily digest

One email. 5 articles. Every morning.

No spam. Unsubscribe anytime.