Skip to content

Blog: Control plane metrics are GA: Keep your API server healthy - #6028

Draft
Reshmi Mangalore (mangalorereshmi) wants to merge 16 commits into
Azure:masterfrom
mangalorereshmi:blog/control-plane-metrics-ga
Draft

Reshmi Mangalore (mangalorereshmi) wants to merge 16 commits into
Azure:masterfrom
mangalorereshmi:blog/control-plane-metrics-ga

Conversation

@mangalorereshmi

Copy link
Copy Markdown
Contributor

Summary

New AKS Engineering Blog post: Control plane metrics are GA: Keep your API server healthy

  • Announces general availability of AKS control plane metrics (Azure Monitor managed service for Prometheus).
  • Covers enablement (az aks create/update --enable-control-plane-metrics), Grafana dashboards (20331/20330), and tuning via ama-metrics-settings-configmap.
  • Shares API server monitoring best practices: request mix, 429/5xx, latency, in-flight requests, APF seats, LIST fan-out, availability, plus a recommended investigation flow.
  • Lists GA limitations.

Changes

  • website/blog/2026-10-15-aks-control-plane-metrics-ga/index.md (new post)
  • website/blog/authors.yml: adds reshmi-mangalore and david-kydd

Checklist

  • Front matter complete; author and tag keys exist
  • Title < 60 chars, description 150–160 chars
  • <!-- truncate --> after intro
  • Code blocks specify language; descriptive link text; external links verified
  • Hero image (optional, pending)
  • npm run build (couldn't run locally due to npm registry access; relying on CI)
  • Update folder date if publish date changes

Co-authors: Reshmi Mangalore (@mangalorereshmi), David Kydd (@davidkydd)

Reshmi Mangalore and others added 15 commits October 15, 2026 14:09
Announce GA of AKS control plane metrics and share API server monitoring best practices. Adds authors reshmi-mangalore and david-kydd.

Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
- Reword sections in Azure blog tone, add PromQL examples and recommendations
- Add GA limitations, What's next, and linked Get started steps
- Fix en-us links, hyphenation, casing, and markdown lint issues

Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
- Add 'Find the client behind the load' using AKS audit logs
- Add 'Common fixes' with Learn links
- Add client attribution step to investigation flow; move alerting guidance

Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
- Move latency percentiles setup under the latency signal
- State baseline guidance once before the signal deep-dives
- Point to built-in API server and etcd dashboards throughout
- Replace redundant note with link to client attribution section

Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
…estigation flow

Co-authored-by: David Kydd <davidkydd@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: fadda8f3-62cd-45e4-93f8-5e5f6d978ad4
@mangalorereshmi

Copy link
Copy Markdown
Contributor Author

Copilot resolve the merge conflicts in this pull request


```promql
# Objects fetched from storage by LIST calls, per resource
sum by (cluster, resource) (rate(apiserver_storage_list_fetched_objects_total[5m]))

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe we should add storage!="watchcache" as condition. Since v1.37, this metric has two labels - kubernetes/kubernetes@d805dfa

@fuweid Fu Wei (fuweid) left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM non-binding

Preserve all upstream and control-plane metrics blog authors.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants