Devops Kubernetes for Data

Use when the user asks about Spark on Kubernetes, the Spark Operator, Airflow KubernetesExecutor, Kafka on Kubernetes with Strimzi, Volcano or Kueue batch scheduling, GPU scheduling, node pools or Karpenter for data jobs, or storage for data workloads. Produces data-platform configs on Kubernetes. Not for pipeline design (use data-etl-pipeline).

45 stars 6 forksDevOps & Cloud

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add j4flmao/agent-skills --skill devops-kubernetes-for-data
Manual install
git clone --depth 1 https://github.com/j4flmao/agent-skills.git /tmp/agent-skills
mkdir -p ~/.claude/skills
cp -r /tmp/agent-skills/skills/devops/kubernetes-for-data ~/.claude/skills/devops-kubernetes-for-data

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Kubernetes for Data Agent

## Purpose
Configures Kubernetes for data-intensive workloads: Spark, Airflow, Kafka, with GPU scheduling, node pools, and storage optimization.

## Agent Protocol

### Trigger
User request includes: Kubernetes for data, Spark on K8s, Airflow on K8s, Kafka on K8s, Strimzi, Spark Operator, Volcano, GPU scheduling, node pools, data workloads K8s, Karpenter.

### Protocol
1. Identify data workload types (Spark, Airflow, Kafka, batch).
2. Select operators (Spark Operator, Strimzi, Airflow Helm chart).
3. Design node pools for workload isolation.
4. Configure resource requests/limits for executors.
5. Set up GPU scheduling if needed.
6. Choose storage class and CSI driver.
7. Configure Karpenter or autoscaler for elasticity.

## Output
Kubernetes configuration for data workloads with Spark/Airflow/Kafka setup, GPU strategy, storage plan.

### Response Format
Read the full skill on GitHub

Details

Skill name
devops-kubernetes-for-data
Path
skills/devops/kubernetes-for-data/SKILL.md
License
MIT
Repo updated
17 November 2026

FAQ

What does the Devops Kubernetes for Data skill do?

Use when the user asks about Spark on Kubernetes, the Spark Operator, Airflow KubernetesExecutor, Kafka on Kubernetes with Strimzi, Volcano or Kueue batch scheduling, GPU scheduling, node pools or Karpenter for data jobs, or storage for data workloads. Produces data-platform configs on Kubernetes. Not for pipeline design (use data-etl-pipeline).

How do I install the Devops Kubernetes for Data skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add j4flmao/agent-skills --skill devops-kubernetes-for-data. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Devops Kubernetes for Data popular?

It lives in j4flmao/agent-skills, which has 45 GitHub stars and 6 forks.

Related skills

Agent Observability

45

j4flmao/agent-skills

Use when the user asks about agent observability, tracing agent reasoning, debugging an agent loop, OpenTelemetry GenAI spans for LLM calls, LLM cost tracking per agent, agent audit logs or hallucination/eval monitoring in production. Produces instrumentation config, trace schema, dashboards, alerts and cost attribution. Not for generic service tracing without LLMs (use devops-opentelemetry).

DevOps & Cloud

AI Agent Architectures

45

j4flmao/agent-skills

Use when the user asks to build an AI agent, design an agent that calls tools and keeps memory, write an agent system prompt or pick an agent framework (Claude Agent SDK, OpenAI Agents SDK, LangGraph). Produces an architecture brief covering loop, tools, memory, guardrails and evals, routing depth to child skills. Not for workflow patterns (use ai-agentic-workflows).

AI, LLMs & Agents

AI Agent Core Loop

45

j4flmao/agent-skills

Use when the user asks about the agent loop, ReAct vs plan-and-solve, re-planning, Reflexion, an agent stuck in a loop, max iterations or termination conditions. Produces a loop spec or patch with state, success predicate, caps and no-progress detection. Not for overall agent design (use ai-agent-architectures) or tool schemas (use tool-calling-principles).

AI, LLMs & Agents

Devops Kubernetes Operators

45

j4flmao/agent-skills

Use when the user asks about Kubernetes operators, custom controllers, CRDs, Kubebuilder, Operator SDK, controller-runtime reconcile loops, finalizers, conversion webhooks, envtest, OLM, or Crossplane compositions. Produces operator code and CRD designs. Not for a chart plus operator scaffold (use cloud-native-kubernetes-mastery).

DevOps & Cloud

Devops Kubernetes Autoscaling

45

j4flmao/agent-skills

Use when the user asks about HPA, VPA, Cluster Autoscaler, Karpenter, KEDA to scale pods on queue length, custom or external metrics autoscaling, scaling behavior and flapping, or autoscaling cost. Produces combined HPA/VPA/node autoscaling configs. Not for KEDA scaler details (use cloud-native-event-driven-scaling) or data workloads (use devops-kubernetes-for-data).

DevOps & Cloud

Devops Mlops

45

j4flmao/agent-skills

Use when the user asks about MLOps, ML CI/CD pipelines, model registry promotion, canary or shadow model deployment, model drift monitoring, model rollback, or feature store CI/CD. Produces model delivery pipelines and monitoring. Not for model serving runtimes (use ml-model-serving) or experiment tracking (use ml-experiment-tracking).

DevOps & Cloud

Browse the most popular Claude skills, all devops & cloud skills, or write your own with the skills generator.