Data Data Lake
Use when the user asks to choose between Iceberg, Delta Lake and Hudi, ACID tables on object storage, time travel, schema evolution, compaction, vacuum, Z-order, merge-on-read vs copy-on-write or data lake architecture. Produces table-format choice and table maintenance plan. Not for medallion and Unity Catalog platform design (use data-data-lakehouse).
Install
npx skills add j4flmao/agent-skills --skill data-data-lakegit clone --depth 1 https://github.com/j4flmao/agent-skills.git /tmp/agent-skills
mkdir -p ~/.claude/skills
cp -r /tmp/agent-skills/skills/data/data-lake ~/.claude/skills/data-data-lakePersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Data Lake
## Purpose
Design and operate ACID-compliant data lakes on object storage using Delta Lake, Apache Iceberg, or Apache Hudi. Manage table formats, optimize storage layout, enforce schema evolution, and implement time-travel and CDC patterns.
## Agent Protocol
### Trigger
Exact user phrases: "Delta Lake", "Apache Iceberg", "Apache Hudi", "Lakehouse", "ACID on lake", "time travel", "table format", "compaction", "Z-order", "Hilbert curve", "vacuum", "CDC", "merge-on-read", "copy-on-write", "manifest file", "metadata layer", "schema evolution", "optimize table", "incremental query".
### Input Context
Before activating, verify:
- Object storage backend (S3, ADLS, GCS, MinIO)
- Table format preference (Delta, Iceberg, Hudi)
- Compute engine (Spark, Flink, Trino, Presto, Hive)
- Write pattern (append-heavy, update-heavy, CDC stream)
- Query pattern (OLAP, incremental, point lookup, full scan)
- Partition strategy (date, categorical, Z-order dimensions)
### Output Artifact
Lake architecture with table format selection, compaction strategy, optimization plan.
### Response Format
```
Table Format: {Delta Lake | Apache Iceberg | Apache Hudi}
Storage: {S3 | ADLS | GCS | MinIO}
Write Mode: {copy-on-write | merge-on-read}
Partition: {column, granularity}
Optimize: {Z-order by columns, compaction interval}
Vacuum: {retention hours}
```
```sql
-- DDL / optimization commands
```Details
- Skill name
data-data-lake- Repository
- j4flmao/agent-skills
- Path
skills/data/data-lake/SKILL.md- License
- MIT
- Repo updated
- 17 November 2026
FAQ
What does the Data Data Lake skill do?
Use when the user asks to choose between Iceberg, Delta Lake and Hudi, ACID tables on object storage, time travel, schema evolution, compaction, vacuum, Z-order, merge-on-read vs copy-on-write or data lake architecture. Produces table-format choice and table maintenance plan. Not for medallion and Unity Catalog platform design (use data-data-lakehouse).
How do I install the Data Data Lake skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add j4flmao/agent-skills --skill data-data-lake. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Data Data Lake popular?
It lives in j4flmao/agent-skills, which has 45 GitHub stars and 6 forks.
Related skills
Agent Observability
45j4flmao/agent-skills
Use when the user asks about agent observability, tracing agent reasoning, debugging an agent loop, OpenTelemetry GenAI spans for LLM calls, LLM cost tracking per agent, agent audit logs or hallucination/eval monitoring in production. Produces instrumentation config, trace schema, dashboards, alerts and cost attribution. Not for generic service tracing without LLMs (use devops-opentelemetry).
AI Agent Architectures
45j4flmao/agent-skills
Use when the user asks to build an AI agent, design an agent that calls tools and keeps memory, write an agent system prompt or pick an agent framework (Claude Agent SDK, OpenAI Agents SDK, LangGraph). Produces an architecture brief covering loop, tools, memory, guardrails and evals, routing depth to child skills. Not for workflow patterns (use ai-agentic-workflows).
AI Agent Core Loop
45j4flmao/agent-skills
Use when the user asks about the agent loop, ReAct vs plan-and-solve, re-planning, Reflexion, an agent stuck in a loop, max iterations or termination conditions. Produces a loop spec or patch with state, success predicate, caps and no-progress detection. Not for overall agent design (use ai-agent-architectures) or tool schemas (use tool-calling-principles).
Data Formats
45j4flmao/agent-skills
Use when the user asks about Parquet vs ORC vs Avro, Apache Arrow, Arrow Flight, row group size, encoding and compression (ZSTD, Snappy) or columnar vs row-oriented formats. Produces a format choice and writer settings for the access pattern. Not for table formats like Iceberg or Delta (use data-data-lake).
Core Onboarding
45j4flmao/agent-skills
Use when the user asks about onboarding a new developer, new team member or new joiner, a getting started guide, dev environment setup, ramp-up plan or first-week checklist. Produces an onboarding plan and environment setup guide. Not for scaffolding a new repository (use project-init) or writing the README (use dev-loop-readme-writer).
Dev Loop Readme Writer
45j4flmao/agent-skills
Use when the user asks to write a README for this repository, improve project documentation, add quick start, installation, usage or contributing sections, or badges. Produces a structured README.md. Not for API reference docs (use backend-openapi-documentation) or changelogs (use dev-loop-changelog-generator).
Browse the most popular Claude skills, all writing & content skills, or write your own with the skills generator.