Backend Bulk Import

Use when the user asks about bulk import, CSV upload, importing a million-row CSV without locking the table, Excel import, row validation error reports, upsert from file or import progress. Produces a streaming import pipeline with staging, batching and an error report. Not for file upload storage itself (use backend-file-storage).

45 stars 6 forksSoftware Development

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add j4flmao/agent-skills --skill backend-bulk-import
Manual install
git clone --depth 1 https://github.com/j4flmao/agent-skills.git /tmp/agent-skills
mkdir -p ~/.claude/skills
cp -r /tmp/agent-skills/skills/backend/bulk-import ~/.claude/skills/backend-bulk-import

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Bulk Import Skill

## Purpose
Design robust bulk import systems that handle large CSV/Excel files with validation, progress tracking, error recovery, and audit trails.

## Architecture Decision Trees

### Import Mode Selection

| Criterion | Insert | Upsert | Replace |
|-----------|--------|--------|---------|
| Duplicate handling | Fails on conflict | Updates existing | Truncate all first |
| Performance | Fastest | Moderate (check per row) | Fast (truncate + insert) |
| Idempotent | No | Yes (by dedup field) | No (destructive) |
| Risk level | Low | Low | High (data loss) |
| Audit trail | All inserts | Updates logged | Lost on truncate |
| Rollback complexity | Simple (transaction) | Moderate | Complex (needs backup) |
| Use case | New data ingestion | Sync with external system | Full reimport/replace |

Decision: Upsert for production syncs. Insert for immutable audit data. Replace only with pre-import backup.

### Parsing Strategy

| Criterion | Streaming (CSV) | Full load (Excel) | Hybrid (chunked) |
|-----------|----------------|-------------------|------------------|
| Memory | O(1) rows in memory | Full file in memory | O(batch size) |
| Max file size | Unlimited | ~100MB practical | ~500MB |
| Row validation | Per-batch | All before processing | Per-batch |
| Error collection | Per-batch | Full before process | Per-batch |
| Progress tracking | Yes (real-time) | No (must parse first) | Yes (per chunk) |
| Random access | No | Yes | No |
Read the full skill on GitHub

Details

Skill name
backend-bulk-import
Path
skills/backend/bulk-import/SKILL.md
License
MIT
Repo updated
17 November 2026

FAQ

What does the Backend Bulk Import skill do?

Use when the user asks about bulk import, CSV upload, importing a million-row CSV without locking the table, Excel import, row validation error reports, upsert from file or import progress. Produces a streaming import pipeline with staging, batching and an error report. Not for file upload storage itself (use backend-file-storage).

How do I install the Backend Bulk Import skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add j4flmao/agent-skills --skill backend-bulk-import. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Backend Bulk Import popular?

It lives in j4flmao/agent-skills, which has 45 GitHub stars and 6 forks.

Related skills

Agent Observability

45

j4flmao/agent-skills

Use when the user asks about agent observability, tracing agent reasoning, debugging an agent loop, OpenTelemetry GenAI spans for LLM calls, LLM cost tracking per agent, agent audit logs or hallucination/eval monitoring in production. Produces instrumentation config, trace schema, dashboards, alerts and cost attribution. Not for generic service tracing without LLMs (use devops-opentelemetry).

DevOps & Cloud

AI Agent Architectures

45

j4flmao/agent-skills

Use when the user asks to build an AI agent, design an agent that calls tools and keeps memory, write an agent system prompt or pick an agent framework (Claude Agent SDK, OpenAI Agents SDK, LangGraph). Produces an architecture brief covering loop, tools, memory, guardrails and evals, routing depth to child skills. Not for workflow patterns (use ai-agentic-workflows).

AI, LLMs & Agents

AI Agent Core Loop

45

j4flmao/agent-skills

Use when the user asks about the agent loop, ReAct vs plan-and-solve, re-planning, Reflexion, an agent stuck in a loop, max iterations or termination conditions. Produces a loop spec or patch with state, success predicate, caps and no-progress detection. Not for overall agent design (use ai-agent-architectures) or tool schemas (use tool-calling-principles).

AI, LLMs & Agents

Backend Caching

45

j4flmao/agent-skills

Use when the user asks about caching, adding a Redis cache in front of a query, cache-aside, write-through, cache invalidation, TTL jitter, cache stampede or Memcached. Produces a cache strategy with keys, TTLs, invalidation and code. Not for browser/HTTP caching (use frontend-browser-caching) or distributed locks (use backend-distributed-locking).

Software Development

Backend Bff Pattern

45

j4flmao/agent-skills

Use when the user asks about Backend for Frontend (BFF), a mobile vs web API layer, API aggregation or composition for one client, or a frontend-specific gateway. Produces a BFF design with aggregation, partial failure and caching. Not for federated GraphQL (use api-graphql-federation) or general API design (use backend-api-design).

Software Development

Backend Clean Architecture

45

j4flmao/agent-skills

Use when the user asks where code belongs, clean architecture, hexagonal, ports and adapters, domain vs application vs infrastructure layer, or service vs repository. Produces a layer map and dependency rules. Not for GoF pattern choice (use design-patterns) or DDD modeling (use architecture-domain-driven-design).

Software Development

Browse the most popular Claude skills, all software development skills, or write your own with the skills generator.