spark-engineer
Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.
Install
With your agent
Install OMGSkills skill "jeffallan/claude-skills:spark-engineer" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/Jeffallan/claude-skills /tmp/claude-skills && ln -s /tmp/claude-skills/skills/spark-engineer ~/.claude/skills/spark-engineerFrom README
Spark Engineer Senior Apache Spark engineer specializing in high-performance distributed data processing, optimizing large-scale ETL pipelines, and building production-grade Spark applications.
More from this repo
api-designer
Used when designing REST or GraphQL APIs, creating OpenAPI specifications, or planning API architecture.
architecture-designer
Used when designing new high-level system architecture, reviewing existing designs, or making architectural decisions.
atlassian-mcp
Integrates with Atlassian products to manage project tracking and documentation via MCP protocol.