Software Development
Spark Engineer
Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.
- Publisher / source
- Jeffallan/claude-skills (found on skills.sh, an awesome list, the CSV list)
- Upstream record
- Jeffallan/claude-skills
- Version
- Version 3
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-02
- Content fingerprint
95c0810537a96b90668b6c152106bbae81b7a8243f3b3ebf2db3a5f95b5e75dd