Build custom Python data sources for Apache Spark using the PySpark DataSource API — batch and streaming readers/writers for external systems. Use this skill whenever someone wants to connect Spark to an external system (database, API, message queue, custom protocol), build a Spark connector or plugin in Python, implement a DataSourceReader or DataSourceWriter, pull data from or push data to a…
Install
npx skills add databricks/databricks-agent-skills --skill spark-python-data-sourcenpx skills add databricks/databricks-agent-skills --skill spark-python-data-source -a claude-code -gnpx skills add databricks/databricks-agent-skills --skill spark-python-data-source -a codex -ggemini skills install https://github.com/databricks/databricks-agent-skills.git --path experimental/spark-python-data-sourcegh skill install databricks/databricks-agent-skills spark-python-data-sourcegit clone --depth 1 https://github.com/databricks/databricks-agent-skills /tmp/databricks__databricks-agent-skills
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/databricks__databricks-agent-skills/experimental/spark-python-data-source ~/.claude/skills/spark-python-data-source # Claude Code
cp -R /tmp/databricks__databricks-agent-skills/experimental/spark-python-data-source ~/.agents/skills/spark-python-data-source # Codex, Cursor, Gemini CLI, Copilot, OpenCode