Comprehensive guide to Spark Structured Streaming for production workloads. Use when building streaming pipelines, working with Kafka ingestion, implementing Real-Time Mode (RTM), configuring triggers (processingTime, availableNow), handling stateful operations with watermarks, optimizing checkpoints, performing stream-stream or stream-static joins, writing to multiple sinks, or tuning streaming…
Install
npx skills add databricks/databricks-agent-skills --skill databricks-spark-structured-streamingnpx skills add databricks/databricks-agent-skills --skill databricks-spark-structured-streaming -a claude-code -gnpx skills add databricks/databricks-agent-skills --skill databricks-spark-structured-streaming -a codex -ggemini skills install https://github.com/databricks/databricks-agent-skills.git --path skills/databricks-spark-structured-streaminggh skill install databricks/databricks-agent-skills databricks-spark-structured-streaminggit clone --depth 1 https://github.com/databricks/databricks-agent-skills /tmp/databricks__databricks-agent-skills
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/databricks__databricks-agent-skills/skills/databricks-spark-structured-streaming ~/.claude/skills/databricks-spark-structured-streaming # Claude Code
cp -R /tmp/databricks__databricks-agent-skills/skills/databricks-spark-structured-streaming ~/.agents/skills/databricks-spark-structured-streaming # Codex, Cursor, Gemini CLI, Copilot, OpenCode