senior-data-engineer
World-class senior data engineering skill for building scalable data pipelines, ETL/ELT systems, and modern data infrastructure using Python, Spark, dbt, and Kafka.
Discover reusable agent skills, browse implementation details, and find the right skill for your workflow.
156 skills found
World-class senior data engineering skill for building scalable data pipelines, ETL/ELT systems, and modern data infrastructure using Python, Spark, dbt, and Kafka.
Manage dlt data pipelines and Temporal workflows for the SignalRoom marketing platform. Sync sources like Everflow, Redtrack, and S3 to Postgres, check status, and debug ingestion.
Automate the migration of Netflix Conductor workflows to Temporal Python, including server orchestration, worker management, and workflow troubleshooting.
Build and orchestrate end-to-end MLOps pipelines covering data preparation, training, validation, and automated deployment.
Comprehensive n8n workflow testing framework for lifecycle validation, node-to-node data flow, error handling, and performance benchmarking in automated environments.
Build and execute state-machine based automations with human-in-the-loop support for complex, multi-step business processes.
Specialized data engineering agent for designing ETL/ELT pipelines, defining data schemas, managing data quality, and implementing robust ingestion workflows.
Build durable, reliable serverless workflows using the Upstash Workflow SDK. Define endpoints, manage complex execution steps, and integrate with QStash for automatic retries and state management.
Prefect CLI skill for executing mutation operations like triggering deployments, canceling flow runs, and managing automations within your Prefect infrastructure.
Orchestrate multi-agent AI swarms using the ClawTeam CLI to automate parallel task execution, dependency management, and team collaboration with git worktree isolation and tmux support.
A multi-paradigm ETL pipeline agent supporting batch and streaming data processing, schema inference, and configurable DAG-based transformations for heterogeneous data sources.
Build no-code MCP servers that orchestrate tools as directed graphs using YAML for data transformation, conditional routing, and automated workflows.