DataOps Engineer

Job Description

Responsible for the governance ensuring data availability, accuracy, and performance across environments as an expert Azure Data Ops with 6-8 years of experience.

Orchestrate, monitor, and automate data pipelines across Azure Data Factory, Databricks, and Synapse.

Build scalable CI / CD workflows using Azure DevOps for data deployments and version control.

Ensure data pipeline reliability through alerting, auto-restart, and SLA compliance.

Set up proactive alerts and error handling for failed or delayed pipelines.

Drive process standardization and documentation for repeatable and auditable data workflows.

Enable lineage and impact analysis across datasets to improve governance and trust.

Enforce data quality checks (DQ rules, schema validation, completeness) at ingestion and transformation stages.

Collaborate with governance teams to align with cataloging, retention, and compliance standards.

Continuously optimize data processing cost, performance, and resource utilization across environments.

Knowledge, Skills & Experience

Relevant Job Experience

Bachelor’s degree in Computer Science, Engineering, or related field (advanced degree preferred).

3–5 years of experience in data platform operations or DataOps within the Azure ecosystem.

Hands-on expertise in :

Azure Data Factory, Databricks, Synapse, and Azure DevOps.

CI / CD pipeline design for data workflows.

Python, SQL, PowerShell scripting for automation.

Data governance and observability tools.

Preferred

Familiarity with big data frameworks (Spark, Delta Lake).

Experience in a retail data environment.

Azure certifications : Azure Data Engineer Associate or DevOps Engineer Expert.

Required Leadership Skills

The position will require someone with the following :

Strong analytical and troubleshooting abilities

Communication and Collaboration

Strategic mindset to drive operational maturity and continuous improvement