Senior Data Platform Engineer
Black Dog LabsMohali, Republic Of India, IN17 days ago
Job descriptionData pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; APIs & integration : Build or collaborate on APIs for data access and updates; design request / responsecontracts; Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable. Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.G., Postgres, SQL Server, MySQL). Python for data work and services; Terraform and IaC fundamentals; Cloud : Azure preferred (e.G., storage, compute, identity, monitoring). If not Azure, very strong AWS background. Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays. Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT. Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards. Testing mindset : Habit of writing tests for code and SQL; Communication : Clear, concise writing and verbal comms; AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests. Regulatory / compliance awareness (e.G., data protection or public-sector standards) and how it impacts design / operations Analytics experience (dim / fact modeling, BI consumption patterns) Full-stack exposure (can prototype simple UI / ops views when needed) Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts) Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.G., Parquet) Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.) Duration : 12+ months (extension / full-time possible) Schedule : Flexible, with overlap for key meetings across time zones Compensation : Competitive, based on experience Mode : Remote; Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome Links to code samples or design docs (if available and shareable)
Position : Senior Data Platform Engineer
Location : Remote (collaboration across time zones), India or LATAM preferred
Engagement Type : Contract (12+ months)
Language : Proficient English communication
Experience : 5+ years in Data Engineering / Backend Engineering / DevOps
About the Role
- We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs;
- automate environments with Terraform;
- instrument observability;
- and write tests to keepthings reliable. Azure experience is preferred;
strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.G., Claude Code) effectively without relying on them exclusively.
Key Responsibilities
handle schema evolutionand failures gracefully.
tune SQL for performance.
handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
write solid shell scripts for glue / ops tasks.
track SLOs and drive root-cause prevention.
collaborate with the team on compliance requirements.
work closely with product / engineering / analytics.
Required Skills & Qualifications
comfortable with shell scripting (bash preferred, powershell proficiency if not bash).
CI / CD experience (version control workflows, automated tests, environment promotion).
Airflow, Dagster, or similar also acceptable.
comfortable with fixtures / test data and CI.
comfortable in async chat and live sessions.
Preferred Qualifications (Nice to Have)
Engagement Details
available for virtual collaboration and on-call windows as agreed
How to Apply
Please share :
Apply via LinkedIn or by sending an email to careers@blackdoglabs.io
Create a job alert for this search
Senior Data Engineer • Mohali, Republic Of India, IN
Related jobs
NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 23 days ago
For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer.
The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer
Incept Labspanchkula, haryana, in Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer II
ClearDemandpanchkula, haryana, in Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer-Remote
Cimpress Indiabaddi, himachal pradesh, inRemote
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incpanchkula, haryana, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
Straivepanchkula, haryana, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladepanchkula, haryana, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Mastekpanchkula, haryana, in We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Intelliaspanchkula, haryana, in Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 3 days ago
- Promoted
Data Engineer – Azure & AWS
Yoda Techpanchkula, haryana, in We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD
All European Careerspanchkula, haryana, inRemote
- Promoted
Senior Data Engineer
Guidanz Incbaddi, himachal pradesh, in BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer
SAIVA AIpanchkula, haryana, in We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
HealthyMe AIbaddi, himachal pradesh, in We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
- Promoted
Senior Azure Data Engineer
Programmers.iobaddi, himachal pradesh, in Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti Incpanchkula, haryana, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Lead Data Engineer
Cimpresspanchkula, haryana, in Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 3 days ago
- Promoted
Snowflake Data Engineer
Newpage Solutionspanchkula, haryana, in Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives.
We partner with life sciences organizations—including p...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
Insight Globalbaddi, himachal pradesh, in GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago