Senior Data Platform Engineer
Black Dog Labsmohali, India11 days ago
Job descriptionStrong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL). Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash). Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion). Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background. Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays. Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable. APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT. Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards. Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI. Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions. AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests. Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations Analytics experience (dim / fact modeling, BI consumption patterns) Full-stack exposure (can prototype simple UI / ops views when needed) Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts) Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet) Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.) Duration : 12+ months (extension / full-time possible) Schedule : Flexible, with overlap for key meetings across time zones Compensation : Competitive, based on experience Mode : Remote; available for virtual collaboration and on-call windows as agreed Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome Links to code samples or design docs (if available and shareable)
Position : Senior Data Platform Engineer
Location : Remote (collaboration across time zones), India or LATAM preferred
Engagement Type : Contract (12+ months)
Language : Proficient English communication
Experience : 5+ years in Data Engineering / Backend Engineering / DevOps
About the Role
We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.
Key Responsibilities
- Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
- Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
- APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
- Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
- Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
- Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
- Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
- Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.
Required Skills & Qualifications
Preferred Qualifications (Nice to Have)
Engagement Details
How to Apply
Please share :
Apply via LinkedIn or by sending an email to
Create a job alert for this search
Senior Data Engineer • mohali, India
Related jobs
)
- Promoted
Senior Data Integration Engineer
Indsafribaddi, himachal pradesh, in Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer
USEReadybaddi, himachal pradesh, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 28 days ago
- Promoted
GCP Data Engineer
JRD Systemspanchkula, haryana, in Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources.
Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 2 days ago
- Promoted
Data streaming Engineer
Xebiapanchkula, haryana, in We’re seeking a hands-on engineer with deep expertise in Confluent Cloud Kafka and Apache Flink.Candidate should be able to design, build, and operate real-time streaming pipelines and analytics, w...Show moreLast updated: 7 days ago
- Promoted
Senior Backend Engineer - AI-Augmented Development
Trueypanchkula, haryana, in Senior Backend Engineer - AI-Augmented Development 🚀.Remote-first | Experience : 5+ years | Type : Full-time.C2C with your own LLC considered.
.We're building the next generation of AI-powered web ap...Show moreLast updated: 6 days ago
- Promoted
AI / ML & Data Engineer
Mindfire Solutionspanchkula, haryana, in We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 9 days ago
- Promoted
Senior Backend Engineer
Blossom Socialpanchkula, haryana, in Blossom Social is building the future of social investing.Our platform empowers retail investors by combining the best of social networks with investing tools—enabling users to connect, learn, and ...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
Response Informaticsbaddi, himachal pradesh, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 28 days ago
- Promoted
Data Engineer
Veraxionpanchkula, haryana, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
HealthyMe AIbaddi, India We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 11 days ago
- Promoted
Sr Data Engineer
Mitchell Martin Inc.baddi, himachal pradesh, in Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 9 days ago
- Promoted
Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)
Sky Systems, Inc. (SkySys)baddi, himachal pradesh, in Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
TrantorChandigarh, India, India We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS.
Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 18 days ago
- Promoted
Platform Engineer – Java / BigData / Kubernetes
Syntasapanchkula, haryana, in Platform Engineer – Java / BigData / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportunity to contribute t...Show moreLast updated: 6 days ago
- Promoted
Senior Azure Data Engineer (Architect) - Pan India
Genpactpanchkula, haryana, in We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills.
The ideal candidate will have experience and a proven track re...Show moreLast updated: 10 days ago
- Promoted
Platform Engineer – Python / Databricks / Notebooks / Kubernetes
Syntasabaddi, himachal pradesh, in Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportuni...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer
Saransh Incbaddi, India Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 11 days ago
- Promoted
Data Engineer with Snowflake Experience- Contract
Gravity Infosolutions, Inc.panchkula, haryana, in Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical.
Most data to be migrated is already in Snowflake...Show moreLast updated: 7 days ago