Talent.com
This job offer is not available in your country.
Senior Data Platform Engineer

Senior Data Platform Engineer

Black Dog LabsDelhi, IN
30+ days ago
Job description

Position : Senior Data Platform Engineer

Location : Remote (collaboration across time zones), India or LATAM preferred

Engagement Type : Contract (12+ months)

Language : Proficient English communication

Experience : 5+ years in Data Engineering / Backend Engineering / DevOps

About the Role

We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.

Key Responsibilities

  • Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
  • Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
  • APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
  • Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
  • Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
  • Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
  • Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
  • Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.

Required Skills & Qualifications

  • Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL).
  • Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash).
  • Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion).
  • Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background.
  • Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays.
  • Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable.
  • APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT.
  • Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards.
  • Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI.
  • Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions.
  • AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests.
  • Preferred Qualifications (Nice to Have)

  • Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations
  • Analytics experience (dim / fact modeling, BI consumption patterns)
  • Full-stack exposure (can prototype simple UI / ops views when needed)
  • Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts)
  • Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet)
  • Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.)
  • Engagement Details

  • Duration : 12+ months (extension / full-time possible)
  • Schedule : Flexible, with overlap for key meetings across time zones
  • Compensation : Competitive, based on experience
  • Mode : Remote; available for virtual collaboration and on-call windows as agreed
  • How to Apply

    Please share :

  • Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work
  • Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome
  • Links to code samples or design docs (if available and shareable)
  • Apply via or by sending an email to careers@blackdoglabs.io

    Create a job alert for this search

    Senior Data Engineer • Delhi, IN

    Related jobs
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsGhaziabad, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    SAP WM & EWM (Data Migration)

    SAP WM & EWM (Data Migration)

    brabersDelhi, IN
    The SAP EWM / WM Data Migration serves as the global focal point for warehouse-related data objects during migration projects. This role ensures accurate collection, validation, and migration of EWM / W...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Mastermind GroupDelhi, IN
    Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Ops Engineer

    Data Ops Engineer

    Tanla Platforms LimitedDelhi, India
    Job Scope : Responsible for orchestrating, monitoring, and maintaining reliable and scalable data pipelines across Tanla’s CPaaS ecosystem. Ensure observability, reliability, and data quality across ...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    MS Dynamics 365 Developer

    MS Dynamics 365 Developer

    Sataware TechnologiesDelhi, IN
    This is a full-time remote role for an MS Dynamics 365 Developer.The developer will be responsible for designing, developing, and implementing MS Dynamics 365 solutions to meet business needs.Key d...Show moreLast updated: 10 hours ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy ServicesNoida, Uttar Pradesh, India
    Location : Hyd, Noida, Chennai, Mumbai.Working on a scrum team as a full stack engineer.Design and develop reusable software modules that meet customer requirements while upholding high standards of...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Data Integration Reliability and Devops Engineer

    Data Integration Reliability and Devops Engineer

    RapidBrainsGhaziabad, IN
    Data Integration Reliability & DevOps Engineer.Normal IST (with 2–3 hours overlap as per client need).We are seeking a highly skilled Data Integration Reliability & DevOps Engineer to join our team...Show moreLast updated: 10 hours ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incDelhi, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    GCP Data engineer

    GCP Data engineer

    LTIMindtreeDelhi, Delhi, India
    We’re Hiring : GCP Data Engineer Location : Gurugram Notice Period : Up to 30 Days Experience : 5+ Years Interested candidates can share their CVs at : Neha. We are looking for a skilled GCP Data E...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    EXLDelhi, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy ServicesDelhi, India, India
    Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Mandatory to have knowledge of Big Data A...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainDelhi, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Tableau Developer - Contract

    Senior Tableau Developer - Contract

    Korn FerryDelhi, IN
    Korn Ferry is a global organizational consulting firm.We help clients synchronize strategy and talent to drive superior performance. Korn Ferry works with organizations to design their structures, r...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyDelhi, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Full Stack SDE with Data Engineering for Analytics

    Senior Full Stack SDE with Data Engineering for Analytics

    TruckmentumDelhi, IN
    Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    2892- Databricks Engineer

    2892- Databricks Engineer

    EXLDelhi, India
    About the Role We are seeking a highly skilled.The ideal candidate will have strong expertise in designing, developing, and optimizing large-scale data pipelines and solutions using Databricks, Spa...Show moreLast updated: 3 hours ago
    • Promoted
    snowflake Cloud Database Administrator

    snowflake Cloud Database Administrator

    Leading automobile GCCDelhi, India
    Cloud Platform Expertise : Familiarity with leading cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, and Snowflake is essential. Understanding their database offerings, such as AWS...Show moreLast updated: 6 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsDelhi, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 19 days ago
    • Promoted
    Backend Engineer — Data

    Backend Engineer — Data

    Branch InternationalDelhi, IN
    Imagine a world where every person has improved access to financial services.People could start new businesses, pay for their children’s education, cover their emergency medical bills – the possibi...Show moreLast updated: 30+ days ago