Talent.com
This job offer is not available in your country.
Senior Data Platform Engineer

Senior Data Platform Engineer

Black Dog Labsmumbai city, maharashtra, in
30+ days ago
Job description

Position : Senior Data Platform Engineer

Location : Remote (collaboration across time zones), India or LATAM preferred

Engagement Type : Contract (12+ months)

Language : Proficient English communication

Experience : 5+ years in Data Engineering / Backend Engineering / DevOps

About the Role

We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.

Key Responsibilities

  • Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
  • Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
  • APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
  • Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
  • Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
  • Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
  • Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
  • Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.

Required Skills & Qualifications

  • Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL).
  • Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash).
  • Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion).
  • Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background.
  • Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays.
  • Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable.
  • APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT.
  • Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards.
  • Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI.
  • Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions.
  • AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests.
  • Preferred Qualifications (Nice to Have)

  • Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations
  • Analytics experience (dim / fact modeling, BI consumption patterns)
  • Full-stack exposure (can prototype simple UI / ops views when needed)
  • Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts)
  • Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet)
  • Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.)
  • Engagement Details

  • Duration : 12+ months (extension / full-time possible)
  • Schedule : Flexible, with overlap for key meetings across time zones
  • Compensation : Competitive, based on experience
  • Mode : Remote; available for virtual collaboration and on-call windows as agreed
  • How to Apply

    Please share :

  • Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work
  • Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome
  • Links to code samples or design docs (if available and shareable)
  • Apply via LinkedIn or by sending an email to careers@blackdoglabs.io

    Create a job alert for this search

    Senior Data Engineer • mumbai city, maharashtra, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIThane, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreeMumbai
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsMumbai, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iomumbai city, maharashtra, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    MODIFIMumbai, Maharashtra, India
    Quick Apply
    MODIFI is a global FinTech company.We enable international commerce through a digital platform for B2B payments : With MODIFI, Exporters get paid instantly, while Importers have the option to pay la...Show moreLast updated: 30+ days ago
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Epergne SolutionsMumbai, Maharashtra, India
    Quick Apply
    Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show moreLast updated: 7 days ago
    • Promoted
    Platform Engineer

    Platform Engineer

    HireAlphaThane, IN
    Distributed Systems, EKS, Kubernetes, Cloud (AWS / Azure / GCP).Python, FastAPI, PostgreSQL, Terraform.We're looking for a Senior Software Engineer who can architect and build robust infrastructure sys...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Fluent HealthMumbai, Maharashtra, India
    Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family.The company will provide customers with high-quality, personalized options, cred...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadymumbai, maharashtra, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladenavi mumbai, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKalyan-Dombivli, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticsmumbai city, maharashtra, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kalyan-Dombivli, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incmumbai city, maharashtra, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivemumbai, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    MODIFI GmbHMumbai, MH, IN
    Quick Apply
    MODIFI is a global FinTech company.We enable international commerce through a digital platform for B2B payments : With MODIFI, Exporters get paid instantly, while Importers have the option to pay la...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ConfidentialMumbai
    We are hiring a Senior Data Engineer to join our team.You will be designing, building, and integrating data pipelines from diverse sources and collaborate with teams that serve the world s largest ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudMumbai, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 27 days ago
    • Promoted
    GenAI Lead Engineer (Investment Data Platforms)

    GenAI Lead Engineer (Investment Data Platforms)

    Vichara Technologiesnavi mumbai, maharashtra, in
    We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
    • Promoted
    AuxoAI - Senior Data Engineer - Databricks

    AuxoAI - Senior Data Engineer - Databricks

    AuxoAIMumbai
    Job Description : - Designing, building, and operating scalable on-premises or cloud data architecture - Analyzing bus...Show moreLast updated: 30+ days ago