Talent.com
Senior Data Platform Engineer

Senior Data Platform Engineer

Black Dog LabsMoradabad, IN
30+ days ago
Job description

Position : Senior Data Platform Engineer

Location : Remote (collaboration across time zones), India or LATAM preferred

Engagement Type : Contract (12+ months)

Language : Proficient English communication

Experience : 5+ years in Data Engineering / Backend Engineering / DevOps

About the Role

We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.

Key Responsibilities

  • Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
  • Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
  • APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
  • Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
  • Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
  • Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
  • Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
  • Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.

Required Skills & Qualifications

  • Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL).
  • Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash).
  • Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion).
  • Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background.
  • Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays.
  • Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable.
  • APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT.
  • Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards.
  • Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI.
  • Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions.
  • AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests.
  • Preferred Qualifications (Nice to Have)

  • Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations
  • Analytics experience (dim / fact modeling, BI consumption patterns)
  • Full-stack exposure (can prototype simple UI / ops views when needed)
  • Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts)
  • Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet)
  • Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.)
  • Engagement Details

  • Duration : 12+ months (extension / full-time possible)
  • Schedule : Flexible, with overlap for key meetings across time zones
  • Compensation : Competitive, based on experience
  • Mode : Remote; available for virtual collaboration and on-call windows as agreed
  • How to Apply

    Please share :

  • Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work
  • Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome
  • Links to code samples or design docs (if available and shareable)
  • Apply via or by sending an email to careers@blackdoglabs.io

    Create a job alert for this search

    Senior Data Engineer • Moradabad, IN

    Related jobs
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Moradabad, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMoradabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasMoradabad, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReadyMoradabad, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiMoradabad, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Senior Data Engineer-IDMC

    Senior Data Engineer-IDMC

    Digivance SolutionsMoradabad, IN
    Data Ingestion, IDMC, Big Data Technology.We are seeking a skilled Data Engineer with strong experience in data ingestion, pipeline development, and working with cloud and big data technologies.The...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeMoradabad, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderMoradabad, IN
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 12 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersMoradabad, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live ConnectionsMoradabad, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI SolutionsMoradabad, IN
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceMoradabad, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdMoradabad, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroMoradabad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneMoradabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Comoradabad, uttar pradesh, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.AiMoradabad, IN
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 23 hours ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR TechMoradabad, IN
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 11 days ago