Talent.com
This job offer is not available in your country.
Senior Data Platform Engineer

Senior Data Platform Engineer

Black Dog LabsTiruppur, IN
30+ days ago
Job description

Position : Senior Data Platform Engineer

Location : Remote (collaboration across time zones), India or LATAM preferred

Engagement Type : Contract (12+ months)

Language : Proficient English communication

Experience : 5+ years in Data Engineering / Backend Engineering / DevOps

About the Role

We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.

Key Responsibilities

  • Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
  • Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
  • APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
  • Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
  • Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
  • Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
  • Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
  • Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.

Required Skills & Qualifications

  • Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL).
  • Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash).
  • Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion).
  • Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background.
  • Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays.
  • Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable.
  • APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT.
  • Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards.
  • Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI.
  • Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions.
  • AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests.

    • Preferred Qualifications (Nice to Have)

  • Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations
  • Analytics experience (dim / fact modeling, BI consumption patterns)
  • Full-stack exposure (can prototype simple UI / ops views when needed)
  • Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts)
  • Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet)
  • Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.)

    • Engagement Details

  • Duration : 12+ months (extension / full-time possible)
  • Schedule : Flexible, with overlap for key meetings across time zones
  • Compensation : Competitive, based on experience
  • Mode : Remote; available for virtual collaboration and on-call windows as agreed

    • How to Apply

    Please share :

  • Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work
  • Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome
  • Links to code samples or design docs (if available and shareable)

    • Apply via or by sending an email to careers@blackdoglabs.io

    Create a job alert for this search

    Senior Data Engineer • Tiruppur, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIErode, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 9 days ago
    • Promoted
    snowflake Cloud Database Administrator

    snowflake Cloud Database Administrator

    Leading automobile GCCcoimbatore, tamil nadu, in
    Cloud Platform Expertise : Familiarity with leading cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, and Snowflake is essential. Understanding their database offerings, such as AWS...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudErode, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 21 days ago
    • Promoted
    DevOps Analytics Engineer

    DevOps Analytics Engineer

    EXLcoimbatore, tamil nadu, in
    Design, develop, and maintain DevOps analytics frameworks and dashboards to monitor CI / CD pipelines, system performance, and deployment metrics. Analyze large volumes of telemetry and log data from ...Show moreLast updated: 9 days ago
    • Promoted
    Senior Scala Developer

    Senior Scala Developer

    ACL Digitalerode, tamil nadu, in
    ACL Digital is actively hiring for experienced.Job Requirement - Senior Java Developer.Preferred Qualification : 5-10 Years Experience (Remote). Computer Science or a related technical field.Customer...Show moreLast updated: 9 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    DNA Technology ServicesCoimbatore, IN
    We are looking for an experienced.The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS / Azure), and modern data engineering practices, with the ability to design and imp...Show moreLast updated: 14 days ago
    • Promoted
    Cloud Database Administrator

    Cloud Database Administrator

    ZarthiCoimbatore, Tamil Nadu, India
    Job Description : Cloud Database Administrator (DBA).Zarthi is a technology service provider that acts as a catalyst for businesses. We have established relationships with companies and organizations...Show moreLast updated: 1 day ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsCoimbatore, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 20 days ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesErode, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Full stack Developer(Dot net+ Angular +SQL)

    Senior Full stack Developer(Dot net+ Angular +SQL)

    Programmers.ioTiruppur, IN
    We are looking for a passionate and experienced Senior.NET Core 6, SQL Server, and Selenium-based test automation.The ideal candidate will be responsible for designing, developing, and maintaining ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Mongo DBA

    Mongo DBA

    Tata Consultancy ServicesErode, IN
    Location : Gurgaon, Noida, Bangalore, Bhubaneswar, Hyderabad, kochi, Pune.As an individual contributor, will be involved with Development and Operations of a framework that caters to automating Mon...Show moreLast updated: 18 hours ago
    • Promoted
    Scala Developer

    Scala Developer

    ACL DigitalErode, IN
    We are hiring for Scala developer.This is completely remote opportunity.If anyone interested can share resume at ayushi.Scala Developer (Exp- 5 to 8 years). Strong design & programming skills in.Log...Show moreLast updated: 14 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy Servicescoimbatore, tamil nadu, in
    Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required. Experience in transforming the data using A...Show moreLast updated: 9 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsCoimbatore, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 23 days ago
    • Promoted
    SQL Database Administrator

    SQL Database Administrator

    MaxVal Group, Inc.Coimbatore, Tamil Nadu, India
    MaxVal started as an IP services company in 2004, with a keen focus on efficiency, cost-effectiveness, and continuous improvement through metrics-based processes. Our focus on these core values led ...Show moreLast updated: 7 days ago
    • Promoted
    Scala Developer

    Scala Developer

    Tata Consultancy ServicesErode, IN
    Scala - Microservice Developer.Tata Consultancy Services is an IT services, consulting and business solutions organization that has been partnering with many of the world’s largest businesses in th...Show moreLast updated: 14 days ago
    • Promoted
    Data - Solution Consultant

    Data - Solution Consultant

    Tata Consultancy Serviceserode, tamil nadu, in
    Required Experience : 8 - 15 years.Databricks (including PySpark, Delta Lake, MLflow).Snowflake (data warehousing, performance tuning, data sharing). Cloud platforms : Azure, AWS, GCP.Legacy system mi...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incErode, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    LemongrassCoimbatore, IN
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticserode, tamil nadu, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago