Senior Data Platform Engineer

Black Dog Labstumakuru, karnataka, in

30+ days ago

Job description

Position : Senior Data Platform Engineer

Location : Remote (collaboration across time zones), India or LATAM preferred

Engagement Type : Contract (12+ months)

Language : Proficient English communication

Experience : 5+ years in Data Engineering / Backend Engineering / DevOps

About the Role

We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.

Key Responsibilities

Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.

Required Skills & Qualifications

Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL).

Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash).

Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion).

Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background.

Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays.

Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable.

APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT.

Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards.

Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI.

Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions.

AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests.

Preferred Qualifications (Nice to Have)

Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations

Analytics experience (dim / fact modeling, BI consumption patterns)

Full-stack exposure (can prototype simple UI / ops views when needed)

Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts)

Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet)

Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.)

Engagement Details

Duration : 12+ months (extension / full-time possible)

Schedule : Flexible, with overlap for key meetings across time zones

Compensation : Competitive, based on experience

Mode : Remote; available for virtual collaboration and on-call windows as agreed

How to Apply

Please share :

Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work

Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome

Links to code samples or design docs (if available and shareable)

Apply via LinkedIn or by sending an email to careers@blackdoglabs.io

Create a job alert for this search

Senior Data Engineer • tumakuru, karnataka, in

Related jobs

Promoted

Data Engineer

RecroTumkur, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Senior Platform Engineer

Vista Applied Solutions Group IncTumkur, IN

Client is looking for Senior Platform Engineer and this is remote position from India.Design, build, and manage scalable Kubernetes platforms and automation using Terraform.Support GitOps workflows...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

IntelliasTumkur, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 3 days ago

Promoted

Data Engineer – Azure & AWS

Yoda TechTumkur, IN

We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 12 days ago

Promoted

Data Engineer

DigitalzoneTumkur, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 3 days ago

Promoted

Data Engineer

IntraEdgeTumkur, IN

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsTumkur, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Mastektumakuru, karnataka, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AITumkur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Insight GlobalTumkur, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer II

ClearDemandTumkur, IN

Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer / Architect ( Full-time at a Fortune 500 tech MNC )

HARPTumkur, IN

Mandatory skills- Python+ Azure Databricks + SQL (all are mandatory skills).Provide architectural guidance,.Data Engineering solutions (mainly on Azure). Evaluate and onboard new features(in Databri...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

Guidanz IncTumkur, IN

BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

HealthyMe AITumkur, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Integration Engineer

IndsafriTumkur, IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 24 days ago

Promoted

Senior Data Engineer with AWS_ Exp : 6+ Years

Atyeti IncTumkur, IN

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 3 days ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 CompanyTumkur, IN

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago

Promoted

Data Platform Engineer – B2B Intelligence Systems (Life Sciences)

BioSalesTumkur, IN

Data Platform Engineer – B2B Intelligence Systems (Life Sciences).BioSales partners with contract research organizations (CROs) and life sciences companies to provide comprehensive sales and go-to-...Show moreLast updated: 3 days ago