This job offer is not available in your country.
Senior Data Platform Engineer
Black Dog LabsTiruchirappalli, IN30+ days ago
Job descriptionStrong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL). Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash). Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion). Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background. Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays. Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable. APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT. Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards. Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI. Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions. AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests. Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations Analytics experience (dim / fact modeling, BI consumption patterns) Full-stack exposure (can prototype simple UI / ops views when needed) Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts) Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet) Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.) Duration : 12+ months (extension / full-time possible) Schedule : Flexible, with overlap for key meetings across time zones Compensation : Competitive, based on experience Mode : Remote; available for virtual collaboration and on-call windows as agreed Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome Links to code samples or design docs (if available and shareable)
Position : Senior Data Platform Engineer
Location : Remote (collaboration across time zones), India or LATAM preferred
Engagement Type : Contract (12+ months)
Language : Proficient English communication
Experience : 5+ years in Data Engineering / Backend Engineering / DevOps
About the Role
We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.
Key Responsibilities
- Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
- Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
- APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
- Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
- Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
- Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
- Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
- Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.
Required Skills & Qualifications
Preferred Qualifications (Nice to Have)
Engagement Details
How to Apply
Please share :
Apply via or by sending an email to careers@blackdoglabs.io
Create a job alert for this search
Senior Data Engineer • Tiruchirappalli, IN
Related jobs
- Promoted
snowflake Cloud Database Administrator
Leading automobile GCCtiruchirappalli, tamil nadu, in Cloud Platform Expertise : Familiarity with leading cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, and Snowflake is essential.
Understanding their database offerings, such as AWS...Show moreLast updated: 30+ days ago
- Promoted
Senior Full stack Developer(Dot net+ Angular +SQL)
Programmers.ioTiruchirappalli, IN We are looking for a passionate and experienced Senior.NET Core 6, SQL Server, and Selenium-based test automation.The ideal candidate will be responsible for designing, developing, and maintaining ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Role
100x.incTiruchirappalli, IN At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
- Promoted
Salesforce Data Cloud Architect
RialtesTiruchirappalli, IN Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of.
Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
- Promoted
- New!
Forward Deployed Data Analyst (Contract-to-Hire)
Fig LabsTiruchirappalli, IN Analytics Agent—an AI agentic analyst that monitors business data 24 / 7, explains what changed and why, and recommends next-best actions.
We help organizations move from static dashboards to.Snowflak...Show moreLast updated: 9 hours ago
- Promoted
- New!
MS Dynamics 365 Developer
Sataware TechnologiesTiruchirappalli, IN This is a full-time remote role for an MS Dynamics 365 Developer.The developer will be responsible for designing, developing, and implementing MS Dynamics 365 solutions to meet business needs.Key d...Show moreLast updated: 9 hours ago
- Promoted
- New!
Python Developer
MegovationTamil Nadu, India, India We are specifically looking to hire talented individuals from Tier 2 and Tier 3 cities for this opportunity.We build big data products, application development, and ERP implementations on the publi...Show moreLast updated: 9 hours ago
- Promoted
Databricks Engineer
Tata Consultancy Servicestiruchirappalli, tamil nadu, in Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required.
Experience in transforming the data using A...Show moreLast updated: 8 days ago
- Promoted
- New!
Data Integration Reliability and Devops Engineer
RapidBrainsTiruchirappalli, IN Data Integration Reliability & DevOps Engineer.Normal IST (with 2–3 hours overlap as per client need).We are seeking a highly skilled Data Integration Reliability & DevOps Engineer to join our team...Show moreLast updated: 9 hours ago
- Promoted
GCP Data Engineer
TEKsystemsTiruchirappalli, IN We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant).
Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 23 days ago
- Promoted
Backend and Data Pipeline Engineer
JRD SystemsTiruchirappalli, IN Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 19 days ago
- Promoted
- New!
System Administrator (Windows, AWS, SQL)
stackwayTiruchirappalli, IN System Administrator | 3+ Years Experience | Windows Server, AWS, SQL.At stackway, we believe software development is best done in small, highly functional teams with good collaboration, cooperatio...Show moreLast updated: 9 hours ago
- Promoted
Data Platform Engineer
Intuitive.CloudTiruchirappalli, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 20 days ago
- Promoted
Cloud Database Administrator
Zarthitiruchirappalli, tamil nadu, in Job Description : Cloud Database Administrator (DBA).Zarthi is a technology service provider that acts as a catalyst for businesses.
We have established relationships with companies and organizations...Show moreLast updated: 29 days ago
- Promoted
- New!
GCP Data Engineer
EXLTiruchirappalli, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 9 hours ago
- Promoted
- New!
SAP WM & EWM (Data Migration)
brabersTiruchirappalli, IN The SAP EWM / WM Data Migration serves as the global focal point for warehouse-related data objects during migration projects.
This role ensures accurate collection, validation, and migration of EWM / W...Show moreLast updated: 9 hours ago
- Promoted
- New!
RDBMS Database Consultant
GC Technologies Pvt LtdTiruchirappalli, IN Banking domain Exp is Mandatory.The Hiring Agency will provide the Visa, Accommodation, Allowance for Transportation and Food.
The Min Period Of Contract will be 6 Months - with Extension for every ...Show moreLast updated: 9 hours ago
- Promoted
- New!
Mongo DBA
Tata Consultancy ServicesTiruchirappalli, IN Location : Gurgaon, Noida, Bangalore, Bhubaneswar, Hyderabad, kochi, Pune.As an individual contributor, will be involved with Development and Operations of a framework that caters to automating Mon...Show moreLast updated: 9 hours ago
- Promoted
Senior Data Engineer
The Mastermind GroupTiruchirappalli, IN Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG).
Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
- Promoted
- New!
Kafka Architect (Freelancing)
ValueLabsTiruchirappalli, IN Kafka Architect (Kafka Event Hub Stream).The Kafka Architect will be a senior architect / engineer responsible for designing, implementing, and advising on large-scale Confluent Kafka platforms.This ...Show moreLast updated: 9 hours ago