Senior Data Platform Engineer
Black Dog Labstiruchirappalli, tamil nadu, in30+ days ago
Job descriptionStrong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL). Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash). Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion). Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background. Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays. Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable. APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT. Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards. Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI. Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions. AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests. Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations Analytics experience (dim / fact modeling, BI consumption patterns) Full-stack exposure (can prototype simple UI / ops views when needed) Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts) Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet) Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.) Duration : 12+ months (extension / full-time possible) Schedule : Flexible, with overlap for key meetings across time zones Compensation : Competitive, based on experience Mode : Remote; available for virtual collaboration and on-call windows as agreed Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome Links to code samples or design docs (if available and shareable)
Position : Senior Data Platform Engineer
Location : Remote (collaboration across time zones), India or LATAM preferred
Engagement Type : Contract (12+ months)
Language : Proficient English communication
Experience : 5+ years in Data Engineering / Backend Engineering / DevOps
About the Role
We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.
Key Responsibilities
- Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
- Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
- APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
- Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
- Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
- Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
- Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
- Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.
Required Skills & Qualifications
Preferred Qualifications (Nice to Have)
Engagement Details
How to Apply
Please share :
Apply via LinkedIn or by sending an email to careers@blackdoglabs.io
Create a job alert for this search
Senior Data Engineer • tiruchirappalli, tamil nadu, in
Related jobs
- Promoted
Senior Data Engineer
Futran SolutionsTiruchirappalli, IN We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.
The ideal candidate will have a proven track record of designing, imp...Show moreLast updated: 17 days ago
- Promoted
- New!
Senior Azure Databricks Engineer
Newscape ConsultingTiruchirappalli, IN We’re Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer.Immediate Joiners / Notice Period ≤ 15 Days.
Only local Pune candidates may apply.L2 interviews will be conducted....Show moreLast updated: 1 hour ago
- Promoted
Data Platform Engineer – B2B Intelligence Systems (Life Sciences)
BioSalesTiruchirappalli, IN Data Platform Engineer – B2B Intelligence Systems (Life Sciences).BioSales partners with contract research organizations (CROs) and life sciences companies to provide comprehensive sales and go-to-...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Insight GlobalTiruchirappalli, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
GMGTiruchirappalli, IN GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show moreLast updated: 1 hour ago
- Promoted
- New!
Senior Data Engineer
FinastraTiruchirappalli, IN Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our business units and 8000+ custome...Show moreLast updated: 1 hour ago
- Promoted
- New!
GCP Senior Data Engineers
Tata Consultancy ServicesTiruchirappalli, IN TCS presents an excellent Opportunity For "GCP Senior Data Engineers" Role.Chennai, Kochi, Bangalore, Hyderabad, Pune, Kolkata, Delhi & Bhubaneswar.
Data Integration, orchestration mechanism, abilit...Show moreLast updated: 1 hour ago
- Promoted
- New!
Data Engineer
Whitefield CareersTiruchirappalli, IN Passionate about data, analytics and automation.Experience cleaning and modeling large quantities of raw, disorganized data (we use dbt).
Experience with a variety of data sources (structured and un...Show moreLast updated: 1 hour ago
- Promoted
- New!
Senior GCP Data Engineer
People Prime WorldwideTiruchirappalli, IN Senior Data Engineer (L4) – Python & GCP.We’re looking for an experienced.You’ll work with various GCP services, manage data flows, ensure data quality, and support analytics and data science teams...Show moreLast updated: 1 hour ago
- Promoted
Senior Data Engineer
SAIVA AITiruchirappalli, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
RPA BluePrism Senior Engineer
LuxoftTiruchirappalli, IN The Blue Prism solution provides a platform for resources from the business operations or IT teams to deliver self-service process automations on an IT supported, secure and resilient infrastructur...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
Live ConnectionsTiruchirappalli, IN Databricks Engineer, Azure Databricks, SQL, Pyspark.Databricks Engineer, Azure Databricks, SQL.Job Title : Senior Data Engineer.
Design, build, and maintain scalable data pipelines and ETL processes....Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RecroTiruchirappalli, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
HealthyMe AITiruchirappalli, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
Ironbook AITiruchirappalli, IN Data Engineer (Microsoft Fabric & Azure) - Relocation to KL.The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures...Show moreLast updated: 1 hour ago
- Promoted
Data Engineer
DigitalzoneTiruchirappalli, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladetiruchirappalli, tamil nadu, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
IntelliasTiruchirappalli, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 6 days ago