Senior Data Platform Engineer
Black Dog Labsbangalore district, karnataka, in30+ days ago
Job descriptionStrong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.g., Postgres, SQL Server, MySQL). Python for data work and services; comfortable with shell scripting (bash preferred, powershell proficiency if not bash). Terraform and IaC fundamentals; CI / CD experience (version control workflows, automated tests, environment promotion). Cloud : Azure preferred (e.g., storage, compute, identity, monitoring). If not Azure, very strong AWS background. Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays. Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); Airflow, Dagster, or similar also acceptable. APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT. Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards. Testing mindset : Habit of writing tests for code and SQL; comfortable with fixtures / test data and CI. Communication : Clear, concise writing and verbal comms; comfortable in async chat and live sessions. AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests. Regulatory / compliance awareness (e.g., data protection or public-sector standards) and how it impacts design / operations Analytics experience (dim / fact modeling, BI consumption patterns) Full-stack exposure (can prototype simple UI / ops views when needed) Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts) Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.g., Parquet) Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.) Duration : 12+ months (extension / full-time possible) Schedule : Flexible, with overlap for key meetings across time zones Compensation : Competitive, based on experience Mode : Remote; available for virtual collaboration and on-call windows as agreed Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome Links to code samples or design docs (if available and shareable)
Position : Senior Data Platform Engineer
Location : Remote (collaboration across time zones), India or LATAM preferred
Engagement Type : Contract (12+ months)
Language : Proficient English communication
Experience : 5+ years in Data Engineering / Backend Engineering / DevOps
About the Role
We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs; automate environments with Terraform; instrument observability; and write tests to keep things reliable. Azure experience is preferred; strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.g., Claude Code) effectively without relying on them exclusively.
Key Responsibilities
- Data pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; handle schema evolution and failures gracefully.
- Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; tune SQL for performance.
- APIs & integration : Build or collaborate on APIs for data access and updates; design request / response contracts; handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
- Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; write solid shell scripts for glue / ops tasks.
- Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; track SLOs and drive root-cause prevention.
- Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; collaborate with the team on compliance requirements.
- Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable.
- Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); work closely with product / engineering / analytics.
Required Skills & Qualifications
Preferred Qualifications (Nice to Have)
Engagement Details
How to Apply
Please share :
Apply via LinkedIn or by sending an email to careers@blackdoglabs.io
Create a job alert for this search
Senior Data Engineer • bangalore district, karnataka, in
Related jobs
Must be proficient in the major languages such as Scala, Spark, and Kafka (any variant).Write elegant and maintainable code, and be comfortable with picking up new technologies.Proficient in workin...Show moreLast updated: 28 days ago
The Data Engineer role involves designing and implementing efficient data models, creating scalable data pipelines, and managing data lakes.
The candidate will also develop and maintain CI / CD pipeli...Show moreLast updated: 30+ days ago
DevSecOps, DataOps, and ML infrastructure.You will build, integrate and operate platforms on .Architect and implement end-to-end data and ML platforms : data ...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
USEReadyBangalore Urban, Karnataka, India Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 23 days ago
- Promoted
- New!
Senior Data Engineer
AmazonBengaluru, Karnataka, India This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.DESCRIPTION : Worl...Show moreLast updated: 11 hours ago
- Promoted
Senior Data Engineer
HealthyMe AIHosur, Tamil Nadu, India About the Role We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.
You will report to the Head of AI and Engineering and be responsi...Show moreLast updated: 21 days ago
- Promoted
Data Platform Engineer
Grizmo LabsBengaluru, Karnataka, India Design, build, and maintain scalable data platforms and pipelines to support the needs of the business.Ensure data quality and accuracy by implementing data validation and testing processes.Partici...Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer
MastekBengaluru, Karnataka, India Role : Data Engineer – Databricks.We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ValueLabsBengaluru, Karnataka, India With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries.
Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Guidewire SoftwareBengaluru, Karnataka, India Responsibilities : Design and Development : Architect, design, and develop robust, scalable, and efficient data pipelines.
Design and manage platform solutions to support data engineering needs to ens...Show moreLast updated: 13 days ago
Data Platform Engineer
InvokhrBangalore Rural, Karnataka, IndiaQuick Apply
- Promoted
Senior Data Engineer
SAIVA AIHosur, Tamil Nadu, India We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
Senior Data Engineer
Saaki Argus & Averil ConsultingBangalore Rural, Karnataka, IndiaQuick Apply
- Promoted
Senior Data Platform Engineer
Black Dog LabsBangalore, IN Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps.
We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Saransh IncHosur, Tamil Nadu, India Data Engineer (Contract-to-Hire | Remote) Experience Level : 6+ Years Location : Remote Contract Type : Full-Time / Fixed-Term Contract (12 months, extendable based on performance) Notice : Immedia...Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer
AvathonBengaluru, Karnataka, India AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 23 days ago
- Promoted
Senior Data Engineer
DataWeaveBengaluru, Karnataka, India About DataWeave : DataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to help digital commerce businesses make smarter, data-driven decisions.
We turn billions of publicly a...Show moreLast updated: 13 days ago
- Promoted
- New!
AWS Data Engineer
Tata Consultancy Serviceshosur, tamil nadu, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 12 hours ago
- Promoted
Data Platform Engineer
Grizmo LabsBengaluru, Karnataka, India What youʼll do : • Design, build, and maintain scalable data platforms and pipelines to support the needs of the business • Ensure data quality and accuracy by implementing data validation and testi...Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
AccoladeBengaluru, Karnataka, India The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 23 days ago
Senior / Lead Platform Engineer (Databrick)
TymeXBengaluru, KA, INQuick Apply
- Promoted
Platform Engineer-Data
ValueLabsBengaluru, Karnataka, India We’re Hiring : Senior Technology Engineer – DevOps & Big Data.Senior Technology Engineer (STE).Build robust CI / CD pipelines using Jenkins & GitOps.
Deploy applications using Kubernetes & OpenShift fo...Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer - Snowflake / AWS
ResourcetreeBangalore About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 19 days ago