Senior Data Platform Engineer
Black Dog LabsRanchi, Republic Of India, IN29 days ago
Job descriptionData pipelines : Design, build, and operate reliable batch and change-driven pipelines from multiple sources; schedule / orchestrate jobs; Transformations & modeling : Implement clean, tested merge and transformation pipelines and produce models that are easy to consume for products and analytics; APIs & integration : Build or collaborate on APIs for data access and updates; design request / responsecontracts; Infrastructure & DevOps : Provision and manage cloud resources with Terraform; automate build / test / deploy with CI / CD; Observability & reliability : Instrument structured logs, metrics, and traces; define alert policies and on-call runbooks; Security basics : Apply least-privilege access, secrets management, and encryption in transit / at rest; Quality & tests : Write unit, integration, and data-quality tests (including SQL tests) to keep pipelines and services correct and maintainable. Collaboration & docs : Communicate clearly in writing and in person; produce concise docs (data contracts, mappings, runbooks); Strong SQL (query tuning, indexing, query plans) and solid RDBMS fundamentals (e.G., Postgres, SQL Server, MySQL). Python for data work and services; Terraform and IaC fundamentals; Cloud : Azure preferred (e.G., storage, compute, identity, monitoring). If not Azure, very strong AWS background. Data integration : Experience with ingestion (batch + change-driven), orchestration, schema / versioning, and resilient retries / replays. Workflow orchestration & scheduling : Prefect preferred (flows / deployments, retries / backoff, scheduling, observability); APIs & auth : Practical experience with REST patterns, pagination, validation, rate limiting, and OAuth2 / OIDC / JWT. Observability : Familiar with logs / metrics / traces and setting actionable alerts and dashboards. Testing mindset : Habit of writing tests for code and SQL; Communication : Clear, concise writing and verbal comms; AI tooling : Ready to use Claude Code (and similar assistants) from day one to accelerate work—while exercising judgment and writing your own code / tests. Regulatory / compliance awareness (e.G., data protection or public-sector standards) and how it impacts design / operations Analytics experience (dim / fact modeling, BI consumption patterns) Full-stack exposure (can prototype simple UI / ops views when needed) Data platform architecture exposure (storage / layout choices, catalog / lineage, governance concepts) Familiarity with event streaming / message queues, job schedulers / orchestrators, and columnar formats (e.G., Parquet) Experience with cloud monitoring stacks (Azure Monitor / Application Insights, CloudWatch, Datadog, New Relic, etc.) Duration : 12+ months (extension / full-time possible) Schedule : Flexible, with overlap for key meetings across time zones Compensation : Competitive, based on experience Mode : Remote; Resume / CV highlighting data engineering, DevOps / IaC, and / or API / auth work Brief note (one paragraph) about a recent pipeline / service : requirements, your role, tech, validation / tests, deployment / ops, outcome Links to code samples or design docs (if available and shareable)
Position : Senior Data Platform Engineer
Location : Remote (collaboration across time zones), India or LATAM preferred
Engagement Type : Contract (12+ months)
Language : Proficient English communication
Experience : 5+ years in Data Engineering / Backend Engineering / DevOps
About the Role
- We’re looking for a hands-on Senior Data Platform Engineer to build and operate production-grade data pipelines and services. You’ll work across ingestion, transformation, orchestration, and APIs;
- automate environments with Terraform;
- instrument observability;
- and write tests to keepthings reliable. Azure experience is preferred;
strong AWS experience is also acceptable. You should communicate clearly (async chat and live sessions), learn fast, and use AI coding tools (e.G., Claude Code) effectively without relying on them exclusively.
Key Responsibilities
handle schema evolutionand failures gracefully.
tune SQL for performance.
handle auth (OAuth2 / OIDC / JWT), idempotency, validation, and auditing.
write solid shell scripts for glue / ops tasks.
track SLOs and drive root-cause prevention.
collaborate with the team on compliance requirements.
work closely with product / engineering / analytics.
Required Skills & Qualifications
comfortable with shell scripting (bash preferred, powershell proficiency if not bash).
CI / CD experience (version control workflows, automated tests, environment promotion).
Airflow, Dagster, or similar also acceptable.
comfortable with fixtures / test data and CI.
comfortable in async chat and live sessions.
Preferred Qualifications (Nice to Have)
Engagement Details
available for virtual collaboration and on-call windows as agreed
How to Apply
Please share :
Apply via LinkedIn or by sending an email to careers@blackdoglabs.io
Create a job alert for this search
Senior Data Engineer • Ranchi, Republic Of India, IN
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 19 hours ago
)
- Promoted
- New!
Senior Data Engineer
Donyatiranchi, jharkhand, in We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 20 hours ago
- Promoted
- New!
Senior Data Engineer
GSPANN Technologies, Incranchi, jharkhand, in Headquartered in California, U.GSPANN provides consulting and IT services to global clients.We help clients transform how they deliver business value by helping them optimize their IT capabilities,...Show moreLast updated: 20 hours ago
- Promoted
Senior Data Engineer
Veraxionranchi, jharkhand, in We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization.
If you love solving complex da...Show moreLast updated: 30+ days ago
- Promoted
Senior Azure Data Engineer
Programmers.ioranchi, jharkhand, in Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
Experience Range : 8 Years - 12 years.We are...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer Lead
JRD Systemsranchi, jharkhand, in The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica.
This role will lead the design and delivery of.Databricks (PySpark, ...Show moreLast updated: 20 hours ago
- Promoted
- New!
Senior Data Engineer
Pacific Data Integratorsranchi, jharkhand, in Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show moreLast updated: 20 hours ago
- Promoted
Azure Data Engineer
SystemBenderranchi, jharkhand, in Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer
Tata Consultancy Servicesranchi, jharkhand, in Job Title : Senior Data Engineer.Required Skillset : Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda).
Master Databricks tools (job creation, cluster, notebook) and be able to qu...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
EXLranchi, jharkhand, in Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
Relevance Labranchi, jharkhand, in Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products.
Translate business requirements into robust logical and...Show moreLast updated: 20 hours ago
- Promoted
Senior Data Engineer
Amicon Hub Servicesranchi, jharkhand, in Required Skills & Qualifications.Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).
Excellent problem-solving skills and the ability to work in a f...Show moreLast updated: 30+ days ago
- Promoted
- New!
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careersranchi, jharkhand, inRemote
- Promoted
Lead Data Engineer
INDI Staffing Servicesranchi, jharkhand, in At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show moreLast updated: 14 days ago
- Promoted
- New!
Senior Data Engineer (AWS / GCP)
Armakuniranchi, jharkhand, in We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show moreLast updated: 19 hours ago
- Promoted
Senior Data Engineer
TekIT Software Solutions Pvt. Ltd. (India & USA)ranchi, jharkhand, in Job Title : Senior Data Engineer.Kochi / Trivandrum / Bangalore.We are seeking a highly skilled.Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks.The ideal can...Show moreLast updated: 5 days ago
- Promoted
GenAI Lead Engineer (Investment Data Platforms)
Vichara Technologiesranchi, jharkhand, in We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers.
Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
One Tapp Consultingranchi, jharkhand, in Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles.
Data Platform Management : Implement and manage data proce...Show moreLast updated: 16 hours ago
- Promoted
- New!
AWS Data Engineer
Atyeti Incranchi, jharkhand, in Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform.
Build and maintain all facets of Data Pipel...Show moreLast updated: 20 hours ago