No longer accepting applications

Senior Data Engineer

TekIT Software Solutions Pvt. Ltd. (India & USA)Jaipur, IN

7 days ago

Job description

Job Title : Senior Data Engineer

Employment Type : Full-Time

Location : Kochi / Trivandrum / Bangalore

Experience : Minimum 8 years

We are seeking a highly skilled Senior Data Engineer with strong expertise in Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks. The ideal candidate will have hands-on experience building scalable data pipelines, transforming raw data into curated datasets, and supporting large-scale replatforming initiatives across complex data ecosystems.

Key Responsibilities

1. Silver / Gold Layer Development

Transform raw data from various sources (Zuora, Commerce Tools, APIs, legacy databases) into curated Silver and Gold layers.
Implement business logic, data standardization, and robust data quality validations.
Collaborate with analysts / stakeholders to validate metric definitions and ensure consistency.

2. Replatforming Support

Audit and analyze existing pipelines for dependencies on legacy data structures.

Update data models and jobs to support new transactional systems.

Ensure end-to-end data lineage, compatibility with downstream analytics, and smooth migration.

3. Collaboration & Documentation

Work closely with engineering, analytics, and product teams to document transformations and requirements.

Contribute to metadata tagging and data cataloging using Unity Catalog .

Develop comprehensive documentation : data dictionaries, PK / FK constraints, pipeline logic, validations, and process notes.

Must-Have Qualifications

Strong data modeling expertise using Kimball methodology .

Hands-on experience with Databricks (Workflows, DLTs, Delta Tables, Unity Catalog).

Strong proficiency in SQL and Python .

Solid understanding of Medallion Architecture (Bronze / Silver / Gold).

Experience with Spark , Kafka , ETL frameworks, and orchestration tools.

Proficiency in AWS / GCP / Azure cloud data services.

Hands-on experience with GitHub or similar version control systems.

Strong foundation in data governance , data quality frameworks, observability, and best practices.

Ability to collaborate effectively across multi-functional teams.

Preferred Qualifications

Experience in replatforming large-scale transactional systems.

Working knowledge or exposure to subscription and commerce data domains .

Create a job alert for this search

Senior Data Engineer • Jaipur, IN