Sr Data Engineer

Job Title : Senior Data Engineer

Location : Remote in India

Employment Type : Full-time

About the Role

We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-making. The ideal candidate will have hands-on experience with Python, Dagster (or equivalent orchestration tools like Airflow or Azure Data Factory), AWS data services, and strong SQL and data modeling expertise.

Key Responsibilities

Design, develop, and maintain scalable data pipelines and ETL / ELT processes for batch and real-time data integration.

Work with cross-functional teams (Data Analysts, Data Scientists, Product, Engineering) to ensure data availability, quality, and reliability.

Implement and manage data orchestration workflows using Dagster, Airflow, or Azure Data Factory.

Optimize data storage, query performance, and transformation logic for efficiency and scalability.

Develop and manage data models, schemas, and metadata to support business intelligence and analytics needs.

Utilize AWS services (e.g., S3, Glue, Redshift, Lambda, Athena, EMR) for building and maintaining cloud-based data solutions.

Establish data quality checks, validation processes, and monitoring frameworks to ensure accuracy and consistency.

Contribute to data governance, documentation, and best practices for data engineering.

Mentor junior engineers and collaborate on code reviews, design sessions, and architecture discussions.

Required Skills & Qualifications

Bachelor’s or Master’s Degree in Computer Science, Information Systems, Data Engineering, or related field.

7+ years of experience in data engineering or related roles.

Strong proficiency in Python for data processing, automation, and scripting.

Hands-on experience with Dagster, or equivalent orchestration tools like Apache Airflow or Azure Data Factory.

Solid experience with AWS Data Services – such as S3, Glue, Redshift, Lambda, Athena, EMR, or related.

Expertise in SQL (query optimization, stored procedures, schema design).

Proven experience building and maintaining complex data pipelines across multiple systems.

Strong understanding of ETL / ELT design patterns, data modeling (OLTP / OLAP), and data warehousing concepts.

Experience working with CI / CD pipelines and version control tools (Git).

Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.