Data Engineer

Job Title : Data Engineer

Experience : 5–10 Years

Location : Bangalore (ONLY)

Mandatory Skills : SQL, ETL, PySpark, Python

Key Responsibilities

Design, develop, and maintain scalable ETL / ELT pipelines to ingest and transform large datasets from diverse sources.

Build and optimize PySpark-based data processing workflows for batch and real-time data use cases.

Write high-performance SQL queries and manage complex data models for analytics and reporting.

Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.

Ensure data quality, accuracy, and reliability through robust validation and monitoring frameworks.

Optimize data storage and processing performance on cloud or distributed systems.

Implement automation for recurring tasks using Python and related tools.

Work with CI / CD pipelines and version control to maintain clean, scalable, and maintainable code.

Troubleshoot and resolve issues in data pipelines, ensuring minimal disruption to business operations.

Required Skills & Qualifications

5–10 years of hands-on experience in Data Engineering .

Strong proficiency in SQL , including complex queries, performance tuning, and data modeling.

Expertise in ETL / ELT development , data integration, and transformation frameworks.

Solid experience in PySpark for distributed data processing.

Strong programming experience in Python , including writing modular, production-grade code.

Experience working with big data ecosystems (e.g., Hadoop, Hive, Spark).

Familiarity with data warehousing concepts and cloud platforms (AWS / Azure / GCP).

Experience with version control (Git), CI / CD, and workflow orchestration tools (Airflow / Luigi) is a plus.

Strong analytical, problem-solving, and communication skills.