Senior Data Engineer

We are seeking an experienced Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He / she will play a key role in developing and maintaining scalable data solutions using PySpark, SQL, and modern data engineering frameworks .

Key Responsibilities

• Develop and deploy end-to-end data pipelines and solutions integrating with various data sources and systems.
• Collaborate with cross-functional teams to understand data requirements and deliver effective BI and analytical solutions.
• Implement data ingestion, transformation, and processing workflows using Spark (PySpark / Scala) and SQL .
• Develop and maintain data models and ETL / ELT processes , ensuring high performance, scalability, reliability, and data quality.
• Build and maintain APIs and data services to support analytics, reporting, and application integration.
• Ensure data quality, integrity, and security across all stages of the data lifecycle.
• Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.
• Write clean, modular, and well-documented Python / Scala / SQL / PySpark code.
• Integrate data from various sources including APIs, relational / non-relational databases, IoT devices, and external providers.
• Ensure adherence to data governance, security, and compliance policies.

Required Skills & Experience