Experience : 8+Years
Location : Chennai, Bangalore
Notice Period : Immediate to 30 days
Mode : WFO
Role : Data Engineer
Role Overview :
The Data Engineer role involves designing and implementing efficient data models, creating scalable data pipelines, and managing data lakes. The candidate will also develop and maintain CI / CD pipelines for seamless integration and deployment of data solutions.
The ideal candidate should have expertise in big data tools, particularly on the Azure Stack, including Azure Data Factory (ADF), Databricks, Synapse Analytics, and Azure DevOps. Proficiency in Spark (Scala / Python), SQL, and strong analytical skills for handling structured and unstructured datasets is essential.
This position is part of the Data Engineering team responsible for enterprise-wide data solutions. The team focuses on data collection, organization, governance, and access management to drive productivity, efficiency, and informed decision-making across the organization..
Key Responsibilities :
- Design, develop, test, and operate large-scale, high-volume, high-performance data solutions for analytics and reporting.
- Leverage best engineering practices to build frameworks for data ingestion, curation, and consumption.
- Implement data structures with best practices in data modeling, ETL processes, and OLAP technologies.
- Model data and metadata for ad hoc and pre-built reporting requirements.
- Deliver high-quality, reliable data to support business needs.
- Collaborate with product and technical teams to build robust and scalable data integration pipelines using SQL, Python, and Spark.
- Adhere to coding and data management best practices.
- Communicate effectively with cross-functional teams, including product, business, and other data teams.
Qualifications :
Bachelor s or Master s degree in Engineering, Computer Science, or a related field (or equivalent work experience).2 4 years of hands-on experience in Data Engineering, Data Modeling, Data Warehousing, and ETL pipelines.Proficiency in SQL, Scala / Python (PySpark), Shell / Python scripting, and CI / CD tools like Git.Experience with Azure data stack tools such as ADLS, ADF, Synapse Analytics, Databricks, Azure DevOps, or an equivalent technology stack.Strong analytical, data profiling, and problem-solving skills.