Hiring Senior Data Engineer for an IT Product Company
Location : Pune
Role : Senior Data Engineer :
Minimum 4+Yrs of Relevant Experience
Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or Azure cloud
- Master's degree in either software engineering, data engineering, data science, computer science, physics, statistics, mathematics, or a related field
- Data engineering professional experience
- Previous hands-on professional experience in developing and maintaining data pipelines on AWS and Databricks.
- Ability to write compelling code, technical documentation and visualize your technical design.
- Coding proficiency with multiple languages Python, Scala and DBT.
- Fluent in industry-standard DevOps practices.
- Practical experience in working with enterprise data landscapes and data structures : Structural data, non-structural data, metadata, master data, transactional data, batch / NRT.
- Tech stack : AWS, Gitlab, Databricks for ETL, Airflow, Python, Scala, and DBT for developing ETL, jobs, AWS CDK and Terraform for IaC.
- Experience on enterprise data sources : Experience in working with any one of these e.g. SAP ERP, Salesforce and product data management (PDM), manufacturing execution system (MES) system data.
- Exposure in Medallion Lakehouse Architecture Would be a plus