Job description
- Be a part of a growing team, We are looking for a Platform Engineer I candidate to join our IT Development team in Hyderabad,
- Create automated processes to measure data quality, failures, and errors
- Analyze existing systems and data pipes to identify areas for improvement or opportunities to enhance
- Continue to help evolve and improve the data quality processes and templates
- Profile data sources to understand existing quality issues in the ETL processes
- Collaborate on data modeling tasks including recommending and evaluating designs based on Kimball dimensional data modeling practices
- Aggregate and combine raw information from different data sources
- Explore ways to enhance data quality and reliability including helping with the development of support and remediation processes
- Identify opportunities for data acquisition
- Develop analytical tools and processes to measure and report data quality
- Help adjust and tune existing CI / CD framework and processes (Azure DevOps) as needed to improve data quality
Skills
Proficient in SQL, Python, and SparkData Engineer Stack : Data Pipelines implementation, SQL, Snowflake / IcebergBachelors Degree or higher in a technical field such as Engineering, Computer Science, etc.Minimum 3+ years of experience designing, building, and supporting data pipesSkills Required
Spark, Sql, Python, Etl, Azure Devops