Senior Data Engineer - Google Cloud Platform

Position : Sr. Programmer Analyst

Division : Data Engineering

Experience : 5 to 8 yrs (At least 3 yrs experience in Data Engineering space with expertise in Python, Airflow & Google Cloud)

Qualification : B.Tech / B.E / MCA / M.Sc(Comp)

Job Type : Permanent & Day Shift

Job Location : Hyderabad / Bangalore

We are looking for an independent contributor experienced in Data Engineering space.

Primary responsibilities include implementation of large-scale data processing (Structural, Statistical etc.,) Pipelines, creates production inference pipelines, associated APIs and analytics that support / provide insights for data driven decision making. Designs and develops data models, APIs, and pipelines to handle analytical workloads, data sharing, and movement across multiple systems at various grains in a large-scale data processing environment. Designs and maintains data systems and data structures for optimal read / write performance. Implements machine learning or statistical / heuristic learning in data pipelines based on input from Data Scientists.

Roles and Responsibilities :

• Work in data streaming, movement, data modeling and data pipeline development
• Develop pipelines and data model changes in support of rapidly emerging business and project requirements
• Develop code and maintain systems to support analytics Infrastructure & Data Lake
• Partner / Contribute to data analysis and machine learning pipelines
• Design data recovery processes, alternate pipelines to check data quality.
• Create and maintain continuous data quality evaluation processes
• Optimize performance of the analytics platform and develop self-healing workflows
• Be a part of a global team and collaborate and co-develop solutions

Qualifying Criteria :

Preferred Qualifications :

Note : We are looking for candidates who can join 0 to 15 days notice max.

ref : hirist.tech)