Talent.com
This job offer is not available in your country.
Senior Data Engineer - Google Cloud Platform

Senior Data Engineer - Google Cloud Platform

GAMIFi Consulting Services Pvt LtdBangalore
30+ days ago
Job description

Position : Sr. Programmer Analyst

Division : Data Engineering

Experience : 5 to 8 yrs (At least 3 yrs experience in Data Engineering space with expertise in Python, Airflow & Google Cloud)

Qualification : B.Tech / B.E / MCA / M.Sc(Comp)

Job Type : Permanent & Day Shift

Job Location : Hyderabad / Bangalore

We are looking for an independent contributor experienced in Data Engineering space.

Primary responsibilities include implementation of large-scale data processing (Structural, Statistical etc.,) Pipelines, creates production inference pipelines, associated APIs and analytics that support / provide insights for data driven decision making. Designs and develops data models, APIs, and pipelines to handle analytical workloads, data sharing, and movement across multiple systems at various grains in a large-scale data processing environment. Designs and maintains data systems and data structures for optimal read / write performance. Implements machine learning or statistical / heuristic learning in data pipelines based on input from Data Scientists.

Roles and Responsibilities :

  • Work in data streaming, movement, data modeling and data pipeline development
  • Develop pipelines and data model changes in support of rapidly emerging business and project requirements
  • Develop code and maintain systems to support analytics Infrastructure & Data Lake
  • Partner / Contribute to data analysis and machine learning pipelines
  • Design data recovery processes, alternate pipelines to check data quality.
  • Create and maintain continuous data quality evaluation processes
  • Optimize performance of the analytics platform and develop self-healing workflows
  • Be a part of a global team and collaborate and co-develop solutions

Qualifying Criteria :

  • 5+ Years of prior experience in Data Engineering and Databases
  • Experience with code based ETL framework like Airflow / Prefect
  • Experience with Google BigQuery, Google PubSub, Google Dataflow
  • Experience building data pipelines on AWS or GCP
  • Experience developing data APIs and pipelines using Python
  • Experience with databases like MySQL / Postgres
  • Experience with intermediate Python programming
  • Experience with advanced SQL (analytical queries)
  • Preferred Qualifications :

  • Experience with Visualization tools like Tableau / QlikView / Looker
  • Experience with building Machine Learning pipelines
  • Note : We are looking for candidates who can join 0 to 15 days notice max.

    ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Bangalore