GCP Data Engineer (Senior)

GCP Data Engineer (Senior) with skills Data Engineering, Big Data for location Bangalore, India

Posted on : August 09, Share on Linkedin Share on Twitter Share on Facebook

ROLES & RESPONSIBILITIES

Stream1 : Data Engineering

• Minimum of 2+ years of hands-on experience in google cloud solutions and implementations.
• Build and maintain data pipeline, data transformation, and analytical components
• Design and develop software solutions using one or more technologies mentioned here : Google Biquery (Must have), SQL, Cloud Composer / Airflow, Data Flow / Apache Beam, Python
• Build analytics software products that utilize the data pipeline to provide actionable insights
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Understand and translate business needs into data models supporting long-term solutions
• Perform reverse engineering of code and physical data models from Python, databases, and SQL scripts
• Work with the application development team to implement the data strategies, build data flows and develop conceptual data models.
• Analyze data-related system integration challenges and propose appropriate solutions
• Ability to perform data validation processes
• Work with other team members to accomplish key software development tasks
• Work with the operation support team on transition and stabilization.

B) Primary Skills : -

C) Optional skills : -

Stream2 : ML OPs or Data Scientist

ETL Developer Skills Required (focus should be given more on data science and ML Ops) :

Minimum 6+ years of hands-on experience in the field of Data Engineering / DW projects

Designing and developing enterprise data solutions on GCP cloud platform with native or third-party data technologies.

Experience in design and development of data modeling, data design, data warehouses, data lakes and analytics platforms on GCP

Expertise in designing ETL data pipelines and data processing architectures for Datawarehouse

Good experience in Datawarehouse in designing Star & Snowflake Schemas and knowledge of Dimensional Data Modelling

Work with data scientists, data team and engineering teams to use Google Cloud platform to analyze data, build data models on Big query, big table etc

Working experience in Integrating different datasets from multiple data sources for data modelling for analytical and AI / ML models

Expertise in MLops pipeline development or GenAIops pipeline development

Knowledge and hands on with GenAI tools for productivity and data tool development

Good working experience with relational databases and NoSQL databases including but not limited to Oracle, Spanner, BigQuery etc.

Expert level SQL skills for data manipulation (DML), data validation and data manipulation

Experience in technical design and building both Streaming and batch processing systems

Take ownership of production deployment of code

Understanding and experience in Pub / Sub, Kafka, Kubernetes, GCP, AWS, Hive, Docker

Expertise in Java batch spring boot / Python or other programming languages used for Data Engineering and integration projects

Strong problem-solving and analytical skills

AI / ML exposure, MLOPS and Vertex AI is a great advantage

Familiarity with DevOps practices like CICD pipeline

Airline domain experience is a plus

Excellent spoken and written communication skills

GCP Cloud Data Engineer Professional is plus

Stream3 : API developer with Python / Java skills

Full Stack Developer :

Develop RESTful APIs in Java and related stack Java, J2EE, Spring, Hibernate, Microservices / Cloud based development

Develop User Interfaces using modern front-end libraries and stack such as React / Node / Angular

Expert at building Cloud Native product development preferably with GCP (Google Cloud Platform)

Thorough understanding and should have extensively used JSON, XML and logging such as Log4j.

Experience with relational databases (Spanner / Oracle / MySql, SQLServer) as well as NoSQL databases like Couchbase, Firestore, Datastore

Handle structured and complex semi-structured data structures in code modules

Create comprehensive unit, functional, performance, and integration test suites. Write CI / CD scripts using Jenkins Pipelines.

Test Driven Development (TDD) and unit testing using Junit and other frameworks

Expertise in end-to-end development of Modern web apps and works with Cross functional teams on

Participate in production deployments and provide support when needed

Good knowledge and hands on experience with DevOps including CI / CD, Observability etc.

Nice to have experience on Infrastructure as a code experience using any tools such as terraform

EXPERIENCE

SKILLS

ABOUT THE COMPANY

Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ : MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).

Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.