Talent.com
This job offer is not available in your country.
GCP Data Engineer

GCP Data Engineer

Multi RecruitBengaluru, IN
30+ days ago
Job description

Roles and Responsibility

  • Data modelling and design
  • Excellent Coding skills in ETLTools.
  • Experience on running ETLpipelines from a wide variety of sources, both batch & streaming, usinglatest data frameworks and technologies with real time monitoring and alerting.
  • Essential experience of workingwith distributed systems software development.
  • Critical experience inperformance optimization for both data loading and ingestion.
  • Know-how of criticaldeveloper’s toolkit such as Linux, GitHub, Dockers, VSCode, Jupyter
  • Ability to work in a fast-pacedand deadline driven environment.
  • Experience of working on publicclouds (AWS / Azure)
  • Experience of migrationprojects from on-Prem to cloud
  • Google Cloud Platform (minimum2 years’ experience with the following services)
  • Data Ingestion – Data Fusion,Cloud Storage, BigQuery
  • Data Preparation – Dataprep,Dataflow, Cloud Functions, BigQuery Compute, Cloud SQL, BigQuery ManagedStorage
  • Analysis – AI Hub, AutoML,Vertex
  • Enabling Tools – Dataplex,Cloud Composer, and Cloud Operations

General Responsibilities :

  • Business Requirements -Evaluates user change requests and obtains approval to make modifications.
  • Data Identification - Utilizescurrent data guidelines.
  • Middleware Solutions - Utilizesmiddleware tools for designing, developing or enhancing solutions whenrequired.
  • Development - Develops and / ormodifies moderately complex application components using disciplined softwaredevelopment processes. Conducts unit testing to ensure the application meetsspecifications.
  • Test - Develops test cases andassists in conducting systems and integration testing. May assist in usertesting.
  • Change Control - Makes modulestest and / or production ready by moving them to libraries, completing forms,following procedures, completing version control documents, etc.
  • Production Support - Assists inscheduling tests or production jobs. Creates and / or monitors reports regardingresults.
  • Troubleshoot - Assists inproviding user navigation, data analysis / reconciliation and front-end support.Troubleshoots existing modules to identify errors or deficiencies.
  • Maintenance - Provides on-goingmaintenance of applications. Identifies, reviews and evaluates user problemsand determines the most appropriate course of action for resolution, withassistance.
  • Continuous Improvements - Looksfor opportunities to eliminate inefficiencies.
  • Systems Performance - Maymonitor application’s performance. May work with other IT groups inidentifying and / or fixing problem areas.
  • Configuration Management - Mayassist in researching, evaluating, and specifying the configuration of hardwareand / or software for application’s environment.
  • Communications - Communicateswith users and / or team members on a regular basis as to the status ofassignments through project meetings, projects status reports, email,etc.
  • Architecture Compliance -Complies with architecture and quality processes, principles, policies andstandards.
  • Mentors - Provides technicalcoaching and mentoring to less experienced team members.

    • Expected Behaviors :

  • Communication for Results -Speaks effectively in group situations, e.g., meetings, presentations. Expresses ideas in a clear, concise and thorough manner. Simplifies technicalor complex information without insulting the listener / reader. Takes measures toensure understanding has occurred. Asks questions to clarify or discernimplied or poorly expressed meanings.
  • Information Seeking - Easilyasks probing questions to get to the root cause of a situation or a problem, ora potential opportunity below the surface issues presented. Does not stopwith the first answer in order to determine why something happened. Seeksto better understand the context, nature and expectations of deliverables.Obtains information from a variety of sources.
  • Initiative - Recognizesopportunities to act and make a difference. Takes action without over-analyzingor waiting until it is too late. Willingly takes charge and acts in the face ofadversity. Accepts assignments that appear less than ideal, with confidencethat the people, processes and systems in the organization can effectively workthrough issues and obstacles.
  • Innovation - Listens to newideas with an open mind. Understands the existing incentive and reward systemsfor innovation and creativity. Exhibits interest in new ideas andexperimentation by pointing out opportunities for innovation.
  • Problem Solving - Knowledge andability to troubleshoot problems. Utilizes tools, pre-defined steps, andexperience to diagnose and manage technical problems; performs root cause andcause and effect analyses.
  • Teamwork - Actively solicitsideas and opinions from others to quickly accomplish specific decisions orplans targeted at defined business outcomes. Openly encourages other teammembers to voice their ideas and concerns. Shows respect for differences and diversity;disagrees without personalizing issues. Involves other team members toachieve optimal performance by utilizing one another’s strengths.
  • Thoroughness - Performs tasksin a thorough manner and according to formal, written procedures. May expressfrustration about task inefficiency but does not effect change in procedures.
  • Business Process Knowledge -Familiar with all processes and their relevancy to project development. Able to discuss process flows and identify process bottlenecks.
  • Quality Process Techniques -Aware of quality techniques, standards, and measurements used in own area ofwork. Able to use techniques to evaluate a se
    • Create a job alert for this search

    Gcp Data Engineer • Bengaluru, IN