Experience on running ETLpipelines from a wide variety of sources, both batch & streaming, usinglatest data frameworks and technologies with real time monitoring and alerting.
Essential experience of workingwith distributed systems software development.
Critical experience inperformance optimization for both data loading and ingestion.
Know-how of criticaldeveloper’s toolkit such as Linux, GitHub, Dockers, VSCode, Jupyter
Ability to work in a fast-pacedand deadline driven environment.
Experience of working on publicclouds (AWS / Azure)
Experience of migrationprojects from on-Prem to cloud
Google Cloud Platform (minimum2 years’ experience with the following services)
Data Ingestion – Data Fusion,Cloud Storage, BigQuery
Enabling Tools – Dataplex,Cloud Composer, and Cloud Operations
General Responsibilities :
Business Requirements -Evaluates user change requests and obtains approval to make modifications.
Data Identification - Utilizescurrent data guidelines.
Middleware Solutions - Utilizesmiddleware tools for designing, developing or enhancing solutions whenrequired.
Development - Develops and / ormodifies moderately complex application components using disciplined softwaredevelopment processes. Conducts unit testing to ensure the application meetsspecifications.
Test - Develops test cases andassists in conducting systems and integration testing. May assist in usertesting.
Change Control - Makes modulestest and / or production ready by moving them to libraries, completing forms,following procedures, completing version control documents, etc.
Production Support - Assists inscheduling tests or production jobs. Creates and / or monitors reports regardingresults.
Troubleshoot - Assists inproviding user navigation, data analysis / reconciliation and front-end support.Troubleshoots existing modules to identify errors or deficiencies.
Maintenance - Provides on-goingmaintenance of applications. Identifies, reviews and evaluates user problemsand determines the most appropriate course of action for resolution, withassistance.
Continuous Improvements - Looksfor opportunities to eliminate inefficiencies.
Systems Performance - Maymonitor application’s performance. May work with other IT groups inidentifying and / or fixing problem areas.
Configuration Management - Mayassist in researching, evaluating, and specifying the configuration of hardwareand / or software for application’s environment.
Communications - Communicateswith users and / or team members on a regular basis as to the status ofassignments through project meetings, projects status reports, email,etc.
Architecture Compliance -Complies with architecture and quality processes, principles, policies andstandards.
Mentors - Provides technicalcoaching and mentoring to less experienced team members.
Expected Behaviors :
Communication for Results -Speaks effectively in group situations, e.g., meetings, presentations. Expresses ideas in a clear, concise and thorough manner. Simplifies technicalor complex information without insulting the listener / reader. Takes measures toensure understanding has occurred. Asks questions to clarify or discernimplied or poorly expressed meanings.
Information Seeking - Easilyasks probing questions to get to the root cause of a situation or a problem, ora potential opportunity below the surface issues presented. Does not stopwith the first answer in order to determine why something happened. Seeksto better understand the context, nature and expectations of deliverables.Obtains information from a variety of sources.
Initiative - Recognizesopportunities to act and make a difference. Takes action without over-analyzingor waiting until it is too late. Willingly takes charge and acts in the face ofadversity. Accepts assignments that appear less than ideal, with confidencethat the people, processes and systems in the organization can effectively workthrough issues and obstacles.
Innovation - Listens to newideas with an open mind. Understands the existing incentive and reward systemsfor innovation and creativity. Exhibits interest in new ideas andexperimentation by pointing out opportunities for innovation.
Problem Solving - Knowledge andability to troubleshoot problems. Utilizes tools, pre-defined steps, andexperience to diagnose and manage technical problems; performs root cause andcause and effect analyses.
Teamwork - Actively solicitsideas and opinions from others to quickly accomplish specific decisions orplans targeted at defined business outcomes. Openly encourages other teammembers to voice their ideas and concerns. Shows respect for differences and diversity;disagrees without personalizing issues. Involves other team members toachieve optimal performance by utilizing one another’s strengths.
Thoroughness - Performs tasksin a thorough manner and according to formal, written procedures. May expressfrustration about task inefficiency but does not effect change in procedures.
Business Process Knowledge -Familiar with all processes and their relevancy to project development. Able to discuss process flows and identify process bottlenecks.
Quality Process Techniques -Aware of quality techniques, standards, and measurements used in own area ofwork. Able to use techniques to evaluate a se
Create a job alert for this search
Gcp Data Engineer • Bengaluru, Karnataka, India
Related jobs
Promoted
New!
GG Data Engineer
Astellas Pharma Inc.Bengaluru, Karnataka, India
Data Pipeline Development : Design, build, and optimize data pipelines using DWH technologies, Databricks, QLIK and other platforms as required.
Ensuring data quality, reliability, and scalability.Ap...Show moreLast updated: 8 hours ago
Promoted
New!
GCP_Data Engineer
FractalBengaluru, Karnataka, India
It's fun to work in a company where people truly BELIEVE in what they are doing!.Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation...Show moreLast updated: 8 hours ago
Promoted
New!
Data Engineer (GCP)
Job Connect IndiaBengaluru, Karnataka, India
Data Engineer (Google Cloud Platform - GCP)Job Overview.The ideal candidate will have hands-on experience with GCP services such as.
BigQuery, Dataflow, Pub / Sub, Cloud Composer, Cloud Storage, and D...Show moreLast updated: 8 hours ago
Promoted
New!
Staff GCP Data Engineer
EquinixBengaluru, Karnataka, India
Equinix is the world’s digital infrastructure company®, operatingover 260 data centers across the globe.Digital leaders harness Equinix's trusted platform to bring together and interconnect foundat...Show moreLast updated: 8 hours ago
Promoted
GCP Data Engineer
ImpetusBengaluru, Karnataka, India
We need GCP engineers for capacity building;.The candidate should have extensive production experience (1-2 Years ) in GCP, Other cloud experience would be a strong bonus.Strong background in Data ...Show moreLast updated: 30+ days ago
Promoted
GCP Data Engineer
TEKsystemsBengaluru, IN
We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant).
Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 11 days ago
Promoted
GCP Data Engineer
Tata Consultancy ServicesBengaluru, Karnataka, India
TCS is looking for GCP Data Engineer.Location : Bangalore / Kochi / Chennai / Hyderabad / Pune.GCP services (Big Query, Cloud Run, Pub / Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Fu...Show moreLast updated: 30+ days ago
Promoted
New!
GCP Data Engineer- Teradata
Saaki Argus & Averil ConsultingBengaluru, Karnataka, India
Extensive experience working with.Strong experience migrating data from.Familiarity with ETL / ELT processes and.Understanding of CI / CD tools like.
Basic exposure to distributed processing frameworks ...Show moreLast updated: 8 hours ago
Promoted
GCP Data Engineer
AscendionBengaluru, Karnataka, India
Job Title : GCP Data Engineer (4 - 12 Years).Locations : Bengaluru, Hyderabad, Chennai, Pune.We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficiency in ...Show moreLast updated: 23 days ago
Promoted
New!
GCP Data Engineer
Aqilea (formerly Soltia)Bengaluru, Karnataka, India
We are a consulting company with a bunch of technology-interested and happy people!.We love technology, we love design and we love quality.
Our diversity makes us unique and creates an inclusive and...Show moreLast updated: 8 hours ago
Promoted
New!
Data Engineer- GCP
NucleusTeqBengaluru, Karnataka, India
Skills needed : Python, Airflow(Orchestration) ,GCP(Cloud),Spark SQL, PySpark, GCP, CI / CD ,Git,Git Hub.Designing and building data models to support business requirements.
Developing and maintaining ...Show moreLast updated: 8 hours ago
Promoted
New!
GCP Bigquery
TalentOlaBengaluru, Karnataka, India
Primary skill - Google BigQuery.GCP Senior Data Engineer Job description as below : .Solid understanding of GCP ETL framework.
Solid knowledge about develop robust, scalable, reusable and efficient ET...Show moreLast updated: 8 hours ago
Promoted
New!
Data Consultant-GCP Data Engineer
WomenTech NetworkBengaluru, Karnataka, India
At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day.
So why work at Kyndryl? We are always moving forward – always pushing ...Show moreLast updated: 4 hours ago
Promoted
GCP Data Engineer
HCLTechBengaluru, Karnataka, India
ETL, Pyspark, Python with Azure or AWS or GCP.Special Economic Zone, Tower-2 Jigani, 129, Bommasandra Jigani Link Rd,.Interested candidates please share your resume to sajithkuma@hcltech.Show moreLast updated: 3 days ago
Promoted
GCP Data Engineer
FractalBengaluru, Karnataka, India
We are seeking an experienced GCP Data Engineer with 6+ years of experience to design, develop, and manage cloud-based data solutions on Google Cloud Platform (GCP).
The ideal candidate will have ex...Show moreLast updated: 30+ days ago
Promoted
New!
GCP Data Engineer
TalentOlaBengaluru, Karnataka, India
GCP Senior Data Engineer Job description as below : Key Responsibilities : Solid understanding of GCP ETL framework.Solid knowledge about develop robust, scalable, reusable and efficient ETL Solid kn...Show moreLast updated: 8 hours ago
Promoted
New!
IN-Senior Associate _GCP Data Engineer_Data and Analytics_ Advisory_Bangalore
PwCKalhalli, Karnataka, India
Summary : A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics....Show moreLast updated: 8 hours ago
Promoted
GCP Data Engineer
BrillioBengaluru, Karnataka, India
GCP (primary), AWS (secondary acceptable).Infrastructure as Code (good to have).Develop and maintain scalable, cloud-native data processing pipelines on GCP.
BigQuery, DataFlow, Pub / Sub, Cloud Stora...Show moreLast updated: 30+ days ago