Senior Data Engineer

Guidewire SoftwareKarnataka, India

2 days ago

Job description

Responsibilities :

Design and Development :
Architect, design, and develop robust, scalable, and efficient data pipelines.
Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.
Write clean, efficient, and maintainable code.
Leadership and Collaboration :
Lead and mentor a team of Data engineers, providing technical guidance and fostering a collaborative environment.
Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
Drive the adoption of best practices in software development lifecycle (SDLC), including code reviews, testing, and continuous integration / continuous deployment (CI / CD).
Data Management and Optimization :
Ensure data quality, integrity, and security across all data pipelines.
Optimize data processing workflows for performance and cost-efficiency.
Develop and maintain comprehensive documentation for data pipelines and related processes.
Innovation and Continuous Improvement :
Stay current with emerging technologies and industry trends in big data and cloud computing.
Propose and implement innovative solutions to improve data processing and analytics capabilities.
Continuously evaluate and improve existing data infrastructure and processes.

Qualifications :

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

8+ years of experience in software engineering with a focus on data engineering and building data platform

Strong programming experience using Python or Java.

Proven experience with Big data technologies like Apache Spark, Amazon EMR, Apache Iceberg, Amazon Redshift, etc or Similar technologies

Proven experience in RDBMS(Postgres, MySql, etc) and NoSQL(MongoDB, DynamoDB, etc) database

Proficient in AWS cloud services (e.g., Lambda, S3, Athena, Glue) or comparable cloud technologies.

Demonstrated leadership experience, with a track record of leading and mentoring engineering teams.

In-depth understanding of SDLC best practices, including Agile methodologies, code reviews, and CI / CD.

Experience working in Event driven and Serverless Architecture

Experience with platform solutions and containerization technologies (e.g., Docker, Kubernetes).

Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.

Strong communication skills, both written and verbal.

Create a job alert for this search

Senior Data Engineer • Karnataka, India

Related jobs

Promoted

Senior Data Engineer

Societe Generale Global Solution CentreKarnataka, India

With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors / inspectors with high-qua...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Sonata SoftwareKarnataka, India

The Senior Software Engineer supports functions which require automation / systems development, including initial development and ongoing support of the suite of applications that would help manage l...Show moreLast updated: 2 days ago

Promoted

Senior GCP Data Engineer

AscendionKarnataka, India

Job Title : Senior GCP Data Engineer (7 - 12 Years).Locations : Bengaluru, Hyderabad, Chennai, Pune.We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficie...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

USEReadyKarnataka, India

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 2 days ago

Promoted
New!

Senior Data Engineer

AvathonKarnataka, India

AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 10 hours ago

Promoted

Senior Data Engineer

DataWeaveKarnataka, India

APIs powering dashboards and integrations.Collaborate with cross-functional teams in a.Elasticsearch, Cassandra, Solr.Good communication and problem-solving skills. Mentorship, learning opportunitie...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer [T500-20511]

ANSRKarnataka, India

ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 1 day ago

Promoted

Data Engineer

EVERSANAKarnataka, India

At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer / Architect

InfosysKarnataka, India

As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for. You will create, maintain, aud...Show moreLast updated: 2 days ago

Promoted

Data Engineer

People Tech Group IncKarnataka, India

We are Hiring - Data Engineer Bengaluru!.We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects.The ideal candida...Show moreLast updated: 1 day ago

Promoted

Senior Engineer Data [T500-20882]

Albertsons Companies IndiaKarnataka, India

About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc.Our well-known banners across the United States, including Albertsons, Safeway, Vo...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Incept LabsKarnataka, India

Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

ValueLabsKarnataka, India

With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries. Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

ZetaKarnataka, India

It was founded by and Ramki Gaddipati in 2015.Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issua...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer-Remote

Cimpress IndiaKarnataka, India

Remote

NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Tredence Inc.Karnataka, India

Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues. Work with business to understand the need in...Show moreLast updated: 2 days ago

Promoted

Senior Engineer Data [T500-20299]

Albertsons Companies IndiaKarnataka, India

MDM Senior Data Engineer-P-Tiger Analytics

ObjectWin Technology India Pvt. LtdKA, India

Quick Apply

JOB DESCRIPTION Curious about the role? As a Senior Data Engineer, you will be responsible for design and develop Business Entity models, hierarchies, and relati...Show moreLast updated: 7 days ago