Senior Data Engineer
Guidewire SoftwareBengaluru, Karnataka, India16 days ago
Job descriptionBachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 8+ years of experience in software engineering with a focus on data engineering and building data platform Strong programming experience using Python or Java. Proven experience with Big data technologies like Apache Spark, Amazon EMR, Apache Iceberg, Amazon Redshift, etc or Similar technologies Proven experience in RDBMS(Postgres, MySql, etc) and NoSQL(MongoDB, DynamoDB, etc) database Proficient in AWS cloud services (e.g., Lambda, S3, Athena, Glue) or comparable cloud technologies. Demonstrated leadership experience, with a track record of leading and mentoring engineering teams. In-depth understanding of SDLC best practices, including Agile methodologies, code reviews, and CI / CD. Experience working in Event driven and Serverless Architecture Experience with platform solutions and containerization technologies (e.g., Docker, Kubernetes). Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment. Strong communication skills, both written and verbal.
Responsibilities :
- Design and Development :
- Architect, design, and develop robust, scalable, and efficient data pipelines.
- Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.
- Write clean, efficient, and maintainable code.
- Leadership and Collaboration :
- Lead and mentor a team of Data engineers, providing technical guidance and fostering a collaborative environment.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
- Drive the adoption of best practices in software development lifecycle (SDLC), including code reviews, testing, and continuous integration / continuous deployment (CI / CD).
- Data Management and Optimization :
- Ensure data quality, integrity, and security across all data pipelines.
- Optimize data processing workflows for performance and cost-efficiency.
- Develop and maintain comprehensive documentation for data pipelines and related processes.
- Innovation and Continuous Improvement :
- Stay current with emerging technologies and industry trends in big data and cloud computing.
- Propose and implement innovative solutions to improve data processing and analytics capabilities.
- Continuously evaluate and improve existing data infrastructure and processes.
Qualifications :
Create a job alert for this search
Senior Data Engineer • Bengaluru, Karnataka, India
Related jobs
- Promoted
Senior Data Engineer
DataWeaveBengaluru, Karnataka, India APIs powering dashboards and integrations.Collaborate with cross-functional teams in a.Elasticsearch, Cassandra, Solr.Good communication and problem-solving skills.
Mentorship, learning opportunitie...Show moreLast updated: 16 days ago
- Promoted
Senior DS Prompt Engineer
FedExBangalore Rural, Karnataka, India What your main responsibilities are.Skilled and passionate GenAI Prompt Engineer to join our Customer Experience Analytics team.
The ideal candidate will be responsible for designing inputs for AI t...Show moreLast updated: 16 days ago
- Promoted
Senior Azure Data Engineer (Architect) - Pan India
Genpacthosur, tamil nadu, in We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills.
The ideal candidate will have experience and a proven track re...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer
ValueLabsBengaluru, Karnataka, India With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries.
Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Tredence Inc.Bengaluru, Karnataka, India Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues.
Work with business to understand the need in...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ZetaBengaluru, India Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future.It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015.Our flagship process...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
Delta Air LinesBengaluru, India Design, architect, and optimize Teradata EDW solutions with a focus on performance, scalability, and maintainability.Lead performance tuning efforts using TASM and other workload management tools.D...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Societe Generale Global Solution CentreBengaluru, Karnataka, India With 710 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors / inspectors with high-qualit...Show moreLast updated: 7 days ago
- Promoted
Data Engineer with Snowflake Experience- Contract
Gravity Infosolutions, Inc.hosur, tamil nadu, in Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical.
Most data to be migrated is already in Snowflake...Show moreLast updated: 5 days ago
- Promoted
Senior Serdes Architect
Mulya TechnologiesGreater Bengaluru Area, India Senior SerDes Architect and Lead.About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET ...Show moreLast updated: 25 days ago
- Promoted
Senior Data Engineer
AvathonBengaluru, Karnataka, India AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 26 days ago
- Promoted
Senior Data Engineer
Tata Consultancy ServicesBangalore Urban, Karnataka, India TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
AccoladeBengaluru, Karnataka, India The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 26 days ago
- Promoted
Senior Data Engineer
USEReadyhosur, tamil nadu, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
Veraxionhosur, tamil nadu, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 6 days ago
- Promoted
Senior DAC Architect
Mulya TechnologiesGreater Bengaluru Area, India About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET nodes, which enable differentiate...Show moreLast updated: 25 days ago
- Promoted
- New!
GCP Data Engineer
JRD Systemshosur, tamil nadu, in Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources.
Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 5 hours ago
- Promoted
Data Engineer
Response Informaticshosur, tamil nadu, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 26 days ago