Principal Data Engineer
Guidewire SoftwareBengaluru, Republic Of India, IN21 days ago
Job descriptionBachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 8+ years of experience in software engineering with a focus on data engineering and building data platform Strong programming experience using Python or Java. Proven experience with Big data technologies like Apache Spark, Amazon EMR, Apache Iceberg, Amazon Redshift, etc or Similar technologies Proven experience in RDBMS(Postgres, MySql, etc) and NoSQL(MongoDB, DynamoDB, etc) database Proficient in AWS cloud services (e.G., Lambda, S3, Athena, Glue) or comparable cloud technologies. Demonstrated leadership experience, with a track record of leading and mentoring engineering teams. In-depth understanding of SDLC best practices, including Agile methodologies, code reviews, and CI / CD. Experience working in Event driven and Serverless Architecture Experience with platform solutions and containerization technologies (e.G., Docker, Kubernetes). Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment. Strong communication skills, both written and verbal.
Responsibilities :
- Design and Development :
- Architect, design, and develop robust, scalable, and efficient data pipelines.
- Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.
- Write clean, efficient, and maintainable code.
- Leadership and Collaboration :
- Lead and mentor a team of Data engineers, providing technical guidance and fostering a collaborative environment.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
- Drive the adoption of best practices in software development lifecycle (SDLC), including code reviews, testing, and continuous integration / continuous deployment (CI / CD).
- Data Management and Optimization :
- Ensure data quality, integrity, and security across all data pipelines.
- Optimize data processing workflows for performance and cost-efficiency.
- Develop and maintain comprehensive documentation for data pipelines and related processes.
- Innovation and Continuous Improvement :
- Stay current with emerging technologies and industry trends in big data and cloud computing.
- Propose and implement innovative solutions to improve data processing and analytics capabilities.
- Continuously evaluate and improve existing data infrastructure and processes.
Qualifications :
Create a job alert for this search
Principal Data Engineer • Bengaluru, Republic Of India, IN
Related jobs
Being aware of departmental guidance on best practices, processes, templates, clauses and playbooks.Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
Tredence Inc.Bengaluru, Republic Of India, IN Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues.
Work with business to understand the need in...Show moreLast updated: 18 days ago
- Promoted
Principal Data Engineer
DataWeaveBengaluru, Republic Of India, IN APIs powering dashboards and integrations.Collaborate with cross-functional teams in a.Elasticsearch, Cassandra, Solr.Good communication and problem-solving skills.
Mentorship, learning opportunitie...Show moreLast updated: 21 days ago
- Promoted
Principal Data Engineer
Best Infosystems Ltd.Bengaluru, Republic Of India, IN Technical Lead-Data Engineer_Full-Time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.
Bachelor’s / relevant exp - with Snowpro Certification.Ent...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Science Engineer
Netcore CloudBengaluru, Republic Of India, IN Netcore Cloud is a MarTech platform helping businesses design, execute, and optimize campaigns across multiple channels.With a strong focus on leveraging data, machine learning, and AI, we empower ...Show moreLast updated: 11 days ago
- Promoted
Principal Data Engineer
ZetaBengaluru, Republic Of India, IN Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core banking, fraud &...Show moreLast updated: 12 days ago
- Promoted
Principal Data Engineer
NeemtreeBangalore Description : Responsibilities : - Define and lead the data architecture vision and strategy, ensuring it supp...Show moreLast updated: 18 days ago
- Promoted
Principal Cloud Data Engineer
AscendionBengaluru, Republic Of India, IN Job Title : Senior GCP Data Engineer (7 - 12 Years).Locations : Bengaluru, Hyderabad, Chennai, Pune.We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficie...Show moreLast updated: 21 days ago
- Promoted
Principal Data Engineer (Azure Focus)
TEKsystems Global Services in IndiaBengaluru, Republic Of India, IN Bangalore (Work From Office – 5 Days).We are looking for a highly skilled.The ideal candidate will have hands-on experience in.
Azure Data Factory (ADF), Databricks, and Azure SQL.ETL and data wareh...Show moreLast updated: 12 days ago
- Promoted
Principal Data Pipeline Engineer
Incept LabsBengaluru, Republic Of India, IN Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
PriceEasy AIBengaluru, Karnataka, India Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Solutions Engineer
ValueLabsBengaluru, Republic Of India, IN With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries.
Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 21 days ago
- Promoted
AI & Data Principal Engineer
Talent SocioBangalore About the Role : We are seeking a visionary AI & Data Principal Engineer to lead the architecture, development, and deployment of advanced AI and data-driven solutions.This...Show moreLast updated: 26 days ago
Principal Data Engineer
ScaleneWorksBengaluru, Karnataka, IndiaQuick Apply
- Promoted
Principal Data Engineer
CoffeeBeansBengaluru, Republic Of India, IN Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes.
We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
- Promoted
Elanco - Principal Data Engineer
ElancoBangalore Description : At Elanco (NYSE : ELAN) it all starts with animals!.As a global leader in animal health, we are dedicated to innovation and delivering products and se...Show moreLast updated: 7 days ago
- Promoted
Principal Data Engineer
AutodeskBengaluru, Karnataka, India We are seeking a highly experienced.Autodesk’s Analytics Data Platform (ADP).This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-o...Show moreLast updated: 11 days ago
- Promoted
Principal Data Engineer
WithumBengaluru, Republic Of India, IN Withum is a place where talent thrives - where who you are matters.It’s a place of endless opportunities for growth.A place where entrepreneurial energy plus inclusive teamwork equals exponential r...Show moreLast updated: 30+ days ago
- Promoted
Principal Engineer
Wenger & WatsonBengaluru, Karnataka, India Principal Engineer — Marketing & CRM.We’re seeking a Principal Engineer to drive the evolution of our cloud-native, SaaS-based marketing and CRM platform serving banks and credit unions across the ...Show moreLast updated: 8 days ago