No longer accepting applications
Lead Data Engineer
Guidewire SoftwareBengaluru, Republic Of India, IN22 days ago
Job descriptionBachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 8+ years of experience in software engineering with a focus on data engineering and building data platform Strong programming experience using Python or Java. Proven experience with Big data technologies like Apache Spark, Amazon EMR, Apache Iceberg, Amazon Redshift, etc or Similar technologies Proven experience in RDBMS(Postgres, MySql, etc) and NoSQL(MongoDB, DynamoDB, etc) database Proficient in AWS cloud services (e.G., Lambda, S3, Athena, Glue) or comparable cloud technologies. Demonstrated leadership experience, with a track record of leading and mentoring engineering teams. In-depth understanding of SDLC best practices, including Agile methodologies, code reviews, and CI / CD. Experience working in Event driven and Serverless Architecture Experience with platform solutions and containerization technologies (e.G., Docker, Kubernetes). Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment. Strong communication skills, both written and verbal.
Responsibilities :
- Design and Development :
- Architect, design, and develop robust, scalable, and efficient data pipelines.
- Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.
- Write clean, efficient, and maintainable code.
- Leadership and Collaboration :
- Lead and mentor a team of Data engineers, providing technical guidance and fostering a collaborative environment.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
- Drive the adoption of best practices in software development lifecycle (SDLC), including code reviews, testing, and continuous integration / continuous deployment (CI / CD).
- Data Management and Optimization :
- Ensure data quality, integrity, and security across all data pipelines.
- Optimize data processing workflows for performance and cost-efficiency.
- Develop and maintain comprehensive documentation for data pipelines and related processes.
- Innovation and Continuous Improvement :
- Stay current with emerging technologies and industry trends in big data and cloud computing.
- Propose and implement innovative solutions to improve data processing and analytics capabilities.
- Continuously evaluate and improve existing data infrastructure and processes.
Qualifications :
Create a job alert for this search
Lead Data Engineer • Bengaluru, Republic Of India, IN
Related jobs
![Lead Data Engineer [T500-20510]](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-in&company_name=ANSR)
- Promoted
Senior Data Engineer
Straivehosur, tamil nadu, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
MakeMyTripBangalore Urban, Karnataka, India At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
CoffeeBeansBengaluru, Karnataka, India Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes.
We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer [T500-20510]
ANSRBengaluru, Karnataka, India ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Recrohosur, tamil nadu, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Philodesign Technologies Inchosur, tamil nadu, in The ideal candidate will have strong hands-on expertise in.Azure Data Factory (ADF), Synapse, and Databricks.ETL, SQL, and data warehousing concepts.
Design, develop, and implement ETL solutions usi...Show moreLast updated: 1 day ago
- Promoted
Lead Data Engineer
INDI Staffing ServicesBangalore Urban, Karnataka, India At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show moreLast updated: 1 day ago
- Promoted
Lead Data Engineer
ImpetusBengaluru, Karnataka, India GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
thinkbridgehosur, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Digitalzonehosur, tamil nadu, in As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Insight Globalhosur, tamil nadu, in GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SGS & Cohosur, tamil nadu, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
Guidanz Inchosur, tamil nadu, in BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 1 day ago
- Promoted
Lead Data Engineer - Databricks
Tredence Inc.Bengaluru, Karnataka, India Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI.
Headquartered in San Jose, Cali...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
Saransh Inchosur, tamil nadu, in Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago
- Promoted
Senior Data Engineer
Mastekhosur, tamil nadu, in We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
CimpressBengaluru, Karnataka, India Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Response Informaticshosur, tamil nadu, in We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago