Talent.com
Lead Data Engineer Data and Analytics
Lead Data Engineer Data and AnalyticsInforma Group Plc. • Bengaluru, Karnataka, India
Lead Data Engineer Data and Analytics

Lead Data Engineer Data and Analytics

Informa Group Plc. • Bengaluru, Karnataka, India
30+ days ago
Job description

Closing Date :   Applications will close on 11th November 2025.

What you will be doing :

  • Function as part of an Agile engineering team in the role of Lead Data Engineer responsible for orchestrating and upholding the highest levels of Engineering and Enterprise Data Warehouse Concepts and practices throughout the Software Development Life Cycle collaborating closely with development operations and architecture teams.
  • Define delivery phases and perform project task and individual management duties for team setting activities sub-activities and milestones while ensuring that development and delivery standards are rigorously enforced.
  • Manage and enhance our Continuous Integration Delivery and Deployment processes teams and users to ensure high-quality and efficient delivery.
  • Collaborate closely with Engineering Managers and Business Analysts to produce accurate delivery estimates and oversee the transition from analysis through design to deliver
  • Design and implement scalable data solutions using AWS services
  • Design and implement data models for warehouse solutions
  • Create and maintain Infrastructure as Code using CloudFormation
  • Implement comprehensive unit testing strategies
  • Work closely with cross-functional teams to gather requirements
  • Mentor junior engineers on AWS best practices and data engineering concepts
  • Participate in code reviews and technical discussions
  • Document technical solutions and maintain knowledge base
  • Deploy and troubleshoot solutions as needed adhering to best practices throughout the development lifecycle to identify and resolve issues prior to deployment.
  • Plan design and develop cloud-based applications analytical services and platforms.
  • Ensure adherence to company security guidelines and requirements.

Qualifications :

What we are looking for :

  • An enthusiastic team member who fosters collaborative relationships advocate for technical excellence and adapt to evolving requirements within a dynamic team environment.
  • Demonstrate excellent communication organizational skills and a proactive approach to meeting deadlines and achieving project goals.
  • Proven experience as a Lead Data Engineer with expertise in Python and Spark.
  • Experience in CI / CD pipelines using GitHub and GitHub Actions to streamline development workflows.
  • Develop and maintain ETL pipelines using AWS Glue Lambda and EventBridge.
  • Manage data storage solutions across S3 and Redshift.
  • Implement security best practices using AWS IAM.
  • Experience with cloud computing services especially AWS ECS RDS EFS S3 Lambda to build scalable and resilient applications.
  • Experience with database management including SQL (e.g. MySQL) and NoSQL (e.g. MongoDB) ensuring efficient data storage and retrieval.
  • Ensure code quality through SonarCloud integration
  • Create and maintain Infrastructure as Code using CloudFormation
  • In-depth knowledge in Test Driven Development (TDD) for Data Pipelines and Python
  • Excellent container orchestration skills using Docker ensuring efficient application deployment and management.
  • Strong understanding of Agile methodologies and implementations (Kanban XP Scrum).
  • Excellent problem-solving and troubleshooting skills.
  • Process-oriented with great documentation skills.
  • Bachelors degree in computer science or a related field or equivalent work experience preferred
  • Additional Information :

    What we offer in return :

  • 24 days annual leave
  • 4 volunteering days annually
  • Day off for your birthday
  • Pension contributions
  • Medical insurance for self and dependants; life cover and personal accident cover for self
  • Seasonal social and charitable events
  • Training and development
  • Blended style and flexi working time
  • Right tools for remote working
  • Additional Information :

  • You must have the right to work and live in Bengaluru India
  • We believe that great things happen when people connect face-to-face. Thats why we work in-person with each other or with customers and partners three days a week or more. When youre not spending time together in one of our offices or other workplaces like at conference you get the flexibility and support to work from home or remotely.

    The successful candidate will be able to utilise our balanced working model. We ask that candidates live within a commutable distance of our office in Bengaluru to ensure that as a balanced worker they can make it to our office location 3 days per week.

    We want all our candidates to shine in our recruitment process. Please let us know if there is anything we can do to ensure you are able to show us your best self. This could include having the application form in a different format more time for questions or anything else please ask us we are happy to be flexible! Please contact

    Being Yourself at Taylor & Francis

    If youre excited about working with Taylor & Francis to foster human progress through knowledge we invite you to apply even if your existing skills and experience dont fit every item listed above. At Taylor & Francis we are at our best and most successful when colleagues can be themselves and contribute regardless of their identity or background. As a colleague you will have the opportunity to further innovate and develop in areas that you are passionate about. Our goal is to empower you with the resources incentives and flexibility you need to enjoy success at work and to live a healthy balanced life.

    Taylor & Francis is proud to be an Equal Opportunity Employer. We believe in and value diversity of people and thought fostering a supportive and inclusive environment where all colleagues can learn and succeed as their true selves. Taylor & Francis recruits develops and retains colleagues without regard to any protected personal characteristics or other non-merit-based factor.

    If you have a disability or face another barrier  and would like to request an adjustment to assist your participation in the hiring process and / or in the advertised position please contact Ivy Ma. Your request will be reviewed and considered in the strictest confidence.

    We genuinely care about our colleagues promoting work-life balance wellbeing and flexible working. We believe that the skills and experience you bring to Taylor & Francis are invaluable. We want you to have the opportunity to develop your abilities and to innovate and develop in areas which you are passionate about. To find out more about our business and the great career opportunities please go to our Careers Site : Work :

    No

    Employment Type : Full-time

    Key Skills

    Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

    Experience : years

    Vacancy : 1

    Create a job alert for this search

    Lead Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    Lead Data Engineer

    Lead Data Engineer

    Tredence Inc. • Bengaluru, Karnataka, India
    Primary Roles and Responsibilities : Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
    Last updated: 1 day ago • Promoted
    Data Analytics Engineer

    Data Analytics Engineer

    CrowdStrike • Bengaluru, Karnataka, India
    As a global leader in cybersecurity CrowdStrike protects the people processes and technologies that drive modern organizations. Since 2011 our mission hasnt changed were here to stop breaches and w...Show more
    Last updated: 21 hours ago • Promoted • New!
    AI & Data Analytics Engineer

    AI & Data Analytics Engineer

    Amphenol • Bangalore Urban district, India, India
    We are seeking a highly motivated.This role will play a critical part in modernizing and streamlining our testing processes through automation,. The Analyst will collaborate with auditors and stakeh...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • bangalore, karnataka, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Technical Lead-Data Engineer

    Technical Lead-Data Engineer

    Best Infosystems Ltd. • Bengaluru, Karnataka, India
    Technical Lead-Data Engineer_Full-Time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai. Bachelor’s / relevant exp - with Snowpro Certification.Ent...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    SPIRO • bangalore, India
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 1 day ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Dr. Martens plc • Bengaluru, Karnataka, India
    SO, WHAT'S THE STORY? As a Lead Data Engineer , you will play a key role in the development and maintenance of the organization's data infrastructure. Working within a multi-disciplined team led by...Show more
    Last updated: 1 day ago • Promoted
    Data Analytics Engineer

    Data Analytics Engineer

    Weekday AI • Bengaluru, KA, IN
    Quick Apply
    This role is for one of the Weekday's clients.We are seeking a talented and motivated .In this role, you will be responsible for designing, developing, and maintaining data infrastructure that...Show more
    Last updated: 22 days ago
    AWS Lead Data engineer

    AWS Lead Data engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
    Last updated: 26 days ago • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    IQVIA • Bengaluru, Karnataka, India
    Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team perform...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Brillio • Bengaluru, Karnataka, India
    We are seeking a Build and Deploy Engineer with strong experience in ETL tools (DataStage, SSIS, IICS), Python, and UNIX scripting to support, maintain, and enhance data integration workflows for a...Show more
    Last updated: 6 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Eltropy • Bengaluru, Karnataka, India
    Lead data engineer and ML Analyst.Design and manage scalable ETL / ELT pipelines using AWS Glue, Redshift, S3, and Kafka / Kinesis. Architect and implement data lake and warehouse solutions following be...Show more
    Last updated: 5 days ago • Promoted
    Lead Analytics Engineer

    Lead Analytics Engineer

    Volvo Cars • Bengaluru, Karnataka, India
    Software the fuel for mobility.We bring bold digital visions to life.So were on the lookout for more curious and creative engineers who want to create change one line of high-quality code at a tim...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Maersk • Bengaluru, Karnataka, India
    Moller Maersk is the global leader in container shipping services.The business operates in 130 countries and employs 80000 staff. An integrated container logistics company Maersk aims to connect an...Show more
    Last updated: 17 days ago • Promoted
    Lead Data Engineer [T500-21385]

    Lead Data Engineer [T500-21385]

    ANSR • Bengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members levera...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme Services • Bengaluru, Karnataka, India
    We are hiring sharp, hands-on Data Engineers to build scalable data solutions and drive performance across both traditional and cloud-based data platforms. Key Roles and Responsibilities.Strong comm...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Greetings from TATA CONSULTANCY SERVICES LIMITED!!!.Thank you for exploring career opportunities with Asia's largest IT company. Exciting # Job Opportunities for # Experienced Professionals.Should h...Show more
    Last updated: 30+ days ago • Promoted
    Manager, Data Engineer

    Manager, Data Engineer

    Saks Global India • Bangalore Urban, Karnataka, India
    Data Engineer and Operations Lead.Saks Global is the largest multi-brand luxury retailer in the world, comprising Saks Fifth Avenue, Neiman Marcus, Bergdorf Goodman, Saks OFF 5TH, Last Call and Hor...Show more
    Last updated: 30+ days ago • Promoted