Talent.com
Data Pipeline Engineer

Data Pipeline Engineer

DeloitteBengaluru, Republic Of India, IN
12 days ago
Job description

Your potential, unleashed.

India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.

At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matters.

The Team

Deloitte’s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.

Work you’ll do

Total Experience - 7 to 11 Years

Relevant Experience - 5+

Location - Bangalore

Roles and Responsibilities :

The Data Engineer will work on data engineering projects for various business units, focusing on delivery of complex data management solutions by leveraging industry best practices. They work with the project team to build the most efficient data pipelines and data management solutions that make data easily available for consuming applications and analytical solutions. A Data engineer is expected to possess strong technical skills.

Experience : -

  • Knowledge of and skills in various programming languages primarily Python
  • Must have knowledge on Back-end frameworks, Pandas, Numpy, Matplotlib / Seaborn
  • Thorough understanding of containers and functions. Deployment experience with Kubernetes (K8s) or Functions is highly desirable.
  • Experience using Cloud Native CI / CD tools (Azure Pipelines / Circle CI / Jenkins X).
  • Experience deploying workloads to AWS or Azure with strong knowledge and understanding of the cloud provider's API / associated services and infrastructure
  • Experience in test driven development & writing of unit and integration tests is a must
  • Knowledge of other Cloud (Google Cloud Platform, Cloudera etc), and Integration services technologies is highly desirable.
  • Experience working in agile teams with demonstrated application of the principles.
  • Demonstrable proficiency in developing complex JavaScript applications.
  • Experience of working with lean startup / agile development methodologies
  • Strong analytical, problem-solving, and troubleshooting skills.
  • Experienced with modern coding, testing, debugging and automation techniques.
  • Rave about the benefits of CI / CD
  • Have a high bar for user experience and quality.
  • You are data driven and customer obsessed.
  • Good communication skills.

Key Characteristics

  • Availability to solve production issues / taking ownership of interfaces deployed on prod etc
  • Understanding in RDBMS and NoSQL databases (e.G., PostgreSQL, MongoDB).
  • Ability to troubleshoot and resolve database issues.
  • In-depth knowledge and experience in RESTful API interfaces.
  • Comprehensive understanding of ETL processes from end-to-end.
  • Technology champion who constantly pursues skill enhancement and has inherent curiosity to understand work from multiple dimensions.
  • Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
  • Has worked on real data challenges and handled high volume, velocity, and variety of data.
  • Is proficient in designing data integrations and data processes across different types of architecture patterns using native cloud services, or custom application codes
  • Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.
  • Contributes to community building initiatives like CoE, CoP.
  • Mandatory Skills

  • Programming Languages : Proficiency in Python and PySpark is paramount. Should have knowledge of data processing using Pandas, Numpy and relevant libraries to handle data.
  • Databases : Strong knowledge of SQL and NoSQL databases
  • Big Data Technologies : Experience with frameworks like Apache Spark, Hadoop, and Kafka for processing large datasets
  • Cloud Computing : Familiarity with cloud platforms like Azure(preferred) / AWS(good to have) and their data services (e.G., Data Factory, Databricks, Synapse, Redshift)
  • ETL / ELT & Data Warehousing : Expertise in designing and implementing ETL (Extract, Transform, Load) processes, and data modelling for efficient data warehousing
  • Data Pipelines : Ability to develop, optimize, and maintain robust and scalable data pipelines
  • Should have a good understanding of optimization techniques and able to resolve performance bottlenecks
  • Knowledge of web frameworks and API is beneficial
  • How you’ll grow

    At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities to help build world-class skills in addition to hands-on experience in the global, fast-changing business world. From on-the-job learning experiences to formal development

    Programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career. Explore Deloitte University, The Leadership Centre.

    Benefits

    At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.

    Our purpose

    Deloitte is led by a purpose : To make an impact that matters .

    Every day, Deloitte people are making a real impact in the places they live and work. We pride ourselves on doing not only what is good for clients, but also what is good for our people and the communities in which we live and work—always striving to be an organization that is held up as a role model of quality, integrity, and positive change. Learn more about Deloitte's impact on the world

    Recruiter tips

    We want job seekers exploring opportunities at Deloitte to feel prepared and confident. To help you with your interview, we suggest that you do your research : know some background about the organization and the business area you’re applying to. Check out recruiting tips from Deloitte professionals.

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Bengaluru, Karnataka, India
    Virtual interview : 25-Oct-2025.Data Software Engineer - Spark, Python, (Azure Databricks ).Years of in Big Data & Data related technology experience. Expert level understanding of distributed comput...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VRIZEBengaluru, Karnataka, India
    Experience as a Data Engineer with strong track record of designing and implementing data solutions.Experience in programming language as Python, Pyspark with airflows. Experience with cloud data wa...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroBangalore, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HCLTechGreater Bengaluru Area, India
    F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen IncBengaluru, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Data engineer - AWS - Inperson drive

    Data engineer - AWS - Inperson drive

    Live ConnectionsGreater Bengaluru Area, India
    Show moreLast updated: 16 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionBangalore, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Ubique SystemsBengaluru, Karnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneBengaluru, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Data Engineer I

    Data Engineer I

    LiciousGreater Bengaluru Area, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    VIDA Digital IdentityGreater Bengaluru Area, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show moreLast updated: 16 hours ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 27 days ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyantbangalore district, karnataka, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Previous experience as a data engineer or in a similar role.Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Syn...Show moreLast updated: 14 hours ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Come and join us for an exciting career with TCS!!!.Must Have Experiences and Skills : .We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be re...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    HCLTechGreater Bengaluru Area, India
    HCLTech is a global technology company, home to more than 226,600 people across 60 countries, delivering industry-leading capabilities centered around AI, digital, engineering, cloud and software, ...Show moreLast updated: 16 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansBengaluru, Karnataka, India
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeBengaluru, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago