Talent.com
Senior Data Engineer - Big Data Technologies
Senior Data Engineer - Big Data TechnologiesAndor Tech(India) Pvt Ltd • Bangalore
Senior Data Engineer - Big Data Technologies

Senior Data Engineer - Big Data Technologies

Andor Tech(India) Pvt Ltd • Bangalore
30+ days ago
Job description

Job Description : Accountabilities :

  • Understands the business vision from the data solutions and works with all project stakeholders to enable that.
  • Works alongside multiple other project team members to drive towards the common goal.
  • Helps the business analysts to create data mapping documents that define the end to end pipeline.
  • Builds and delivers data pipelines that ingests data (structured and unstructured) from multiple sources into the target data lake.
  • Builds the data management layer in line with the business needs and standards defines.
  • Triages problems in the pipelines or data layers and effectively fixes them based on the priority.
  • Automates data loading during initial or incremental loads.
  • Supports the run and maintain team during critical issues and helps them in faster resolution.

Dimensions :

A key element of this role is to work along with Trading and Supply teams in delivering an enterprise solution in data engineering area. This will mostly include green field implementation of data analytics solutions delivering high value to customer.

Special Challenges :

  • As a data engineer responsible for effectively handling data and deriving value out of it.
  • Responsible for providing innovative solutions that are best in class but also quick to market.
  • No direct reports. But is self-driven and can independently handle the work assigned.
  • Drive effective best practices across multiple initiatives and teams and be innovative and influential in managing constraints.
  • Requirements :

  • 4 + years of IT industry experience, with at least 2 years on Big data technologies.
  • Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
  • Has worked on real data challenges and handled huge volume, velocity and variety of data.
  • Understands Infrastructure concepts and has worked with multiple cloud tenants.
  • Proficient with data warehousing and traditional ETL technologies.
  • Strong experience in writing stored procedure, functions and triggers in SQL.
  • Strong experience on Azure ecosystem and has worked with data management on Databricks, ADF, Blob Store, ADLS etc.
  • Implement complex data processing algorithms in real time in and efficient manner using Spark and other technologies.
  • Knowledge on data analytics area using Visualization and data modelling tools.
  • Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.
  • Excellent communication and stakeholder management skills
  • Industry certification in Data Engineering is an added advantage. technical skills like Pyspark , Azure etc
  • Mandatory skills :

  • AWS / Azure / SAP - Master
  • ELT - Master
  • Data Modeling - Master
  • Data Integration & Ingestion - Skill
  • Data Manipulation and Processing - Skill
  • GITHUB, Action, Azure DevOps - Skill
  • Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest - Skill
  • Roles and Responsibilities :

    The Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization, not just within IT teams, but also in the wider Business stakeholder community. A Senior Data engineer is expected to be a subject matter expert, who design & build data solutions and mentor junior engineers. They are also the key drivers to convert Vison and Data Strategy for IT solutions and deliver.

    Key Characteristics :

  • Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions.
  • Deep data focus with expertise in technology domain
  • A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff.
  • Actively delivers the roll-out and embedding of Data Foundation initiatives in support of
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Bangalore

    Related jobs
    Senior Data Engineer (Onpremise)

    Senior Data Engineer (Onpremise)

    Blend • Bengaluru, Karnataka, India
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo Infotech • Bengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show more
    Last updated: 25 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cargill • Bengaluru, Karnataka, India
    The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasury-specific data solutions,...Show more
    Last updated: 16 days ago • Promoted
    Senior Data Enginer

    Senior Data Enginer

    Tredence Inc. • Bengaluru, Republic Of India, IN
    Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Delta Air Lines • Bengaluru, India
    Design, architect, and optimize Teradata EDW solutions with a focus on performance, scalability, and maintainability.Lead performance tuning efforts using TASM and other workload management tools.D...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arcana • Bengaluru, Republic Of India, IN
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer - Big Data Technologies

    Senior Data Engineer - Big Data Technologies

    Netsmart • Bangalore
    RESPONSIBIITIES : - Design, implement, and optimize complex data pipelines using advanced SQL, ETL tools, and integration technologies. Collaborate with cross-functional teams t...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Publicis Production • Bangalore Urban, Karnataka, India
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Relevance Lab • Bengaluru, Karnataka, India
    Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into robust logical and...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRO • Bengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    London Stock Exchange Group • Bangalore, India
    Senior Data Engineer- Customer Lifecycle Engineering, CMR ABOUT US : LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business.We are de...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer(Big Data)

    Senior Data Engineer(Big Data)

    Andor Tech • Bengaluru, Karnataka, India
    If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC. Work on cutting-edge big data solutions f...Show more
    Last updated: 24 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digital • Bengaluru, Karnataka, India
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zluri • Bengaluru, India
    Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Zluri is a next-gen Identity Governance and Administration (IGA) platform that enables IT and security teams to discover iden...Show more
    Last updated: 21 days ago • Promoted
    AuxoAI - Senior Data Engineer - BigQuery

    AuxoAI - Senior Data Engineer - BigQuery

    hirist.tech • Bangalore
    Note : If shortlisted, you will be invited for initial rounds on 6th December'25 (Saturday) in : AuxoAI is seekin...Show more
    Last updated: 11 days ago • Promoted
    Roku - Big Data Engineer

    Roku - Big Data Engineer

    Roku • Bangalore
    Description : Teamwork makes the stream work.Roku is changing how the world watches TV.Roku is the #1 TV streaming platform in the Cana...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Meril • Bengaluru, Karnataka, India
    We're Hiring : Senior Data Engineer.We are looking for a highly skilled.If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you....Show more
    Last updated: 2 days ago • Promoted
    Senior Big Data Solutions Engineer

    Senior Big Data Solutions Engineer

    SPIRO • Bengaluru, Republic Of India, IN
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 2 days ago • Promoted