Talent.com
Senior Data Engineer - Big Data Technologies
Senior Data Engineer - Big Data TechnologiesAndor Tech(India) Pvt Ltd • Bangalore
Senior Data Engineer - Big Data Technologies

Senior Data Engineer - Big Data Technologies

Andor Tech(India) Pvt Ltd • Bangalore
30+ days ago
Job description

Job Description : Accountabilities :

  • Understands the business vision from the data solutions and works with all project stakeholders to enable that.
  • Works alongside multiple other project team members to drive towards the common goal.
  • Helps the business analysts to create data mapping documents that define the end to end pipeline.
  • Builds and delivers data pipelines that ingests data (structured and unstructured) from multiple sources into the target data lake.
  • Builds the data management layer in line with the business needs and standards defines.
  • Triages problems in the pipelines or data layers and effectively fixes them based on the priority.
  • Automates data loading during initial or incremental loads.
  • Supports the run and maintain team during critical issues and helps them in faster resolution.

Dimensions :

A key element of this role is to work along with Trading and Supply teams in delivering an enterprise solution in data engineering area. This will mostly include green field implementation of data analytics solutions delivering high value to customer.

Special Challenges :

  • As a data engineer responsible for effectively handling data and deriving value out of it.
  • Responsible for providing innovative solutions that are best in class but also quick to market.
  • No direct reports. But is self-driven and can independently handle the work assigned.
  • Drive effective best practices across multiple initiatives and teams and be innovative and influential in managing constraints.
  • Requirements :

  • 4 + years of IT industry experience, with at least 2 years on Big data technologies.
  • Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
  • Has worked on real data challenges and handled huge volume, velocity and variety of data.
  • Understands Infrastructure concepts and has worked with multiple cloud tenants.
  • Proficient with data warehousing and traditional ETL technologies.
  • Strong experience in writing stored procedure, functions and triggers in SQL.
  • Strong experience on Azure ecosystem and has worked with data management on Databricks, ADF, Blob Store, ADLS etc.
  • Implement complex data processing algorithms in real time in and efficient manner using Spark and other technologies.
  • Knowledge on data analytics area using Visualization and data modelling tools.
  • Excellent analytical & problem-solving skills, willingness to take ownership and resolve technical challenges.
  • Excellent communication and stakeholder management skills
  • Industry certification in Data Engineering is an added advantage. technical skills like Pyspark , Azure etc
  • Mandatory skills :

  • AWS / Azure / SAP - Master
  • ELT - Master
  • Data Modeling - Master
  • Data Integration & Ingestion - Skill
  • Data Manipulation and Processing - Skill
  • GITHUB, Action, Azure DevOps - Skill
  • Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest - Skill
  • Roles and Responsibilities :

    The Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization, not just within IT teams, but also in the wider Business stakeholder community. A Senior Data engineer is expected to be a subject matter expert, who design & build data solutions and mentor junior engineers. They are also the key drivers to convert Vison and Data Strategy for IT solutions and deliver.

    Key Characteristics :

  • Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions.
  • Deep data focus with expertise in technology domain
  • A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff.
  • Actively delivers the roll-out and embedding of Data Foundation initiatives in support of
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Bangalore

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Nityo Infotech • Bengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zluri • Bengaluru, Karnataka, India
    Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Identity Governance and Administration (IGA) platform that enables IT and security teams to discover identities and applicati...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Bangalore, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Delta Air Lines • Bengaluru, India
    Design, architect, and optimize Teradata EDW solutions with a focus on performance, scalability, and maintainability.Lead performance tuning efforts using TASM and other workload management tools.D...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Relevance Lab • Bengaluru, Karnataka, India
    Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into robust logical and...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Acuity Knowledge Partners • Bengaluru, Karnataka, India
    The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of ...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer I

    Data Engineer I

    Licious • Greater Bengaluru Area, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    VIDA Digital Identity • Greater Bengaluru Area, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cargill • Bengaluru, Karnataka, India
    Job Purpose and Impact - The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasur...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • hosur, tamil nadu, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer(Big Data)

    Senior Data Engineer(Big Data)

    Andor Tech • Bengaluru, Karnataka, India
    If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC. Work on cutting-edge big data solutions f...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer - Databricks

    Senior Data Engineer - Databricks

    Tredence Inc. • Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digital • Bengaluru, Karnataka, India
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ADM • Bengaluru, India
    Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an ...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arcana • Greater Bengaluru Area, India
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • Bangalore, IN
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer – Orchestration Infrastructure

    Senior Data Engineer – Orchestration Infrastructure

    Out Of The Blue • hosur, tamil nadu, in
    Out of the Blue is building an agentic AI platform to help eCommerce brands scale smarter and protect revenue.Our platform proactively detects and acts on what breaks growth—misfiring pixels, broke...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • hosur, tamil nadu, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day ago • Promoted