Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

Delta Air LinesBengaluru, India
30+ days ago
Job description

Responsibilities :

Data Pipeline Development and Maintenance :

  • Build and optimize scalable ETL / ELT pipelines to ingest data from diverse sources such as APIs, cloud platforms, and databases.
  • Ensure pipelines are robust, efficient, and capable of handling large volumes of data.

Data Integration and Harmonization :

  • Implement data transformation and enrichment processes to support analytics and reporting needs.
  • Data Quality and Monitoring :

  • Troubleshoot and resolve issues related to data quality, latency, or performance.
  • Collaboration with Stakeholders :

  • Provide technical support and guidance on data-related issues or projects.
  • Tooling and Automation :

  • Leverage cloud-based solutions and frameworks (e.g., AWS) to streamline processes and enhance automation.
  • Maintain and optimize existing workflows while continuously identifying opportunities for improvement.
  • Documentation and Best Practices :

  • Document pipeline architecture, data workflows, and processes for both technical and non-technical audiences.
  • Follow industry best practices for version control, security, and data governance.
  • Continuous Learning and Innovation :

  • Stay current with industry trends, tools, and technologies in data engineering and marketing analytics.
  • Recommend and implement innovative solutions to improve the scalability and efficiency of data systems.
  • What you need to succeed (minimum qualifications) :

  • Bachelor of Science degree in Computer Science or equivalent
  • At least 3+ years of experience as a data engineer developing and maintaining data pipelines
  • Strong experience with databases and data platforms (AWS preferred)
  • Proficiency in Python, SQL, PySpark
  • Experience in Data Quality, Data Modeling, Data Analytics / BI, Data Enrichment.
  • Understanding of concepts such as normalization, SCD (Slowly changing dimensions) and CDC (Change data capture)
  • Experience in working on streaming event platforms such as Kafka / Kinesis
  • Knowledge of non-relational databases
  • Preferable experience in DBT for data transformation and modeling.
  • Good understanding of data warehouses, ETL / ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.,)
  • Understanding of orchestration tools such as Airflow
  • Ability to create clean, well-designed code and systems
  • Strong attention to detail and a commitment to data accuracy.
  • Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment.
  • Ability to work collaboratively in a team environment.
  • What will give you a competitive edge (preferred qualifications) :

  • Experience working with AWS to develop data pipelines
  • AWS certifications : Solution Architect or Developer Associate
  • Experience migrating data pipelines and systems to modern cloud-based solutions
  • Airline experience is a plus
  • ID : DELRM04

    Create a job alert for this search

    Senior Data Engineer • Bengaluru, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyBangalore Urban, Karnataka, India
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESBangalore, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CybleBengaluru, Karnataka, India
    We are a fast-growing technology company building scalable, data-driven solutions across multiple domains.Our teams leverage modern pipelines, cloud-native infrastructure, and advanced analytics to...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainBengaluru, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RecroBengaluru, Karnataka, India
    Create and maintain optimal data pipeline architecture.Create and maintain events / streaming based architecture / design. Identify, design, and implement internal process improvements : automating manua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Veltrishosur, tamil nadu, in
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 21 days ago
    • Promoted
    Senior Engineer Data [T500-20496]

    Senior Engineer Data [T500-20496]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc. Our well-known banners across the United Sta...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.bangalore, karnataka, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AvathonBengaluru, Karnataka, India
    AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    JRD SystemsBengaluru, Karnataka, India
    This role is critical to both the development of new data products and the modernization of existing platforms.The ideal candidate is a seasoned data engineer with hands-on experience designing, bu...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SMC Squared IndiaBengaluru, Karnataka, India
    This position is responsible for the design, development, and deployment of extraction, transformation, and load (ETL) processes and methodologies to satisfy corporate data movements across various...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CareerXperts ConsultingBengaluru, IN
    We are looking for a highly skilled.The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientist...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Grid DynamicsBengaluru, Karnataka, India
    Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    AccoladeBengaluru, Karnataka, India
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eagle Eye NetworksBengaluru, Karnataka, India
    Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more efficient and...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Publicis ProductionBengaluru, Karnataka, India
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Net Zero Insightshosur, tamil nadu, in
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Confidential JobsBangalore, IN
    This role involves collaborating with cross-functional teams to ensure data reliability, scalability, and performance.The candidate will work closely with data scientists, analysts and software eng...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SG AnalyticsBengaluru, Karnataka, India
    The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficie...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MastekBengaluru, Karnataka, India
    Role : Data Engineer – Databricks.We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it...Show moreLast updated: 24 days ago