Talent.com
This job offer is not available in your country.
Data Engineer [T500-20906]

Data Engineer [T500-20906]

Delta Air LinesAgra, IN
21 hours ago
Job description

About Delta Tech Hub :

Delta Air Lines (NYSE : DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good. Delta has fast emerged as a customer-oriented, innovation-led, technology-driven business. The Delta Technology Hub will contribute directly to these objectives. It will sustain our long-term aspirations of delivering niche, IP-intensive, high-value, and innovative solutions. It supports various teams and functions across Delta and is an integral part of our transformation agenda, working seamlessly with a global team to create memorable experiences for customers.

Responsibilities :

Data Pipeline Development and Maintenance :

  • Design, build, and optimize scalable ETL / ELT pipelines to ingest data from diverse sources such as APIs, cloud platforms, and databases.
  • Ensure pipelines are robust, efficient, and capable of handling large volumes of data.

Data Integration and Harmonization :

  • Implement data transformation and enrichment processes to support analytics and reporting needs.
  • Data Quality and Monitoring :

  • Develop and implement data validation and monitoring frameworks to ensure data accuracy and consistency.
  • Troubleshoot and resolve issues related to data quality, latency, or performance.
  • Collaboration with Stakeholders :

  • Partner with cross functional teams, analysts, and data scientists to understand data requirements and translate them into technical solutions.
  • Provide technical support and guidance on data-related issues or projects.
  • Tooling and Automation :

  • Leverage cloud-based solutions and frameworks (e.g., AWS) to streamline processes and enhance automation.
  • Maintain and optimize existing workflows while continuously identifying opportunities for improvement.
  • Documentation and Best Practices :

  • Document pipeline architecture, data workflows, and processes for both technical and non-technical audiences.
  • Follow industry best practices for version control, security, and data governance.
  • Continuous Learning and Innovation :

  • Stay current with industry trends, tools, and technologies in data engineering and marketing analytics.
  • Recommend and implement innovative solutions to improve the scalability and efficiency of data systems.
  • What you need to succeed (minimum qualifications) :

  • Bachelor of Science degree in Computer Science or equivalent
  • Extensive experience with databases and data platforms (AWS preferred)
  • 2+ Hands-on experience in designing, implementing, managing large scale data and ETL solutions utilizing AWS Compute, Storage and database services (S3, Lambda, Redshift, Glue, Athena etc.,)
  • Proficiency in Python, SQL, PySpark
  • 2-3 years of post-degree professional experience as a data engineer developing and maintaining data pipelines
  • Experience in Data Quality, Data Modeling, Data Analytics / BI, Data Enrichment, Security and Governance.
  • Understanding of concepts such as normalization, SCD (Slowly changing dimensions) and CDC (Change data capture)
  • Experience in working on streaming event platforms such as Kafka / Kinesis
  • Strong knowledge of relational and non-relational databases
  • Proficiency in DBT for data transformation and modeling.
  • Good understanding of data warehouses, ETL / ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.,)
  • Strong understanding of orchestration tools such as Airflow
  • Ability to create clean, well-designed code and systems
  • Proven ability to work with large and complex datasets
  • Strong analytical and programming skills with the ability to solve data-related challenges efficiently
  • Strong attention to detail and a commitment to data accuracy.
  • Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment.
  • Excellent communication skills with the ability to present complex data findings to both technical and non-technical audiences.
  • Ability to work collaboratively in a team environment.
  • Behavioral Competencies :

  • Ability to work in collaborative environments and embrace diverse perspectives.??
  • Communicate clearly and concisely, express thoughts and ideas effectively, and embrace cultural differences with respect when engaging with others.?
  • Ability to engage effectively with peers and stakeholders to build strong partnerships.?
  • Prioritize, maintain focus, and consistently deliver commitment.?
  • Proactively understand customer expectations and willingness to create customer-based solutions.?
  • What will give you a competitive edge (preferred qualifications) :

  • Experience working with AWS to develop data pipelines
  • AWS certifications : Solution Architect or Developer Associate
  • Experience migrating data pipelines and systems to modern cloud-based solutions
  • Create a job alert for this search

    Data Engineer • Agra, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeAgra, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaAgra, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXAgra, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsAgra, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 25 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsAgra, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainAgra, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ATOM Systems Private LimitedAgra, IN
    We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 2 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsAgra, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jade Business Services (JBS)Agra, IN
    Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseAgra, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesAgra, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Tytan Technology Inc.Agra, IN
    Please apply directly or send your resume to.The ideal candidate will have deep expertise in.Design and develop scalable, efficient, and reliable. Architect and implement modern.Work closely with bu...Show moreLast updated: 21 hours ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLAgra, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Magma ConsultancyAgra, IN
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 21 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsAgra, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyAgra, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadAgra, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalAgra, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncAgra, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisAgra, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 2 days ago