Talent.com
Data Engineer [T500-20906]

Data Engineer [T500-20906]

Delta Air LinesKarnataka, India
2 days ago
Job description

About Delta Tech Hub :

Delta Air Lines (NYSE : DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting the people and cultures of the globe, Delta strives to foster understanding across a diverse world and serve as a force for social good. Delta has fast emerged as a customer-oriented, innovation-led, technology-driven business. The Delta Technology Hub will contribute directly to these objectives. It will sustain our long-term aspirations of delivering niche, IP-intensive, high-value, and innovative solutions. It supports various teams and functions across Delta and is an integral part of our transformation agenda, working seamlessly with a global team to create memorable experiences for customers.

Responsibilities :

Data Pipeline Development and Maintenance :

  • Design, build, and optimize scalable ETL / ELT pipelines to ingest data from diverse sources such as APIs, cloud platforms, and databases.
  • Ensure pipelines are robust, efficient, and capable of handling large volumes of data.

Data Integration and Harmonization :

  • Implement data transformation and enrichment processes to support analytics and reporting needs.
  • Data Quality and Monitoring :

  • Develop and implement data validation and monitoring frameworks to ensure data accuracy and consistency.
  • Troubleshoot and resolve issues related to data quality, latency, or performance.
  • Collaboration with Stakeholders :

  • Partner with cross functional teams, analysts, and data scientists to understand data requirements and translate them into technical solutions.
  • Provide technical support and guidance on data-related issues or projects.
  • Tooling and Automation :

  • Leverage cloud-based solutions and frameworks (e.g., AWS) to streamline processes and enhance automation.
  • Maintain and optimize existing workflows while continuously identifying opportunities for improvement.
  • Documentation and Best Practices :

  • Document pipeline architecture, data workflows, and processes for both technical and non-technical audiences.
  • Follow industry best practices for version control, security, and data governance.
  • Continuous Learning and Innovation :

  • Stay current with industry trends, tools, and technologies in data engineering and marketing analytics.
  • Recommend and implement innovative solutions to improve the scalability and efficiency of data systems.
  • What you need to succeed (minimum qualifications) :

  • Bachelor of Science degree in Computer Science or equivalent
  • Extensive experience with databases and data platforms (AWS preferred)
  • 2+ Hands-on experience in designing, implementing, managing large scale data and ETL solutions utilizing AWS Compute, Storage and database services (S3, Lambda, Redshift, Glue, Athena etc.,)
  • Proficiency in Python, SQL, PySpark
  • 2-3 years of post-degree professional experience as a data engineer developing and maintaining data pipelines
  • Experience in Data Quality, Data Modeling, Data Analytics / BI, Data Enrichment, Security and Governance.
  • Understanding of concepts such as normalization, SCD (Slowly changing dimensions) and CDC (Change data capture)
  • Experience in working on streaming event platforms such as Kafka / Kinesis
  • Strong knowledge of relational and non-relational databases
  • Proficiency in DBT for data transformation and modeling.
  • Good understanding of data warehouses, ETL / ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.,)
  • Strong understanding of orchestration tools such as Airflow
  • Ability to create clean, well-designed code and systems
  • Proven ability to work with large and complex datasets
  • Strong analytical and programming skills with the ability to solve data-related challenges efficiently
  • Strong attention to detail and a commitment to data accuracy.
  • Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment.
  • Excellent communication skills with the ability to present complex data findings to both technical and non-technical audiences.
  • Ability to work collaboratively in a team environment.
  • Behavioral Competencies :

  • Ability to work in collaborative environments and embrace diverse perspectives.??
  • Communicate clearly and concisely, express thoughts and ideas effectively, and embrace cultural differences with respect when engaging with others.?
  • Ability to engage effectively with peers and stakeholders to build strong partnerships.?
  • Prioritize, maintain focus, and consistently deliver commitment.?
  • Proactively understand customer expectations and willingness to create customer-based solutions.?
  • What will give you a competitive edge (preferred qualifications) :

  • Experience working with AWS to develop data pipelines
  • AWS certifications : Solution Architect or Developer Associate
  • Experience migrating data pipelines and systems to modern cloud-based solutions
  • Create a job alert for this search

    Data Engineer • Karnataka, India

    Related jobs
    • Promoted
    Lead Data Engineer [T500-20510]

    Lead Data Engineer [T500-20510]

    ANSRKarnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RAOS INFOSOFT JOIN PRIVATE LIMITEDKarnataka, India
    Looking to hire a data engineer with the following : .Born programmer, Strong in Python frameworks.Strong in SQL and RDBMS concepts. Should join within 1 week from the time interview is scheduled.Idea...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TEKsystemsKarnataka, India
    The position is open with DaaS Core Data Assets Development and Support team, they focus on the serving external customers / clients and the position is open as part of new hiring projection for thei...Show moreLast updated: 2 days ago
    • Promoted
    MarkIT EDM Data Engineer

    MarkIT EDM Data Engineer

    GenpactKarnataka, India
    We are seeking a highly skilled and motivated Senior MarkIT EDM Data Engineer.The ideal candidate will be a self-starter who can work independently and collaborate effectively with both internal an...Show moreLast updated: 2 days ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusKarnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 2 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    ImpetusKarnataka, India
    We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune ...Show moreLast updated: 2 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    BrillioKarnataka, India
    Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through in...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer - Databricks & PySpark

    Data Engineer - Databricks & PySpark

    Capgemini EngineeringKarnataka, India
    Data Engineer – Databricks & PySpark.Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagi...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL DigitalKarnataka, India
    We’re Hiring : Data Engineers – Bangalore.Are you passionate about building your career in Data Engineering? We’re looking for talented. Technical Skills and Platforms : Python, Hadoop, HIVE, Impala, ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Hithonix Solutions Private LimitedKarnataka, India
    About Hithonix Solutions Pvt Ltd : .Hithonix Solutions Pvt Ltd is a forward-looking technology company committed to delivering innovative software solutions that drive business success for our client...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer [T500-20511]

    Senior Data Engineer [T500-20511]

    ANSRKarnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    EVERSANAKarnataka, India
    At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    People Tech Group IncKarnataka, India
    We are Hiring - Data Engineer Bengaluru!.We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects.The ideal candida...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    ConcentrixKarnataka, India
    Concentrix is a technology-enabled global business services company specializing in customer engagement and business performance. With more than 4,00,000 staff, Concentrix is present across 40 count...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cantordust Solutions LLCKarnataka, India
    Preferred : Bangalore (On-site); Alternatives : Mumbai, Kathmandu (On-site).Contract work, with potential for conversion to full time. We are recent MIT graduates experienced in digital transformation...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer (Apache Flink)

    Data Engineer (Apache Flink)

    AMISEQKarnataka, India
    Big Data experience- 3-4 years'.Understanding of production concerns like data consistency, latency, availability, and failure handling.Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroKarnataka, India
    Global Product Company - Established 1969.Job Title : Data Engineer ( Scala ).Job Location : Marathahalli , Bangalore(Hybrid). Strong software design capabilities with a deep understanding of design...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer [T500-19944]

    Data Engineer [T500-19944]

    Delta Air LinesKarnataka, India
    Delta Air Lines (NYSE : DAL) is the U.Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-...Show moreLast updated: 2 days ago