Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Delta Air LinesBengaluru, India
30+ days ago
Job description

Responsibilities :

Data Pipeline Development and Maintenance :

  • Build and optimize scalable ETL / ELT pipelines to ingest data from diverse sources such as APIs, cloud platforms, and databases.
  • Ensure pipelines are robust, efficient, and capable of handling large volumes of data.

Data Integration and Harmonization :

  • Implement data transformation and enrichment processes to support analytics and reporting needs.
  • Data Quality and Monitoring :

  • Troubleshoot and resolve issues related to data quality, latency, or performance.
  • Collaboration with Stakeholders :

  • Provide technical support and guidance on data-related issues or projects.
  • Tooling and Automation :

  • Leverage cloud-based solutions and frameworks (e.g., AWS) to streamline processes and enhance automation.
  • Maintain and optimize existing workflows while continuously identifying opportunities for improvement.
  • Documentation and Best Practices :

  • Document pipeline architecture, data workflows, and processes for both technical and non-technical audiences.
  • Follow industry best practices for version control, security, and data governance.
  • Continuous Learning and Innovation :

  • Stay current with industry trends, tools, and technologies in data engineering and marketing analytics.
  • Recommend and implement innovative solutions to improve the scalability and efficiency of data systems.
  • What you need to succeed (minimum qualifications) :

  • Bachelor of Science degree in Computer Science or equivalent
  • At least 2+ years of experience as a data engineer developing and maintaining data pipelines
  • Strong experience with databases and data platforms (AWS preferred)
  • Proficiency in Python, SQL, PySpark
  • Experience in Data Quality, Data Modeling, Data Analytics / BI, Data Enrichment.
  • Understanding of concepts such as normalization, SCD (Slowly changing dimensions) and CDC (Change data capture)
  • Experience in working on streaming event platforms such as Kafka / Kinesis
  • Knowledge of non-relational databases
  • Preferable experience in DBT for data transformation and modeling.
  • Good understanding of data warehouses, ETL / ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.,)
  • Understanding of orchestration tools such as Airflow
  • Ability to create clean, well-designed code and systems
  • Strong attention to detail and a commitment to data accuracy.
  • Proven ability to learn new data models quickly and apply them effectively in a fast-paced environment.
  • Ability to work collaboratively in a team environment.
  • What will give you a competitive edge (preferred qualifications) :

  • Experience working with AWS to develop data pipelines
  • AWS certifications : Solution Architect or Developer Associate
  • Experience migrating data pipelines and systems to modern cloud-based solutions
  • Airline experience is a plus
  • ID : DELRM02

    Create a job alert for this search

    Data Engineer • Bengaluru, India

    Related jobs
    • Promoted
    Data Engineer 2

    Data Engineer 2

    YubiBangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionhosur, tamil nadu, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EVERSANABengaluru, Karnataka, India
    At EVERSANA, we are proud to be certified as a Great Place to Work across the globe.We’re fueled by our vision to create a healthier world. How? Our global team of more than 7,000 employees is commi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TresVistaBengaluru, Karnataka, India
    TresVista is a global enterprise whose business model is built to deliver enduring value.TresVista combines best practices, technology-enabled execution, and industry-leading talent to drive meanin...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    The Customization GroupBengaluru, Karnataka, India
    An information technology firm that provides consulting services in IT, software, and advanced areas such as Artificial Intelligence. By leveraging latest technologies, we offer.We have a brand-new ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgebangalore district, karnataka, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 27 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + Companyhosur, tamil nadu, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 18 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    SynechronBengaluru, Karnataka, India
    We have immediate opportunity for Data Engineer.Job Location : Synechron ( Bengaluru).Notice : Only immediate joiner.At Synechron, we believe in the power of digital to transform businesses for the ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SelectorBengaluru, Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.AI / ML-based analytics approach, the platform provides actionable multi-dimensional. It enables operations teams t...Show moreLast updated: 16 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsBengaluru, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceshosur, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 5 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIhosur, tamil nadu, in
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseBengaluru, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsBangalore, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 8 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansbangalore, karnataka, in
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TELUS Digital AI Data Solutionsbangalore, karnataka, in
    TELUS Digital (TD) Experience partners with the world’s most innovative brands, from tech startups to industry leaders in fintech, gaming, healthcare, and more. We empower businesses to scale and re...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Inchosur, tamil nadu, in
    Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXBengaluru, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago