Talent.com
Data Pipeline Architect
Data Pipeline ArchitectANSR • Bengaluru, Republic Of India, IN
Data Pipeline Architect

Data Pipeline Architect

ANSR • Bengaluru, Republic Of India, IN
13 days ago
Job description

About American Airlines :

To Care for People on Life's Journey®. Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in more than 60 countries.

American Airlines is transforming the way it delivers technology to its customers and team members worldwide.

American’s Tech Hub in Hyderabad, India, is our latest technology office location and home to team members who drive technical innovation and engineer unrivalled digital products to best serve American’s customers and team members. With U.S. tech hubs in Dallas-Fort Worth, Texas and Phoenix, Arizona, our new team in Hyderabad, India enables better support of our 24 / 7 operation and positions American to deliver industry-leading technology solutions that create a world-class customer experience.

Engineer, IT Data

INTRO :

Are you ready to explore a world of possibilities, both at work and during your time off? Join our American Airlines family, and you’ll travel the world, grow your expertise, and become the best version of you. As you embark on a new journey, you’ll tackle challenges with flexibility and grace, learning new skills and advancing your career while having the time of your life. Feel free to enrich both your personal and work life and hop onboard!

WHY YOU WILL LOVE THIS JOB :

  • As one diverse, high-performing team dedicated to technical excellence, you will focus relentlessly on delivering unrivaled digital products that drive a more reliable and profitable airline.
  • The Data Domain refers to the area within Information Technology that focuses on managing and leveraging data as a strategic asset. This includes data management, storage, integration and governance. The Data domain leans into Machine Learning and AI, as well as Data Science and Business Intelligence.

This list is intended to reflect the current job but there may be additional essential functions (and certainly non-essential job functions) that are not referenced. Management will modify the job or require other tasks be performed whenever it is deemed appropriate to do so, observing, of course, any legal obligations including any collective bargaining obligations.

  • Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions
  • Implement data migration and data engineering solutions using Azure products and services : (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools
  • Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support
  • Provide technical leadership and collaborate within a team environment as well as work independently
  • Be a part of a DevOps team that completely owns and supports their product
  • Implement batch and streaming data pipelines using cloud technologies
  • Leads development of coding standards, best practices and privacy and security guidelines
  • Mentors' others on technical and domain skills to create multi-functional teams
  • ALL YOU WILL NEED FOR SUCCESS

    Minimum Qualifications :

  • Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS / MIS), Engineering or related technical discipline, or equivalent experience / training
  • 3+ years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
  • 3+ years data analytics experience using SQL
  • 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
  • Preferred Qualification :

  • 3+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
  • 3+ years data analytics experience using SQL
  • 3+ years full-stack development experience, preferably in Azure
  • 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
  • Airline Industry Experience
  • 3+ years of Teradata Vantage development and administration
  • Skills, Licenses, and Certifications :

  • Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers
  • Expertise in providing practical direction within the Azure Native cloud services
  • Azure Development Track Certification (preferred)
  • Spark Certification (preferred)
  • Combination of Development, Administration & Support experience in several of the following tools / platforms required :
  • Scripting : Python, Spark, Unix, SQL
  • Data Platforms : Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake
  • Azure Data Explorer Administration skills a plus
  • Azure Cloud Technologies : Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions
  • CI / CD : GitHub, Jenkins, Azure DevOps, Terraform
  • BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana
  • Data Governance and Privacy : Alation, Monte Carlo, Informatica and BigID
  • Create a job alert for this search

    Data Pipeline Architect • Bengaluru, Republic Of India, IN

    Related jobs
    Data Architect

    Data Architect

    Tredence Inc. • Bangalore Urban, Karnataka, India
    IT experience and 7+ years' experience in SQL Server, SSIS, SQL, Python / C#, ETL, Streaming.Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL p...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Veca Consulting Pvt Ltd • Bengaluru, Republic Of India, IN
    Location : Bangalore(No relocation).Notice Period : 20-30 days(who are currently serving).As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable ...Show more
    Last updated: 6 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Omni Recruit Private Limited • Bengaluru, Republic Of India, IN
    This role requires writing optimised and scalable Advanced SQL, Python codes and scripts with.At a fundamental level, the responsible person should be able to dive. Being in a startup, playing with ...Show more
    Last updated: 2 days ago • Promoted
    Data Architect

    Data Architect

    Tech Mahindra • hosur, tamil nadu, in
    Strong experience architecting and delivering.Proficiency in Azure services including.Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, Azure Databricks.Python, Spark, or relate...Show more
    Last updated: 16 days ago • Promoted
    Data Architect

    Data Architect

    Recro • hosur, tamil nadu, in
    Central Data Office – Data Architect.SMEs, engineers, and developers to design and govern enterprise-level data architectures, ensuring alignment with corporate data principles and standards.This p...Show more
    Last updated: 16 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Mastek • Bengaluru, Republic Of India, IN
    Work closely with our data science team to help build complex algorithms that provide unique insights into our data.Use agile software development processes to make iterative improvements to our ba...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
    Last updated: 16 days ago • Promoted
    Data Architect

    Data Architect

    Brillio • Bengaluru, Karnataka, India
    We are looking for a highly skilled.The ideal candidate will combine strong technical capabilities with architectural oversight, ensuring efficient, scalable, and governed AWS data ecosystems.Exper...Show more
    Last updated: 16 days ago • Promoted
    Data Architect (Adobe AEP)

    Data Architect (Adobe AEP)

    RibbitZ LLC • Bangalore, IN
    Define overall AEP data architecture, schemas (XDM), and identity strategy.Design and oversee ingestion pipelines (batch, streaming, APIs). Ensure data quality, scalability, and governance across da...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Data Architect - Snowflake

    Senior Data Architect - Snowflake

    Reflections Info Systems • hosur, tamil nadu, in
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show more
    Last updated: 1 day ago • Promoted
    Data Architect

    Data Architect

    Andela • Bangalore, IN
    Andela exists to connect brilliance and opportunity.Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations ...Show more
    Last updated: 2 days ago • Promoted
    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Sky Systems, Inc. (SkySys) • hosur, tamil nadu, in
    Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire). Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show more
    Last updated: 20 hours ago • Promoted • New!
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Bengaluru, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 7 days ago • Promoted
    GCP Data Architect

    GCP Data Architect

    Lykora Consulting Services Private Limited • Bangalore, IN
    GCP Architecture, Data Platform Design, DevOps, Security, Cloud Infrastructure.Leads architecture and delivery of enterprise data platforms on GCP, ensuring scalability, compliance, and performance...Show more
    Last updated: 22 hours ago • Promoted • New!
    Data Architect

    Data Architect

    Genisys Group • Bengaluru, Karnataka, India
    The Data Lead / Data Architect will own the vision, design, and delivery of cutting-edge enterprise data platforms and modern analytics solutions across public clouds and hybrid infrastructures.This ...Show more
    Last updated: 3 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Sigmoid • Bengaluru, Republic Of India, IN
    We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.You will be responsible for designing, implementing, and maintaining data pipelines to support our organization'...Show more
    Last updated: 14 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • hosur, tamil nadu, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 9 days ago • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • hosur, tamil nadu, in
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 2 days ago • Promoted