Talent.com
No longer accepting applications
Data Pipeline Architect

Data Pipeline Architect

Xiaomi IndiaBengaluru, Republic Of India, IN
30+ days ago
Job description

Job Description :

  • As a Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure to support our rapidly growing business needs.
  • The ideal candidate will have expertise in Apache Iceberg, Apache Hive, Apache Hadoop, SparkSQL, YARN, HDFS, MySQL, Data Modeling, Data Warehousing, Spark Architecture, and SQL Query Optimization.
  • Experience with Apache Flink, PySpark, Automated Data Quality testing & Data Migration is considered a plus.
  • Also, it's mandatory to know any one cloud stack (AWS or Azure) for Data Engineering to Create Data Jobs and Workflows and Scheduler it later for Automation

Job Responsibilities & Requirements :

  • Bachelor's degree in computer science, Information Technology, or a related field. Master's degree preferred.
  • 4-5 years of experience working as a Data Engineer
  • Mandatory experience in PySpark Development for Big data processing
  • Strong proficiency in Apache Iceberg, Apache Hive, Apache Hadoop, SparkSQL, YARN, HDFS, Data Modeling, and Data Warehousing.
  • Core PySpark Development and Optimizing SQL queries and performance tuning to ensure optimal data retrieval and processing.
  • Experience with Apache Flink, and Automated Data Quality testing is a plus.
  • It's mandatory to know any one cloud stack (AWS or Azure) for Data Engineering to Create Data Jobs and Workflows and Scheduler later for Automation
  • Join Xiaomi India Technology and be part of a team that is shaping the future of technology innovation. Apply now and embark on an exciting journey with us!

    Create a job alert for this search

    Data Pipeline Architect • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Architect

    Data Architect

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Year of Experience- 10 to 15 years.Cloud data warehouse technologies on GCP data platform covering – Cloud Storage, Data Flow, Data Proc, BigQuery, etc. At least one End-to-end GCP data platform imp...Show moreLast updated: 30+ days ago
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.aihosur, tamil nadu, in
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show moreLast updated: 12 days ago
    • Promoted
    AI Data Architect

    AI Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    We are seeking an inventive Data Architect for AI with 8–15 years of experience to lead the strategic design and implementation of enterprise-scale AI solutions. ETL / ELT, Big Data cloud data solutio...Show moreLast updated: 17 days ago
    • Promoted
    Azure Cloud Architect

    Azure Cloud Architect

    Persistent Systemshosur, tamil nadu, in
    We are seeking an experienced Azure Data Cloud Architect to design, implement, and optimize cutting-edge data solutions on Microsoft Azure. You will collaborate with cross-functional teams to transl...Show moreLast updated: 22 days ago
    • Promoted
    Senior Azure Data Engineer (Architect) - Pan India

    Senior Azure Data Engineer (Architect) - Pan India

    Genpacthosur, tamil nadu, in
    We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills. The ideal candidate will have experience and a proven track re...Show moreLast updated: 14 days ago
    • Promoted
    Technical Data Architect

    Technical Data Architect

    GrayMatter Software ServicesBengaluru, Karnataka, India
    We are seeking a highly skilled Technical Architect with 12+ years of experience to oversee and guide the development of advanced data architectures, business intelligence solutions, and ETL workfl...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and consumption.Develop Data Pipelines...Show moreLast updated: 22 days ago
    • Promoted
    Data Architect

    Data Architect

    KPI PartnersBengaluru, Karnataka, India
    KPI Partners is a leading provider of Data Analytics and Business Intelligence solutions, dedicated to helping organizations transform data into actionable insights. We are committed to fostering a ...Show moreLast updated: 22 days ago
    • Promoted
    Data Architect

    Data Architect

    Best Infosystems Ltd.Bengaluru, Karnataka, India
    Data Architect_Full-Time_Trivandrum / Bangalore / Chennai / Kochi.Trivandrum / Bangalore / Chennai / Kochi.Design and implement scalable, secure, and cost-effective data architectures using GCP.Lead the design...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Lead / Architect

    Azure Data Lead / Architect

    TEKsystems Global Services in Indiahosur, tamil nadu, in
    Notice Period : Immediate to15 Days.Please find the below Azure Data Lead / Architect JD.Azure AI skills, Azure Open AI, AI Foundry. Excellent communication and interpersonal skills, with the ability t...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show moreLast updated: 1 day ago
    • Promoted
    Data Architect

    Data Architect

    BrillioBengaluru, Karnataka, India
    Architecting, designing and implementing Modern Data Platforms and Solutions using Microsoft Azure Cloud and understands reference architectures. Deep understanding Data Migration Strategies with 2+...Show moreLast updated: 1 day ago
    • Promoted
    Data Architect

    Data Architect

    DautomBangalore Urban, Karnataka, India
    Data Architecture Design & Strategy : .Lead engagements with the internal stakeholders to understand their data needs and design solutions ensuring data quality and governance.Design the right pipeli...Show moreLast updated: 22 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD Systemshosur, tamil nadu, in
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Architect

    Data Architect

    EXLBengaluru, Karnataka, India
    Locations : {Pune, Gurgaon, Hyderabad, Bangalore} Summary : We are seeking an experienced Azure platform and data architect to build data strategy, architect and design analytics platform leveraging...Show moreLast updated: 15 hours ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    Aayshosur, tamil nadu, in
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    Persistent SystemsBengaluru, Karnataka, India
    We are looking for an experienced and talented Data Architect to join our growing data engineering team.The ideal candidate will have a strong background in working with Python, Pyspark, AWS / Databr...Show moreLast updated: 30+ days ago
    • Promoted
    Solution & Data Architect - Azure Applications

    Solution & Data Architect - Azure Applications

    Infotechtionhosur, tamil nadu, in
    Solution & Data Architect - Azure Applications .Location : India (Remote) | Employment Type : Full-time | Senior - 8-11+ Years of experience. We are seeking an accomplished Solution and Data Architect...Show moreLast updated: 1 day ago