Talent.com
This job offer is not available in your country.
5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

USTBengaluru, Karnataka, India
30+ days ago
Job description

Candidates ready to join immediately can share their details via email for quick processing.

CCTC | ECTC | Notice Period | Location Preference

Act fast for immediate attention! ⏳

5+ years if Experienc

e.Roles and Responsibiliti

  • esDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala
  • ).Build data ingestion and transformation frameworks for structured and unstructured data source
  • s.Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solution
  • s.Work with large volumes of data and ensure quality, integrity, and consistenc
  • y.Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or GCP
  • ).Implement data quality checks and automation for ETL / ELT pipeline
  • s.Monitor and troubleshoot data issues in production and perform root cause analysi
  • s.Document technical processes, system designs, and operational procedure

s.Must-Have Skil

  • ls3+ years of experience as a Data Engineer or similar rol
  • e.Hands-on experience wit h PySpa rk o r Spark using Sca l
  • a.Strong knowledge o f S QL for data querying and transformatio
  • n.Experience working wit h any cloud platfo rm (AWS, Azure, or GCP
  • ).Solid understanding of data warehousing concepts and big data architectur
  • e.Experience with version control systems like Gi
  • t.Good-to-Have Skil

  • lsExperience with data orchestration tools lik e Apache Airfl ow , Databricks Workflo ws, or simila
  • r.Knowledge o f Delta La ke , HD FS, o r Kaf k
  • a.Familiarity with containerization tools (Docker / Kubernetes
  • ).Exposure to CI / CD practices and DevOps principle
  • s.Understanding of data governance, security, and compliance standard
  • s.

    Create a job alert for this search

    Cloud Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Software Engineer - Bigdata ( Java or Scala or Python, Spark, SQL, AWS )

    Software Engineer - Bigdata ( Java or Scala or Python, Spark, SQL, AWS )

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

    Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    Ushatech solutionsBengaluru, Karnataka, India
    We’re Hiring : Data Engineer (Core Python, PySpark, Hive, Hadoop).Hybrid – 3 Days / Week from Client Location.The ideal candidate will have strong expertise in. Core Python, PySpark, and Hadoop ecosyst...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    ETL Data Engineer – AWS & Python Specialist

    ETL Data Engineer – AWS & Python Specialist

    EastvantageBangalore Rural, Karnataka, India
    We're Hiring : ETL Data Engineer – AWS & Python Specialist!.We are seeking an experienced ETL Data Engineer to design, develop, and maintain robust data pipelines using AWS cloud services and Python...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritobangalore, karnataka, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

    Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS)

    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 4 hours ago
    • Promoted
    Scala Data Engineer

    Scala Data Engineer

    XebiaBengaluru, Karnataka, India
    We’re Hiring : Scala Data Engineer (Bangalore – Hybrid, 3 days / week in office).Scala, Spark, and Big Data ecosystem.Location : Bangalore (Hybrid – 3 days office / week). Strong problem-solving and debug...Show moreLast updated: 29 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhosur, tamil nadu, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Hands-on development experience on Google Cloud Platform, on.Following Cloud services : Cloud Composer, Big query, Pub sub, Data proc, Data flow, CDAP, Big table, GCS. Hands-on development Experience...Show moreLast updated: 30+ days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USTBengaluru, Karnataka, India
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

    5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

    USTBengaluru, Karnataka, India
    CCTC | ECTC | Notice Period | Location Preference.Act fast for immediate attention! ⏳📩.Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala.Build data ing...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer (Spark Scala)

    Data Engineer (Spark Scala)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Location- Chennai / Pune / Bangalore / Hyderabad / Delhi.Pls find the Job Description below. Big Data Hadoop - Hive and Spark / Scala solid experience.SQL advance kn...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

    Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

    VisaBangalore, Karnataka, India
    Visa is seeking highly energetic, passionate, technology enthusiast for Data Engineering team.The successful candidate will work as a Senior Data Engineer and be part of the Risk Solution Services ...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer | Azure + Databricks

    Data Engineer | Azure + Databricks

    XebiaBengaluru, Karnataka, India
    Job Opportunity – Data Engineer | Azure + Databricks.Bangalore (Whitefield) | Hybrid (3 days office / week).Immediate to 2 weeks – only apply if you can join early. The ideal candidate will have stron...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS).

    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS).

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    SynechronBangalore Urban, Karnataka, India
    We have immediate opportunity for.Data Engineer (Python, Spark / Scala).Data Engineer (Python, Spark / Scala).Notice Period : Immediate joiner only. At Synechron, we believe in the power of digital to tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago