Talent.com
This job offer is not available in your country.
Big Data Developer - Scala / Spark

Big Data Developer - Scala / Spark

Kezan ConsultingBangalore
30+ days ago
Job description

Position : Big Data Engineer (Immediate Joiner)

Experience : 5+ Years

Location : (Gurugram / Bangalore)

Joining : Immediate Joiner

Job Summary :

We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.

The ideal candidate will have expertise in building data pipelines, data warehousing, and data processing applications.

Key Responsibilities :

Data Warehousing :

  • Design, develop, and maintain large-scale data warehouses using Amazon Redshift.
  • Optimize Redshift cluster performance, scalability, and cost-effectiveness.

Data Pipelines :

  • Build and maintain data pipelines using Apache Spark, Scala, and AWS services like S3, Glue, and Lambda.
  • Ensure data quality, integrity, and security across the data pipeline.
  • Data Processing :

  • Develop and optimize data processing applications using Spark, Scala, and AWS services.
  • Work with data scientists and analysts to develop predictive models and perform advanced analytics.
  • AWS Services :

  • Leverage AWS services like S3, Glue, Lambda, and IAM to build scalable and secure data systems.
  • Ensure data systems are highly available, scalable, and and Optimization :
  • Troubleshoot and optimize data pipeline performance issues.
  • Ensure data systems are optimized for cost, performance, and scalability.
  • Requirements :

    Experience : 5+ years of experience in big data engineering or a related field.

    Technical Skills :

  • Proficiency in Amazon Redshift, Apache Spark, and Scala.
  • Experience with AWS services like S3, Glue, Lambda, and IAM.
  • Knowledge of data processing frameworks like Spark and data storage solutions like S3 and Redshift.
  • Data Architecture : Strong understanding of data architecture principles and design patterns.

    Problem-Solving : Excellent problem-solving skills and attention to detail.

    Preferred Qualifications :

    Certifications : AWS Certified Big Data Specialty or similar certifications.

    Machine Learning : Familiarity with machine learning frameworks like Spark MLlib or TensorFlow.

    Agile Methodology : Experience working in agile development environments.

    Data Governance : Experience with data governance, data quality, and data security.

    (ref : hirist.tech)

    Create a job alert for this search

    Big Data Developer • Bangalore

    Related jobs
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careershosur, tamil nadu, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote SeniorAzure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databrick...Show moreLast updated: 8 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Veltrishosur, tamil nadu, in
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLhosur, tamil nadu, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesBengaluru, India
    TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Strategic HR SolutionsBangalore
    Spark Scala Developer Location : Bengaluru, Mumbai Employment Type : Full-time What Were Looking...Show moreLast updated: 29 days ago
    • Promoted
    Senior Manager - Data Engineering Lead

    Senior Manager - Data Engineering Lead

    DIAGEO Indiahosur, tamil nadu, in
    Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field. Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticshosur, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer (Spark Scala)

    Data Engineer (Spark Scala)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Location- Chennai / Pune / Bangalore / Hyderabad / Delhi.Pls find the Job Description below. Big Data Hadoop - Hive and Spark / Scala solid experience.SQL advance kn...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Big Data with Quantexa-Pan India

    Big Data with Quantexa-Pan India

    Tata Consultancy Servicesbangalore, karnataka, in
    We are looking for Big data developer with Quantexa as mandatory skill.Experience Range- 5 to 12 years.Data Engineer - Big Data Hadoop, Spark and Scala. Spark, Scala, Hadoop, HIVE, Oozie, Shell Scri...Show moreLast updated: 14 hours ago
    • Promoted
    Scala Data Engineer

    Scala Data Engineer

    XebiaBengaluru, Karnataka, India
    We’re Hiring : Scala Data Engineer (Bangalore – Hybrid, 3 days / week in office).Scala, Spark, and Big Data ecosystem.Location : Bangalore (Hybrid – 3 days office / week). Strong problem-solving and debug...Show moreLast updated: 27 days ago
    • Promoted
    Big Data Specialist

    Big Data Specialist

    Brilliohosur, tamil nadu, in
    We are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distribute...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIhosur, tamil nadu, in
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 18 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    ImpetusBengaluru, India
    Years of experience : 4 - 7 years.Experience in working on Spark framework, good understanding of core concepts, optimizations, and best practices. Good hands-on experience in writing code in PySpar...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Inchosur, tamil nadu, in
    Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USTbangalore, karnataka, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    2855 - Data Engineer

    2855 - Data Engineer

    EXLhosur, tamil nadu, in
    We are looking for an experienced Data Engineer to drive the development of scalable, secure, and high-performance data solutions. This role requires deep technical expertise in Python, Apache Spark...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgehosur, tamil nadu, in
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 26 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    4Bell TechnologyBangalore
    Job Description : Core Responsibilities : - Design, build, and maintain robust d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemshosur, tamil nadu, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago