Talent.com
This job offer is not available in your country.
Big Data Developer - Scala / Spark

Big Data Developer - Scala / Spark

Kezan ConsultingGurgaon
30+ days ago
Job description

Position : Big Data Engineer (Immediate Joiner)

Experience : 5+ Years

Location : (Gurugram / Bangalore)

Joining : Immediate Joiner

Job Summary :

We're seeking an experienced Senior Big Data Engineer with 5+ years of experience in designing, developing, and implementing large-scale data systems using Redshift, AWS, Spark, and Scala.

The ideal candidate will have expertise in building data pipelines, data warehousing, and data processing applications.

Key Responsibilities :

Data Warehousing :

  • Design, develop, and maintain large-scale data warehouses using Amazon Redshift.
  • Optimize Redshift cluster performance, scalability, and cost-effectiveness.

Data Pipelines :

  • Build and maintain data pipelines using Apache Spark, Scala, and AWS services like S3, Glue, and Lambda.
  • Ensure data quality, integrity, and security across the data pipeline.
  • Data Processing :

  • Develop and optimize data processing applications using Spark, Scala, and AWS services.
  • Work with data scientists and analysts to develop predictive models and perform advanced analytics.
  • AWS Services :

  • Leverage AWS services like S3, Glue, Lambda, and IAM to build scalable and secure data systems.
  • Ensure data systems are highly available, scalable, and and Optimization :
  • Troubleshoot and optimize data pipeline performance issues.
  • Ensure data systems are optimized for cost, performance, and scalability.
  • Requirements :

    Experience : 5+ years of experience in big data engineering or a related field.

    Technical Skills :

  • Proficiency in Amazon Redshift, Apache Spark, and Scala.
  • Experience with AWS services like S3, Glue, Lambda, and IAM.
  • Knowledge of data processing frameworks like Spark and data storage solutions like S3 and Redshift.
  • Data Architecture : Strong understanding of data architecture principles and design patterns.

    Problem-Solving : Excellent problem-solving skills and attention to detail.

    Preferred Qualifications :

    Certifications : AWS Certified Big Data Specialty or similar certifications.

    Machine Learning : Familiarity with machine learning frameworks like Spark MLlib or TensorFlow.

    Agile Methodology : Experience working in agile development environments.

    Data Governance : Experience with data governance, data quality, and data security.

    (ref : hirist.tech)

    Create a job alert for this search

    Big Data Developer • Gurgaon

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLDelhi, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentDelhi, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyDelhi, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 18 days ago
    • Promoted
    Data Architect

    Data Architect

    InfoBeansDelhi, IN
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Big Data with Quantexa-Pan India

    Big Data with Quantexa-Pan India

    Tata Consultancy ServicesGhaziabad, IN
    We are looking for Big data developer with Quantexa as mandatory skill.Experience Range- 5 to 12 years.Data Engineer - Big Data Hadoop, Spark and Scala. Spark, Scala, Hadoop, HIVE, Oozie, Shell Scri...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DexianDelhi, IN
    We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract. Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeDelhi, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaDelhi, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 5 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudDelhi, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainDelhi, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekDelhi, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesGhaziabad, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisDelhi, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Delhi, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeDelhi, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Owner

    Senior Data Owner

    iVoyantDelhi, IN
    One of my leading MNC clients is looking for an experienced Senior Data Owner to oversee the Data & Analytics pillar of their FinCrime Platform. This is a high-visibility role where you’ll be part o...Show moreLast updated: 6 days ago
    • Promoted
    Backend Developer / Data Scraping / Kubernetes

    Backend Developer / Data Scraping / Kubernetes

    Daply | Scaling Digital PublishingDelhi, IN
    IN ORDER TO BE CONSIDERED FOR THIS ROLE, YOU MUST SUBMIT AN APPLICATION HERE : .Web Scraping / Captcha Control.Show moreLast updated: 7 days ago