Talent.com
This job offer is not available in your country.
Engineer (Spark, SparkSQL)

Engineer (Spark, SparkSQL)

Anicalls (Pty) Ltdnoida, India
14 hours ago
Job description
  • 2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform
  • Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)
  • Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
  • Unix Shell Scripting and setting up CRON
  • Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
  • Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller).
  • Prior Experience in Consumer Banking Domain is an advantage.
  • Prior Experience in the agile delivery method is an advantage.
  • Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
  • Core Java skillset is an added advantage. Airflow is an added advantage.
  • Good Knowledge and Experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus.
  • Create a job alert for this search

    Engineer Spark • noida, India

    Related jobs
    • Promoted
    Databricks SQL Engineer with Commercial Pharma

    Databricks SQL Engineer with Commercial Pharma

    KeasisDelhi, IN
    Job Title : Databricks SQL Engineer with Commercial Pharma.We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL.The ideal candidate will ...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Software Engineer (Java / Scala, Spark, SQL, AWS, Kubernetes)

    Software Engineer (Java / Scala, Spark, SQL, AWS, Kubernetes)

    The Nielsen CompanyGurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Database Administrator (PostgreSQL | AWS | ETL | Snowflake)

    Senior Database Administrator (PostgreSQL | AWS | ETL | Snowflake)

    CESMeerut, IN
    We are seeking a highly skilled and proactive Senior Database Administrator to join our.This hybrid role blends traditional DBA responsibilities with modern data. Comparative data loads and ensure o...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    AWS – Data Engineer

    AWS – Data Engineer

    Epergne Solutionsgurgaon, India
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFormati...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Sr. Hadoop Spark / Scala Engineer

    Sr. Hadoop Spark / Scala Engineer

    Anicalls (Pty) Ltdnoida, India
    Coordinate Development, Integration, and Production deployments.Optimize Spark code, Impala queries, and Hive partitioning strategy for better scalability, reliability, and performance.Build applic...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen CompanyGurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata (Java / Scala, Spark, Python, AWS )

    Senior Software Engineer - Bigdata (Java / Scala, Spark, Python, AWS )

    The Nielsen CompanyGurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Java Spark Lead associate

    Java Spark Lead associate

    Anicalls (Pty) Ltdnoida, India
    Hadoop, Spark, and Big Data platforms, RBDMS, NoSQL).Advanced SQL capabilities are required.Good Knowledge of database design techniques and experience working with huge data volumes is a plus.Expe...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritogurugram, uttar pradesh, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    PostgreSQL Lead Engineer

    PostgreSQL Lead Engineer

    Anicalls (Pty) Ltdnoida, India
    Experience with log aggregation / dashboarding, monitoring, and alerting systems.SQL code review to ensure queries are optimized and tuned to perform efficiently before the production release.Expert-...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Sr. Spark Assoc. Developer

    Sr. Spark Assoc. Developer

    Anicalls (Pty) Ltdnoida, India
    Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.Proficiency working with large data stores. Test Driven Development (TDD) or Pair Programming.Deep unders...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalfaridabad, haryana, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen Companygurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Azure Data Spark

    Azure Data Spark

    Anicalls (Pty) Ltdnoida, India
    Technical, organizational, and cultural leadership for the team.Build the team by hiring individual contributors, ensuring a healthy mix of talent across seniority, styles, and backgrounds.As a mem...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesDelhi, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    Senior Spark / Cassandra Analyst

    Senior Spark / Cassandra Analyst

    Anicalls (Pty) Ltdnoida, India
    Analyze, design, program, debug, and modify software enhancements and / or new products used in local, networked, or Internet-related computer programs, primarily for end-users.Write code and complet...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Delhi, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago