Talent.com
This job offer is not available in your country.
Senior Data Analyst - Apache Spark

Senior Data Analyst - Apache Spark

Ivy comptechhyderabad, India
19 hours ago
Job description

About The Role

As Senior Data Analyst will contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders.

Key Responsibilities :  Strong understanding on Apache Druid and Apache Hadoop Architecture.

Ability to learn new tools, languages and operating systems.

Firm understanding of database systems - data modelling, SQL and transactional processing.

Hands-on experience with Kafka for batch and streaming data ingestion to pull data from different RDBMS sources into the HDFS

Preferred experience in Spark / Druid Stream processing.

Experience in writing SQL queries.

Experience in working with relational databases and integrating with Hadoop infrastructure.

  • Skills Required :  3 to 5~ years of strong hands on real time big data development experience in Hadoop, Hive, Kafka, Druid.

Experience in managing and setting up Production scale  Druid and Hadoop clusters  with HA.

Experience in working with relational databases and integrating with Hadoop infrastructure.

Good understanding in Data Modeling and SQL.

Hands-on experience with Sqoop / Kafka for batch and streaming data ingestion to pull data from different RDBMS sources into the HDFS.

Preferred experience in Druid Stream processing.

Hands on experience with Distributed messaging system Apache Kafka.

Explore various big data technologies to design new product architectures and POC's for same.

  • Experience with data systems, analytics(Apache Hadoop, Spark,Hive), streaming (Apache Flink, Spark, Kafka) distributed query engines and databases(Apache Druid).
  • Primary Skills :
  • Hadoop, Druid, Kafka, SQL

    Qualifications : Any Graduate

    Location Hyderabad, India

    Additional Information Not Specified

    Create a job alert for this search

    Senior Data Analyst • hyderabad, India

    Related jobs
    • Promoted
    Senior Data Analyst

    Senior Data Analyst

    Recrohyderabad, telangana, in
    Proven experience with patient and / or payer data management solutions in the US pharmaceutical market.Microsoft Office suite (PowerPoint, Word). HIPAA-compliant data management experience.Experience...Show moreLast updated: 19 days ago
    • Promoted
    Value Momentum Software - Senior Data Analyst

    Value Momentum Software - Senior Data Analyst

    ValuemomentumHyderabad
    Job Responsibilities : - Utilize knowledge of insurance data models, specifically Guidewire and Duckcreek, to interpret and analyze complex data structures.Collaborat...Show moreLast updated: 30+ days ago
    • Promoted
    Dun & Bradstreet - Data Engineer - Spark / Hadoop

    Dun & Bradstreet - Data Engineer - Spark / Hadoop

    DUN BRADSTREET TECHNOLOGY AND CORPORATE SERVICESHyderabad
    Why We Work at Dun & Bradstreet : Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow.Each da...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    StraiveHyderabad, Telangana, India
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 4 days ago
    • Promoted
    Data Analyst (Hadoop)

    Data Analyst (Hadoop)

    Tata Consultancy Servicesshyderabad, telangana, in
    The ideal candidate should have strong analytical skills and experience working with large datasets to generate insights and support business decision-making. Collect, clean, and analyze large datas...Show moreLast updated: 9 days ago
    • Promoted
    Senior Scala / Spark Developer

    Senior Scala / Spark Developer

    Cyanous Software Private LimitedHyderabad
    Key Responsibilities : - Design, develop, and maintain data processing applications using Scala and Apache Spark.Collaborate with cross-functional ...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Analyst

    Senior Data Analyst

    Elife TransferHyderabad, IN
    At Hoppa & Elife, we’re unifying all ground transportation into one powerful marketplace, giving travellers the freedom to book airport transfers, ride-hailing, shared shuttles, private cars, and t...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIHyderabad, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Senior Analyst - Data Integration

    Senior Analyst - Data Integration

    HolmanHyderabad, India
    Services vibrant tech Center in Hyderabad, you will have the opportunity to contribute to technology innovation for Holman Automotive, a leading American fleet management and automotive services co...Show moreLast updated: 30+ days ago
    • Promoted
    Unify Technologies - Spark / Scala Developer - Data Analytics

    Unify Technologies - Spark / Scala Developer - Data Analytics

    UNIFY TECHNOLOGIES PVT LTDHyderabad
    Job Description : We are looking for a candidate with strong experience into Spark with Scala with M...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Analyst / Engineer

    Senior Data Analyst / Engineer

    Milestone Technologies, Inc.Hyderabad, IN
    This role will ensure data ingested from manufacturing systems into Client's data lake and downstream applications (e.The successful candidate will work directly with. Identify gaps, missing values,...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Analyst

    Senior Data Analyst

    ValueMomentumHyderabad, Telangana, India
    Location : Hyderabad / Pune / Coimbatore.We are looking for a skilled Guidewire Data Analyst to support data management, analysis, and reporting needs within Guidewire-based insurance platforms.The idea...Show moreLast updated: 28 days ago
    • Promoted
    Spark / Scala Developer

    Spark / Scala Developer

    Cyanous Software Private LimitedHyderabad
    Detailed JD (Roles and Responsibilities) : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, ...Show moreLast updated: 30+ days ago
    • Promoted
    Digital Solution Analyst - Senior Data Engineer

    Digital Solution Analyst - Senior Data Engineer

    MindSource TechnologiesHyderabad
    Job Description : We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team.In this role, you will lead the design and implem...Show moreLast updated: 13 days ago
    • Promoted
    Unify Technologies - Spark / Scala Developer - Data Engineering

    Unify Technologies - Spark / Scala Developer - Data Engineering

    UNIFY TECHNOLOGIES PVT LTDHyderabad
    Spark Core / Streaming with programming language Scala also in Machine Learing OR AI, Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism / te...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Analyst - Application Development

    Senior Analyst - Application Development

    HolmanHyderabad, India
    Services vibrant tech Center in Hyderabad, you will have the opportunity to contribute to technology innovation for Holman Automotive, a leading American fleet management and automotive services co...Show moreLast updated: 30+ days ago
    • Promoted
    Saras Analytics - Senior Business Analyst

    Saras Analytics - Senior Business Analyst

    SARAS SOLUTIONS INDIA PRIVATE LIMITEDHyderabad, India
    Senior Business Saras Analytics : We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maxi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Urgent Search! Senior Data Analyst

    Urgent Search! Senior Data Analyst

    ValueMomentumHyderabad, Telangana, India
    Job Description GW Data Analyst- GenAI Job Title : Data Analyst Primary skills : LLM, RAG, Adv.SQL Location : Hyderabad / Pune / Coimbatore Mode of work : Office Experience : 7+ yrs years About the j...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Application Development Senior Analyst (CATIA CAA)

    Application Development Senior Analyst (CATIA CAA)

    The Goodyear Tire & Rubber CompanyHyderabad, India
    Software Application Development.Design, develop, and implement custom solutions using the CATIA Customization Application Architecture (CAA) toolkit to meet specific engineering and design require...Show moreLast updated: 3 hours ago
    • Promoted
    FactSet - Senior Business Analyst - SQL / ETL

    FactSet - Senior Business Analyst - SQL / ETL

    Factset Research SystemsHyderabad
    Your Team's Impact : The Business Intelligence team is responsible for driving data-informed decision-making across the organization through comprehensive report...Show moreLast updated: 5 days ago