Talent.com
This job offer is not available in your country.
Big Data Engineer - Hadoop / Spark

Big Data Engineer - Hadoop / Spark

ImpacteersHydrebad
12 days ago
Job description

Position Overview :

We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.

The role involves working with large datasets, integrating diverse data sources, and ensuring data availability for analytics, machine learning, and business intelligence.

The ideal candidate will have strong expertise in big data technologies and the ability to collaborate with cross-functional teams to deliver data-driven solutions.

Key Responsibilities :

  • Design, build, and optimize large-scale data pipelines for ingestion, transformation, and storage.
  • Work with structured and unstructured data across multiple platforms and sources.
  • Implement and maintain data lake and data warehouse solutions.
  • Develop scalable ETL (Extract, Transform, Load) processes.
  • Ensure data quality, security, and governance across systems.
  • Collaborate with data scientists, analysts, and business teams to provide reliable data solutions.
  • Monitor and optimize the performance of big data clusters and processing jobs.
  • Research and integrate emerging big data tools and technologies.
  • Troubleshoot and resolve issues related to data processing and storage.

Key Skills & Competencies :

  • Strong knowledge of big data frameworks (Hadoop, Spark, Flink, Kafka).
  • Hands-on experience with cloud platforms (AWS, Azure, GCP).
  • Proficiency in SQL, NoSQL databases (MongoDB, Cassandra, HBase).
  • Strong programming skills in Python, Java, or Scala.
  • Knowledge of ETL tools and data integration techniques.
  • Familiarity with data warehousing solutions (Snowflake, Redshift, BigQuery).
  • Problem-solving and analytical skills with attention to detail.
  • Ability to work in cross-functional teams and manage multiple projects.
  • Qualifications :

  • Bachelors or Masters degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • 3 to 6 years of experience in data engineering or big data roles.
  • Proven track record in handling large, complex datasets.
  • Certifications in big data or cloud platforms (preferred but not mandatory).
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Hydrebad

    Related jobs
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Grid Dynamicshyderabad, telangana, in
    Proven experience leading data engineering teams, including distributed teams across multiple geographies and time zones. Effective in managing cross-team collaboration with architects, product mana...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLHyderabad, Telangana, India
    The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 23 days ago
    • Promoted
    Dun & Bradstreet - Data Engineer - Spark / Hadoop

    Dun & Bradstreet - Data Engineer - Spark / Hadoop

    DUN BRADSTREET TECHNOLOGY AND CORPORATE SERVICESHyderabad
    Why We Work at Dun & Bradstreet : Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow.Each da...Show moreLast updated: 11 days ago
    • Promoted
    Big Data Engineer - Python / PySpark

    Big Data Engineer - Python / PySpark

    People Prime World WideHyderabad
    Key Responsibilities : - Design, develop, and maintain scalable ETL / ELT pipelines using Python and PySpark.Work with large-scale datasets across di...Show moreLast updated: 9 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisHyderabad, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIHyderabad, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USThyderabad, telangana, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivesecunderabad, telangana, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Infogainhyderabad, telangana, in
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Bigdata Engineer

    Bigdata Engineer

    TAO Digital SolutionsHyderabad, Telangana, India
    Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques.Candidate will possess experience in developing highly scalable Big Data pipelines, stron...Show moreLast updated: 7 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Rapinno Tech Solutions Pvt.Ltd.Hyderabad, Telangana, India
    Locations : Hyderabad | Chennai | Pune | Bangalore.Show moreLast updated: 7 days ago
    • Promoted
    Data Architect / Data Modeler

    Data Architect / Data Modeler

    INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITEDHyderabad,Bangalore,Chennai
    Role - Data Architect / Data Modeler Exp - 12 to 16 Yrs Locations - Chennai, Hyderabad, Bengaluru, Delhi, Pun...Show moreLast updated: 20 days ago
    • Promoted
    Associate Big Data Engineer

    Associate Big Data Engineer

    ConfidentialHyderabad / Secunderabad, Telangana
    Contribute towards supporting the build / implementation of data ingestion and curation processes developed using Big data tools such as Spark (Scala / python), Hive, HDFS, Kafka, Pig, Spark, HDFS, Ooz...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhyderabad, telangana, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticssecunderabad, telangana, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer - Big Data / Kafka

    Senior Data Engineer - Big Data / Kafka

    SMARTWORK IT SERVICESHyderabad
    Position : Senior Data Engineer (ETL / Big Data / Streaming) Experience : 810 years Location : Onsite Hybder...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Specialist

    Big Data Specialist

    Brilliosecunderabad, telangana, in
    We are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distribute...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritosecunderabad, telangana, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 3 hours ago