Talent.com
This job offer is not available in your country.
Big Data Engineer - Hadoop / Spark

Big Data Engineer - Hadoop / Spark

ImpacteersChennai
12 days ago
Job description

Position Overview :

We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.

The role involves working with large datasets, integrating diverse data sources, and ensuring data availability for analytics, machine learning, and business intelligence.

The ideal candidate will have strong expertise in big data technologies and the ability to collaborate with cross-functional teams to deliver data-driven solutions.

Key Responsibilities :

  • Design, build, and optimize large-scale data pipelines for ingestion, transformation, and storage.
  • Work with structured and unstructured data across multiple platforms and sources.
  • Implement and maintain data lake and data warehouse solutions.
  • Develop scalable ETL (Extract, Transform, Load) processes.
  • Ensure data quality, security, and governance across systems.
  • Collaborate with data scientists, analysts, and business teams to provide reliable data solutions.
  • Monitor and optimize the performance of big data clusters and processing jobs.
  • Research and integrate emerging big data tools and technologies.
  • Troubleshoot and resolve issues related to data processing and storage.

Key Skills & Competencies :

  • Strong knowledge of big data frameworks (Hadoop, Spark, Flink, Kafka).
  • Hands-on experience with cloud platforms (AWS, Azure, GCP).
  • Proficiency in SQL, NoSQL databases (MongoDB, Cassandra, HBase).
  • Strong programming skills in Python, Java, or Scala.
  • Knowledge of ETL tools and data integration techniques.
  • Familiarity with data warehousing solutions (Snowflake, Redshift, BigQuery).
  • Problem-solving and analytical skills with attention to detail.
  • Ability to work in cross-functional teams and manage multiple projects.
  • Qualifications :

  • Bachelors or Masters degree in Computer Science, Data Engineering, Information Technology, or a related field.
  • 3 to 6 years of experience in data engineering or big data roles.
  • Proven track record in handling large, complex datasets.
  • Certifications in big data or cloud platforms (preferred but not mandatory).
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Chennai

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 7 days ago
    • Promoted
    Big Data Specialist

    Big Data Specialist

    Brilliochennai, tamil nadu, in
    We are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distribute...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHchennai, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainChennai, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsChennai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisChennai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalchennai, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USTchennai, tamil nadu, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritochennai, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivechennai, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, Tamil Nadu, India
    We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    IntraEdgeChennai, Tamil Nadu, India
    Senior Big Data Engineer (Python).Immediate to 30 Days Preferred.The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing ...Show moreLast updated: 30+ days ago