Talent.com
This job offer is not available in your country.
Big Data Engineer - Hadoop / Hive

Big Data Engineer - Hadoop / Hive

Unison consulting pte ltdChennai
5 hours ago
Job description

Responsibilities :

  • Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
  • Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.
  • Optimize data processing workflows for maximum performance and efficiency.
  • Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.
  • Implement best practices for data governance, security, and compliance.
  • Document technical designs, processes, and procedures to support knowledge sharing across teams.

Requirements :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 4+ years of experience as a Big Data Engineer or in a similar role.
  • Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.
  • Extensive experience with programming languages such as Python, Scala, or Java.
  • Knowledge of data modeling and data warehousing concepts.
  • Familiarity with NoSQL databases like Cassandra or MongoDB.
  • Proficient in SQL for data querying and analysis.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and effectively in a fast-paced environment.
  • Benefits :

  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge technologies and solve complex challenges.
  • Dynamic and collaborative work environment with opportunities for growth and career advancement.
  • Regular training and professional development opportunities.
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Chennai

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 8 days ago
    • Promoted
    Big Data Specialist

    Big Data Specialist

    Brilliochennai, tamil nadu, in
    We are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distribute...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHchennai, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainChennai, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsChennai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark

    Big Data Engineer - Hadoop / Spark

    ImpacteersChennai
    Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer - Big Data / Kafka

    Senior Data Engineer - Big Data / Kafka

    SMARTWORK IT SERVICESChennai
    Position : Senior Data Engineer (ETL / Big Data / Streaming) Experience : 810 years Location : Onsite Hybder...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgechennai, tamil nadu, in
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 26 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisChennai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESChennai, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalchennai, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TCS Human Resources Team!!!.Skill : Snowflake Data Engineer.Required Technical Skill Set : Snowflake, dbt, FiveTran, Snowpipe, AWS services : Managed Airflow (MWAA), S3, Lambda.Minimum ...Show moreLast updated: 26 days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USTchennai, tamil nadu, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeschennai, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemschennai, tamil nadu, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 24 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    IntraEdgeChennai, Tamil Nadu, India
    Senior Big Data Engineer (Python).Immediate to 30 Days Preferred.The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing ...Show moreLast updated: 30+ days ago