Talent.com
Big Data Engineer - Hadoop/Hive
Big Data Engineer - Hadoop/HiveUnison consulting pte ltd • Chennai
Big Data Engineer - Hadoop / Hive

Big Data Engineer - Hadoop / Hive

Unison consulting pte ltd • Chennai
30+ days ago
Job description

Responsibilities :

  • Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
  • Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.
  • Optimize data processing workflows for maximum performance and efficiency.
  • Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.
  • Implement best practices for data governance, security, and compliance.
  • Document technical designs, processes, and procedures to support knowledge sharing across teams.

Requirements :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 4+ years of experience as a Big Data Engineer or in a similar role.
  • Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.
  • Extensive experience with programming languages such as Python, Scala, or Java.
  • Knowledge of data modeling and data warehousing concepts.
  • Familiarity with NoSQL databases like Cassandra or MongoDB.
  • Proficient in SQL for data querying and analysis.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and effectively in a fast-paced environment.
  • Benefits :

  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge technologies and solve complex challenges.
  • Dynamic and collaborative work environment with opportunities for growth and career advancement.
  • Regular training and professional development opportunities.
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Chennai

    Related jobs
    Big Data Developer - Hadoop / HDFS

    Big Data Developer - Hadoop / HDFS

    HCLTech • Chennai, Tamil Nadu, India
    Senior Data Engineer – Vendor Experience : 6–12 Years.We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernete...Show more
    Last updated: 2 days ago • Promoted
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 25th Oct, 2025.Mode of Interview : Virtual Drive( Cisco or WebEx). Hands-on experience of Hadoop, Python, PySpark...Show more
    Last updated: 28 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Chennai, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Chennai, IN
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastek • Chennai, Tamil Nadu, India
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVS • Chennai, Tamil Nadu, India
    CYGNVS is a purpose-built, first-of-its-kind guided cyber crisis platform designed to allow users to prepare for, practice for and respond to cyber incidents with confidence.Founded in 2020, the ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy Services • chennai, tamil nadu, in
    Job Title : Senior Data Engineer.Required Skillset : Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda). Master Databricks tools (job creation, cluster, notebook) and be able to qu...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing Services • Chennai, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    Trinity Technology Solutions LLC • Chennai, IN
    Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL. Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • Chennai, Tamil Nadu, India
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    JRD Systems • Chennai, IN
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    TekIT Software Solutions Pvt. Ltd. (India & USA) • Chennai, IN
    Job Title : Senior Data Engineer.Kochi / Trivandrum / Bangalore.We are seeking a highly skilled.Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks.The ideal can...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dexian India • Chennai, Tamil Nadu, India
    Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, ...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • Chennai, Tamil Nadu, India
    Job Description : Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastr...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    Role : Big Data Engineer Experience : 5 to 12 Years Location : Chennai Must have skill : Big Data, Python, Hadoop Job Description : - Minimum 3+ Years of experience Hadoop, Hive SQL’s, Spark, Bigda...Show more
    Last updated: 30+ days ago • Promoted
    Digital : Big Data and Hadoop Ecosystems

    Digital : Big Data and Hadoop Ecosystems

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    Greetings from TATA CONSULTANCY SERVICES!.Skill : Digital : Big Data and Hadoop Ecosystems.Years of Experience : 5 - 10 years. Hands on experience in installation, configuration, supporting and managi...Show more
    Last updated: 1 day ago • Promoted
    Big Data Engineer

    Big Data Engineer

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, Gurgaon.HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys. Hands-on experience in Big data, Hadoop.Hands-on...Show more
    Last updated: 27 days ago • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Blue Cloud Softech Solutions Limited • chennai, tamil nadu, in
    Job Overview – Cloud Data Engineer.We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational effic...Show more
    Last updated: 11 hours ago • Promoted • New!