Talent.com
Big Data Engineer
Big Data EngineerRiskInsight Consulting Pvt Ltd • Chennai, TN, IN
Big Data Engineer

Big Data Engineer

RiskInsight Consulting Pvt Ltd • Chennai, TN, IN
30+ days ago
Job type
  • Quick Apply
Job description

Responsibilities

  • Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
  • Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.
  • Optimize data processing workflows for maximum performance and efficiency.
  • Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.
  • Implement best practices for data governance, security, and compliance.
  • Document technical designs, processes, and procedures to support knowledge sharing across teams.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 4+ years of experience as a Big Data Engineer or in a similar role.
  • Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.
  • Extensive experience with programming languages such as Python, Scala, or Java.
  • Knowledge of data modeling and data warehousing concepts.
  • Familiarity with NoSQL databases like Cassandra or MongoDB.
  • Proficient in SQL for data querying and analysis.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and effectively in a fast-paced environment.
  • Benefits

    Competitive salary and benefits package.

    Opportunity to work on cutting-edge technologies and solve complex challenges.

    Dynamic and collaborative work environment with opportunities for growth and career advancement.

    Regular training and professional development opportunities.

    Create a job alert for this search

    Big Data Engineer • Chennai, TN, IN

    Related jobs
    Big Data Engineer

    Big Data Engineer

    Saaki Argus & Averil Consulting • Chennai, Tamil Nadu, India
    Quick Apply
    Notice Period : Immediate Joiner or 30 Day.Hands-on experience on technologies like.Hive, Scala, Spark, AWS, HBase.Proficient in Hadoop distributions such as. Good working experience on technologies...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    TerraGiG • Chennai, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer - Hadoop / HDFS

    Big Data Developer - Hadoop / HDFS

    HCLTech • Chennai, Tamil Nadu, India
    Senior Data Engineer – Vendor Experience : 6–12 Years.We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernete...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    Mastek • Chennai, Tamil Nadu, India
    Work closely with our data science team to help build complex algorithms that provide unique insights into our data.Use agile software development processes to make iterative improvements to our ba...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • Chennai, Tamil Nadu, India
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 30+ days ago • Promoted
    GCP + Bigdata Engineer

    GCP + Bigdata Engineer

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    TATA Consultancy Services is looking for Big Data Developer with Hands on experience with GCP.Required experience range : 6 to 8 years. Job locations : Chennai, Gurgaon.Demonstrated leadership in desi...Show more
    Last updated: 8 hours ago • Promoted • New!
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • chennai, tamil nadu, in
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 21 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Mastek • Chennai, Tamil Nadu, India
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 27 days ago • Promoted
    Data Engineer

    Data Engineer

    HCLTech • Greater Chennai Area, India
    Available Location - Chennai, Bangalore, Hyderabad.Skills required : GCP, Big Query, SQL, Python, Dataflow or Dataproc, Airflow or Cloud composer, DBT, Looker. Notice Period - Immediate joiner to 60 ...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    CXC • Chennai, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VXI Global Solutions • Chennai, IN
    We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Glo...Show more
    Last updated: 30+ days ago • Promoted
    Immediate Opening for Data Engineer (Databricks & D365)

    Immediate Opening for Data Engineer (Databricks & D365)

    GyanSys Inc. • Chennai, IN
    Need to have databricks experience as well as experience with handling D365 data.Need strong SQL skills, strong analytical skills.Show more
    Last updated: 19 days ago • Promoted
    Data Engineer

    Data Engineer

    MRF • Chennai, Tamil Nadu, India
    Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc. Responsible for user access mana...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Aceolution • Chennai, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Synechron • chennai, India
    We have immediate opportunity for.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...Show more
    Last updated: 12 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    loanDNA • Chennai, Tamil Nadu, India
    We are seeking an experienced Snowflake Developer with a minimum of 5 years of hands-on experience in Snowflake development, integration, migration, and deployment. The ideal candidate will be respo...Show more
    Last updated: 25 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Chennai, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Chennai, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted