Talent.com
This job offer is not available in your country.
Big Data Developer

Big Data Developer

CoforgeIndia
30+ days ago
Job description

We are seeking a highly skilled and experienced Senior Big Data Engineer with strong expertise in Streaming Data and Big Data Technologies, AWS & Scala Mandatory. The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.

Key Responsibilities :

  • Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data.
  • Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway.
  • Work extensively with streaming platforms like Kafka, Flink, Spark Streaming.
  • Develop and optimize data ingestion workflows using Apache NiFi, Airflow, Sqoop, Oozie.
  • Build and maintain data lakes and analytics platforms using AWS Lake Formation.
  • Hands-on development using Scala with Spark for distributed data processing.
  • Work with NoSQL databases including DynamoDB, HBase, and Hadoop ecosystem tools like MapReduce, Hive, HDFS.
  • Collaborate with cross-functional teams to deliver high-performance data solutions.

Technical Skills Required :

  • Mandatory : Spark, Scala, AWS, Hadoop
  • Big Data Tools : EMR, Glue, Hive, HDFS, HBase, MapReduce
  • Streaming & Messaging : Kafka, Kinesis, Flink, Spark Streaming
  • Data Ingestion : Apache NiFi, Airflow, Sqoop, Oozie
  • Cloud Platforms : AWS (preferred), Hortonworks, Cloudera, MapR
  • Programming : Scala (with Spark), Python (optional)
  • Databases : DynamoDB, NoSQL, HBase
  • Others : AWS Athena, Lake Formation, CloudFormation
  • Create a job alert for this search

    Big Data Developer • India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainNagpur, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mitra AINagpur, IN
    We are seeking a candidate who is comfortable working on B shift (3PM - 11PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIES. Develop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom f...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCNagpur, IN
    Duration- 12+ months with Extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tra...Show moreLast updated: 4 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLNagpur, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaNagpur, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 24 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    BayOne SolutionsIndia, India
    We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesNagpur, IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsNagpur, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisNagpur, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

    Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

    DautomNagpur, IN
    Remote
    Job Description : Data Engineer (Big Data / Kafka).We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesNagpur, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer / DE with SCALA Spark

    Big Data Engineer / DE with SCALA Spark

    HCLTechNagpur, Maharashtra, India
    We are Hiring Big Data Engineer / Data Engineer with SCALA & Spark.Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc. Experience in Big data technologies , real time data processing platfor...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PASO CoNagpur, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 4 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Alef EducationNagpur, IN
    Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience.What started in 2016 as a small pilot programme in Abu Dhabi has evolved into o...Show moreLast updated: 2 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradNagpur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Data Steward

    Data Steward

    Insight GlobalNagpur, IN
    Collibra, Informatica EDC, Atlan).Proven experience translating technical data logic into.Strong communication, facilitation, and stakeholder management skills. Bachelor's degree in Computer Science...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsNagpur, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsNagpur, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalNagpur, IN
    Insight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion...Show moreLast updated: 30+ days ago