Talent.com
Data Engineer

Data Engineer

GEMRAJ TECHNOLOGIES LIMITEDbhopal, madhya pradesh, in
2 days ago
Job description

Job Title : Data Engineer

Location : Remote

Position : Full-time

Exp- Must Have 8+ Years

Position Overview

We are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data engineering, and is excited about blending these disciplines to create innovative solutions.

You will be responsible for one or more software and data products, participating in architectural decisions, design, development, and evaluation of new technical solutions. This role also involves leading a small team of developers.

Key Responsibilities

  • Manage and optimize data and compute environments to enable efficient use of data assets
  • Design, build, test, and deploy scalable and reusable systems capable of handling large volumes of data
  • Lead a small team of developers; conduct code reviews and mentor junior engineers
  • Continuously learn and help teach emerging technologies to the team
  • Collaborate with cross-functional teams to integrate data into broader applications

Required Skills

  • Proven experience designing and managing data flows
  • Expertise in designing systems and APIs for data integration
  • 8+ years of hands-on experience with Linux, Bash, Python, and SQL
  • 4+ years working with Spark and other components in the Hadoop ecosystem
  • 4+ years of experience using AWS cloud services, particularly :
  • EMR
  • Glue
  • Athena
  • Redshift
  • 4+ years of experience managing a development team
  • Deep passion for technology and enthusiasm for solving complex, real-world problems using cutting-edge tools
  • Additional Skills (Preferred)

  • BS, MS, or PhD in Computer Science, Engineering, or equivalent practical experience
  • Strong experience with Python, C++, or other widely-used languages
  • Experience working with petabyte-scale data infrastructure
  • Solid understanding of :
  • Data organization : partitioning, clustering, file sizes, file formats
  • Data cataloging : Hive / Hive Metastore, AWS Glue, or similar
  • Background working with relational databases
  • Proficiency with Hadoop, Hive, Spark, or similar tools
  • Exposure to modern data stack technologies like dbt, airbyte
  • Experience building scalable data pipelines (e.g., Airflow is a plus)
  • Strong background with AWS and / or Google Cloud Platform (GCP)
  • Demonstrated ability to independently lead projects from concept through launch and ongoing support
  • Create a job alert for this search

    Data Engineer • bhopal, madhya pradesh, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Impetusbhopal, madhya pradesh, in
    Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgebhopal, madhya pradesh, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softbhopal, madhya pradesh, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHbhopal, madhya pradesh, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgebhopal, madhya pradesh, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA Globalbhopal, madhya pradesh, in
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Trantorbhopal, madhya pradesh, in
    We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS. Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 10 days ago
    • Promoted
    Senior Azure Data Engineer (8+ Yrs)

    Senior Azure Data Engineer (8+ Yrs)

    Delphi Consulting Middle Eastbhopal, madhya pradesh, in
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Talogybhopal, madhya pradesh, in
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradbhopal, madhya pradesh, in
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incbhopal, madhya pradesh, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladebhopal, madhya pradesh, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur Rugsbhopal, madhya pradesh, in
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + Companybhopal, madhya pradesh, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXbhopal, madhya pradesh, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDbhopal, madhya pradesh, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadybhopal, madhya pradesh, in
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer - Databricks Expert

    Data Engineer - Databricks Expert

    Nebula Tech Solutionsbhopal, madhya pradesh, in
    Data Engineer – Databricks Expert.Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a....Show moreLast updated: 6 days ago