Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

R SystemsMumbai, IN
26 days ago
Job description

Job Title : Data Engineer

Contract Period : 12 Months

Location : Offshore candidates accepted (Singapore Based Company)

Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)

Experience

  • Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)
  • Proven experience in Python, Spark, and PySpark (non-negotiable).(mandatory
  • Hands-on in building ETL pipelines, real-time streaming, and data transformations .
  • Worked with data warehouses, cloud platforms (AWS / Azure / GCP) , and databases .

✅ Technical Skills

  • Spark Core API : RDDs, transformations / actions, DAG execution.
  • Spark SQL : DataFrames, schema optimization, UDFs.
  • Streaming : Structured Streaming, Kafka integration.
  • Data Handling : S3, HDFS, JDBC, Parquet, Avro, ORC.
  • Orchestration : Airflow / Prefect.
  • Performance Tuning : Partitioning, caching, broadcast joins.
  • Cloud Deployment : Databricks, AWS EMR, Azure HDInsight, GCP Dataproc.
  • CI / CD : Pytest / unittest for Spark jobs, Jenkins, GitHub Actions.

    • ✅ Education & Soft Skills

  • Bachelor’s / Master’s in Computer Science, Computer Engineering, or equivalent.
  • Strong analytical, problem-solving, and communication skills.

    • About the Role

    We are seeking an experienced Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.

    Key Responsibilities

  • Design, build, and optimize data pipelines and ETL workflows .
  • Manage and process large datasets using Spark, PySpark, and SQL .
  • Build and maintain real-time streaming applications with Spark Streaming / Kafka.
  • Collaborate with data scientists and product teams to integrate AI / ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks) .
  • Automate testing and deployment of Spark jobs via CI / CD pipelines.

    • Requirements

  • Bachelor’s / Master’s degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark .
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution .
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow / Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc .
  • Exposure to testing and CI / CD for data pipelines (pytest, Jenkins, GitHub Actions).

    • Budget

  • Onshore : As per market standards.
    • Create a job alert for this search

    Data Engineer • Mumbai, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsMumbai, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekThane, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    R Systemsnavi mumbai, maharashtra, in
    Offshore candidates accepted (Singapore Based Company).Please don't apply if less than 4 years exp in Data Engineer).ETL pipelines, real-time streaming, and data transformations.RDDs, transformatio...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Envuthane, maharashtra, in
    At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Datamatics Business Solutionsmumbai, maharashtra, in
    We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our B2B...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Kalyan-Dombivli, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionKalyan-Dombivli, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Fornaxmumbai, maharashtra, in
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXMumbai, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsMumbai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIMumbai, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKalyan-Dombivli, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incnavi mumbai, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalKalyan-Dombivli, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Certified Data Engineer

    AWS Certified Data Engineer

    CodeVyasamumbai, maharashtra, in
    AWS Certified Data Engineer| Mumbai.The candidate should have a minimum of.CodeVyasa is a mid-sized product engineering company that works with top-tier product / solutions companies such as McKinsey...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SolarSquaremumbai, maharashtra, in
    Job Description : Data Engineer.As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.Your work will transform raw, messy data into clean,. You’ll collaborate cross-fun...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseMumbai, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKalyan-Dombivli, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESThane, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitaldombivli, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago