Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

R SystemsJamnagar, IN
24 days ago
Job description

Job Title : Data Engineer

Contract Period : 12 Months

Location : Offshore candidates accepted (Singapore Based Company)

Work Timing : 6.30 AM to 3.30 PM or 7.00 AM to 4.00 PM (IST - India timing)

Experience

  • Minimum 4+ years as a Data Engineer or similar role.(Please don't apply if less than 4 years exp in Data Engineer)
  • Proven experience in Python, Spark, and PySpark (non-negotiable).(mandatory
  • Hands-on in building ETL pipelines, real-time streaming, and data transformations .
  • Worked with data warehouses, cloud platforms (AWS / Azure / GCP) , and databases .

✅ Technical Skills

  • Spark Core API : RDDs, transformations / actions, DAG execution.
  • Spark SQL : DataFrames, schema optimization, UDFs.
  • Streaming : Structured Streaming, Kafka integration.
  • Data Handling : S3, HDFS, JDBC, Parquet, Avro, ORC.
  • Orchestration : Airflow / Prefect.
  • Performance Tuning : Partitioning, caching, broadcast joins.
  • Cloud Deployment : Databricks, AWS EMR, Azure HDInsight, GCP Dataproc.
  • CI / CD : Pytest / unittest for Spark jobs, Jenkins, GitHub Actions.
  • ✅ Education & Soft Skills

  • Bachelor’s / Master’s in Computer Science, Computer Engineering, or equivalent.
  • Strong analytical, problem-solving, and communication skills.
  • About the Role

    We are seeking an experienced Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.

    Key Responsibilities

  • Design, build, and optimize data pipelines and ETL workflows .
  • Manage and process large datasets using Spark, PySpark, and SQL .
  • Build and maintain real-time streaming applications with Spark Streaming / Kafka.
  • Collaborate with data scientists and product teams to integrate AI / ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks) .
  • Automate testing and deployment of Spark jobs via CI / CD pipelines.
  • Requirements

  • Bachelor’s / Master’s degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark .
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution .
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow / Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc .
  • Exposure to testing and CI / CD for data pipelines (pytest, Jenkins, GitHub Actions).
  • Budget

  • Onshore : As per market standards.
  • Create a job alert for this search

    Data Engineer • Jamnagar, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    EveriseJamnagar, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXJamnagar, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Jamnagar, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaJamnagar, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsJamnagar, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIJamnagar, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalJamnagar, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionJamnagar, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainJamnagar, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIJamnagar, IN
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeJamnagar, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekJamnagar, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesJamnagar, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesJamnagar, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeJamnagar, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsJamnagar, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentJamnagar, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESJamnagar, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseJamnagar, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant only ( this is a Junior position with us ).GCP - 2 years minimum working Experience. Worked with global stakeholders.Randstad Sourc...Show moreLast updated: 30+ days ago
    • Promoted
    Data / ML Engineer

    Data / ML Engineer

    GleantapJamnagar, IN
    Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost). Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 20 days ago