Talent.com
TechVerito - Data Engineer - Python / Spark

TechVerito - Data Engineer - Python / Spark

TechVerito Software Solutions LLPPune
30+ days ago
Job description

About the Role :

We are looking for a Data Engineer with strong experience in Spark (PySpark), SQL, and data pipeline architecture.

You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights.

The ideal candidate is hands-on, detail-oriented, and passionate about crafting reliable data solutions, while collaborating with cross-functional teams.

Responsibilities :

  • Design and architect scalable and efficient data pipelines for batch and real-time processing.
  • Develop and optimize solutions using Spark (PySpark) and SQL.
  • Ensure data pipelines are reliable, maintainable, and well-tested.
  • Work with stakeholders to understand business requirements and translate them into data-driven solutions.
  • Collaborate with cross-functional teams to ensure data quality, availability, and performance.
  • Stay updated with emerging data engineering tools and practices.

Must-Have Skills :

  • Strong expertise in Spark (PySpark).
  • Proficiency in SQL (query optimization, performance tuning, complex joins).
  • Hands-on experience in designing and architecting data pipelines.
  • Excellent communication and collaboration skills.
  • Good to Have :

  • Experience with data streaming platforms (Kafka, Kinesis, etc.
  • Proficiency in Python for data engineering tasks.
  • Exposure to Databricks and Azure cloud services.
  • Knowledge of HTAP systems, Debezium, 3PL / logistics domain(having most of this mentioned skills would be great).
  • Familiarity with orchestration frameworks such as Apache Airflow or Apache NiFi.
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Pune

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgePune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroPune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Haveli
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer - Scala / Apache Spark

    Data Engineer - Scala / Apache Spark

    Ixceed SolutionsPune
    Responsibilities : - Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform,...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICESPune, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 7 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    HCLTechPune, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Trinity Technology Solutions LLCPune, Maharashtra, India
    Location : Pune preferred / remote Core Competencies (Must-Have) Category Skills / Tools Programming Python, PySpark / Spark Operating Systems Linux (RedHat) Databases Hive, MSSQL, MySQL, PostgreSQL ...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent SystemsPune, Haveli
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionPune, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzonePune, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RedPluto Analytics Private LimitedPune, Maharashtra, India
    RedPluto Analytics is seeking an experienced Data Engineer who is passionate about designing, developing, and optimizing scalable data pipelines. The ideal candidate will have strong hands-on expert...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer - PySpark / AWS / Azure

    Data Engineer - PySpark / AWS / Azure

    BinaryStar SearchXPune
    Job Description : - Minimum 5 years of experience in data analytics field - Experience with Azure / AWS Databricks - Experienc...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    AscendionPune, Maharashtra, India
    Job Title : Senior Data Engineer.Location : Gurgaon / Pune / Bangalore.Skills : PySpark, SQL, Databricks, AWS.The ideal candidates should have hands-on expertise in building. Databricks and AWS, along w...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Persistent SystemsPune, Maharashtra, India
    We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations. Job Type : Full Time Employment.Design, build, and maintain data pip...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIROPune, Maharashtra, India
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasPune, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 15 days ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyantpune, maharashtra, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 2 days ago
    • Promoted
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    ACENET CONSULTING PRIVATE LIMITEDPune
    Description : About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in ...Show moreLast updated: 23 days ago