Talent.com
This job offer is not available in your country.
Data Engineer - Python Programming

Data Engineer - Python Programming

NonStopPune
24 days ago
Job description

About NonStop io Technologies :

NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering.

We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains.

NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term.

We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value.

We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises.

We pride ourselves on fostering innovation, learning, and community engagement.

Join us to work on impactful projects in a collaborative and vibrant environment.

Brief Description :

We are looking for a talented Data Engineer to join our team.

In this role, you will design, implement, and manage data pipelines, ensuring the accessibility and reliability of data for critical business processes.

This is an exciting opportunity to work on scalable solutions that power data-driven decisions

Skillset :

Here is a list of some of the technologies you will work with (the list below is not set in stone)

Data Pipeline Orchestration and Execution :

  • AWS Glue
  • AWS Step Functions
  • Databricks Change

Data Capture :

  • Amazon Database Migration Service
  • Amazon Managed Streaming for Apache Kafka with Debezium Plugin
  • Batch :

  • AWS step functions (and Glue Jobs)
  • Asynchronous queueing of batch job commands with RabbitMQ to various ETL Jobs
  • Cron and subervisord processing on dedicated job server(s) : Python & PHP
  • Streaming :

  • Real-time processing via AWS MSK (Kafka), Apache Hudi, & Apache Flink
  • Near real-time processing via worker (listeners) spread over AWS Lambda, custom server (daemons) written in Python and PHP Symfony
  • Languages : Python & PySpark, Unix Shell, PHP Symfony (with Doctrine ORM)
  • Monitoring & Reliability : Datadog & Cloudwatch
  • Things you will do :

  • Build dashboards using Datadog and Cloudwatch to ensure system health and user support
  • Build schema registries that enable data governance
  • Partner with end-users to resolve service disruptions and evangelize our data product offerings
  • Vigilantly oversee data quality and alert upstream data producers of issues
  • Support and contribute to the data platform architecture strategy, roadmap, and implementation plans to support the companys data-driven initiatives and business objective
  • Work with Business Intelligence (BI) consumers to deliver enterprise-wide fact and dimension data product tables to enable data-driven decision-making across the organization.
  • Other duties as assigned
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer Python • Pune

    Related jobs
    • Promoted
    Tarana Wireless - Senior Data Engineer - Python / ETL

    Tarana Wireless - Senior Data Engineer - Python / ETL

    TARANA WIRELESS INDIA PRIVATE LIMITEDPune
    Job Summary : Build a world-class, high-volume data system from the ground up! We have growing data sets and several exciting Machine Learning systems to create or i...Show moreLast updated: 20 days ago
    • Promoted
    GCP Data Engineer @ Pune

    GCP Data Engineer @ Pune

    Quess IT StaffingPune, Maharashtra, India
    Position : GCP Data Engineer Location : Pune Duration : Contract to Hire Job Description : GCP Python PLSQL.Show moreLast updated: 30+ days ago
    • Promoted
    Staff Data Platform Engineer

    Staff Data Platform Engineer

    ZendeskVadgaon (Vadgaon Budruk), India
    Our Enterprise Data & Analytics (EDA) is looking for an experienced Staff Data Platform Engineer to join our growing Platform engineering team. You’ll work in a collaborative Agile environment...Show moreLast updated: 18 days ago
    • Promoted
    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent HealthPune
    Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer - Python

    Data Engineer - Python

    Talent ProPune
    Role & Responsibilities : We are currently looking for a Data Engineer + Instructor Data Mining to join our Computer Science Department.This is a full-time acad...Show moreLast updated: 3 days ago
    • Promoted
    TechVerito - Data Engineer - Python / Spark

    TechVerito - Data Engineer - Python / Spark

    TechVerito Software Solutions LLPPune
    About the Role : We are looking for a Data Engineer with strong experience in Spark (PySpark), SQL, and data pipeline ar...Show moreLast updated: 2 days ago
    • Promoted
    Capgemini - Azure Purview Data Engineer - Python Frameworks

    Capgemini - Azure Purview Data Engineer - Python Frameworks

    capgeminiPune
    You Role - Architect, configure, and optimize Purview for data cataloging, classification, lineage, and compliance <...Show moreLast updated: 12 days ago
    • Promoted
    Intellias - Senior Data Engineer - Python Programming

    Intellias - Senior Data Engineer - Python Programming

    IntelliasPune
    Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer - Python Programming

    Data Engineer - Python Programming

    ConfidentialPune
    ClickHouse, Kubernetes, SQL, and Python.You will be responsible for building and maintaining efficient data pipelines, optimizing query performance, and developing APIs to support scalable data ser...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    VIPANY GLOBAL SOLUTIONS PRIVATE LIMITEDPune
    Responsibilities for Data Engineer : - Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet function...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    People Prime World WidePune
    About Client : Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France.Founded in 1967, It h...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python Programming

    Data Engineer - Python Programming

    Synapse Tech Services IncPune
    Role : Data Engineer (AWS Tech Stack) Location : Pune (WFO) Experience : 10+ Years &...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Databricks Engineer - Python / Spark

    Azure Databricks Engineer - Python / Spark

    ConfidentialPune
    Design and implement scalable data pipelines using Azure Data Bricks.Develop ETL processes to efficiently extract, transform, and load data. Collaborate with data scientists and analysts to define a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python Programming

    Data Engineer - Python Programming

    Tudip TechnologiesPune
    Position Summary : - Experienced Data Engineer skilled in building data pipelines, managing databases, and handling ETL processes. Proficient in tools like SQL, Python...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / PySpark

    Data Engineer - Python / PySpark

    MEEDEN LABS PRIVATE LIMITEDPune
    Job Summary : We are seeking a skilled Data Engineer with strong expertise in Python and PySpark to design, develop, and optimize large-scale data ...Show moreLast updated: 30+ days ago
    Data Engineer – Python / PySpark | 3-10 yr Experience

    Data Engineer – Python / PySpark | 3-10 yr Experience

    CBNsensePune City, MH, in
    Quick Apply
    Job Title : Data Engineer – Python / PySpark .Full-time, hybrid work, 3 days / week in office(.We are seeking a highly skilled Data Engineer with hands-on expertise in Python, PySpark, and ...Show moreLast updated: 18 days ago
    • Promoted
    AWS Data Engineer - Python / Scala / Java

    AWS Data Engineer - Python / Scala / Java

    HyrEzy Talent SolutionsPune
    Job Title : AWS Data Engineer Location : Pune , Bangalore, Greater Noida, Trichy Responsibilities : Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python Programming

    Data Engineer - Python Programming

    PeoplefyPune
    Job Summary : We are seeking a skilled Data Engineer with a minimum of 5 years of experience to join our team.The ideal candidate will have...Show moreLast updated: 25 days ago