Talent.com
Senior Python Data Engineer
Senior Python Data EngineeriVoyant • Jhārkhand, Republic Of India, IN
Senior Python Data Engineer

Senior Python Data Engineer

iVoyant • Jhārkhand, Republic Of India, IN
10 days ago
Job description

About the Project :

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it using efficient data processing libraries, and serving it through APIs. The team emphasizes scalability, maintainability, and developer productivity, incorporating spec-driven development powered by AI tools.

You’ll be contributing to the backend architecture and data pipeline powering this transformation, helping to evolve a high-performance system that's central to the client’s reporting domain.

Responsibilities :

  • Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas required;

Polars nice-to-have).

  • Develop and expose RESTful APIs using FastAPI or similar frameworks.
  • Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
  • Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
  • Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
  • Integrate with messaging and storage mechanisms (e.G., Service Bus, Storage Accounts).
  • Collaborate on infrastructure-as-code automation using Bicep similar tools (Terraform, CDK).
  • Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
  • Contribute to CI / CD pipelines using GitHub Actions.
  • Required Skills and Experience :

  • Strong proficiency in Python for data processing with hands-on expertise in Pandas.
  • Ability to quickly learn new frameworks such as Polars if needed.
  • Experience building backend services or APIs using frameworks like FastAPI.
  • Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.
  • Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).
  • Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar).
  • Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).
  • Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
  • Nice-to-Have / Preferred Qualifications :

  • Experience with Polars (not required).
  • Experience with orchestration tools like Apache Airflow or ETL frameworks like DBT.
  • Exposure to Snowflake (streams, tasks, stored procedures).
  • Experience working with DuckDB and / or DocTV / OpenTI XLarge for report generation.
  • Knowledge of Angular or frontend plugins for Excel is a plus but not required.
  • Familiarity with async workflows and distributed processing concepts.
  • Soft Skills & Cultural Fit :

  • Strong ownership mindset, proactive in identifying and solving problems.
  • Collaborative team player, able to work cross-functionally with architects, engineers, and stakeholders.
  • Comfortable working in a distributed, multicultural team across multiple time zones (Europe, India, U.S.).
  • Adaptable and open to learning emerging tools and technologies.
  • Work Environment / Time Zone Expectations :

  • Global team with flexibility on candidate location.
  • Current team members are distributed across the US, Latin America, Europe, and India.
  • Candidates from other regions will be considered, provided there is reasonable overlap with core collaboration hours.
  • Create a job alert for this search

    Data Engineer Python • Jhārkhand, Republic Of India, IN

    Related jobs
    Python Developer - Machine Learning

    Python Developer - Machine Learning

    Talentgigs • Jhārkhand, Republic Of India, IN
    We’re looking for a hands-on Senior ML Engineer (6–10 years) who can : .Lead design and delivery of LLM & Document AI solutions end-to-end. Own ML services in production (APIs, pipelines, monitoring)....Show more
    Last updated: 1 hour ago • Promoted • New!
    MEAN Stack Developer

    MEAN Stack Developer

    Essex Pvt Ltd • Jharkhand
    Job Description : As a MEAN Stack Developer, you will join our dynamic team to create scalable, high-performance applications. You will leverage your experience in ful...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Epergne Solutions • Gurgaon, Jharkhand, India
    Quick Apply
    Job Roles & Responsibilities.Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-performance code using PySpark / Python with best practices.Perform code...Show more
    Last updated: 30+ days ago
    Python Developer

    Python Developer

    People Prime Worldwide • Jhārkhand, Republic Of India, IN
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show more
    Last updated: 30+ days ago • Promoted
    Python For Machine Learning

    Python For Machine Learning

    People Prime Worldwide • Jhārkhand, Republic Of India, IN
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernisation and ma...Show more
    Last updated: 1 day ago • Promoted
    SQL Developer - Data Analytics

    SQL Developer - Data Analytics

    TechnoRight • Jharkhand
    Job Description : Job Responsibilities : - Design, develop, and maintain efficient database solutions...Show more
    Last updated: 30+ days ago • Promoted
    Generative Ai Engineer

    Generative Ai Engineer

    Live Connections • Jhārkhand, Republic Of India, IN
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field;.ML / Data Science with a focus on generative AI, LLMs, or computer vision.Expertise in...Show more
    Last updated: 15 days ago • Promoted
    Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

    Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

    Peak Trust Global Real Estate • Jhārkhand, Republic Of India, IN
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    N53 Tech • Jhārkhand, Republic Of India, IN
    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years).You will help build and scale their data architecture, data pipelines, data platform govern...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Developer With Test Driven Development

    Python Developer With Test Driven Development

    ENCORE IT SOLUTIONS • Jhārkhand, Republic Of India, IN
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    Grantify • Jhārkhand, Republic Of India, IN
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Analyst

    Senior Data Analyst

    Eternz • Jhārkhand, Republic Of India, IN
    We're redefining how India buys jewelry.Eternz is India's #1 jewelry marketplace with 200+ premium brands - pioneering quick-commerce for jewelry with same-day and 4-hour delivery.Fresh off our Pre...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Analyst

    Data Analyst

    TechnoRight • Jharkhand
    Job description and Understanding : Salary : 12 to 70 LPA Profile : Data Analyst ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Saaki Argus & Averil Consulting • Gurgaon, Jharkhand, India
    Quick Apply
    We are looking to hire Azure Data Engineers for a client who is a leader in the AI and Analytics solution.You will work on a broad range of cutting-edge data analytics problems.Design and build sca...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • Jhārkhand, Republic Of India, IN
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 1 hour ago • Promoted • New!
    Python Developer

    Python Developer

    TekXera • Jhārkhand, Republic Of India, IN
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 1 hour ago • Promoted • New!
    Part-Time Senior Python Backend Developer (3+ Years)

    Part-Time Senior Python Backend Developer (3+ Years)

    Palcode.ai • Jhārkhand, Republic Of India, IN
    We are building cutting-edge AI products in the.General Contractors, Estimators, and Project Managers manage bids, RFIs, and scope gaps. AI Agents, voice automation, and vision systems.Joining us me...Show more
    Last updated: 1 hour ago • Promoted • New!
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • Jhārkhand, Republic Of India, IN
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 12 days ago • Promoted