Talent.com
Senior Python Data Engineer
Senior Python Data EngineeriVoyant • Jhārkhand, Republic Of India, IN
No longer accepting applications
Senior Python Data Engineer

Senior Python Data Engineer

iVoyant • Jhārkhand, Republic Of India, IN
10 days ago
Job description

About the Project :

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it using efficient data processing libraries, and serving it through APIs. The team emphasizes scalability, maintainability, and developer productivity, incorporating spec-driven development powered by AI tools.

You’ll be contributing to the backend architecture and data pipeline powering this transformation, helping to evolve a high-performance system that's central to the client’s reporting domain.

Responsibilities :

  • Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas required;

Polars nice-to-have).

  • Develop and expose RESTful APIs using FastAPI or similar frameworks.
  • Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
  • Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
  • Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
  • Integrate with messaging and storage mechanisms (e.G., Service Bus, Storage Accounts).
  • Collaborate on infrastructure-as-code automation using Bicep similar tools (Terraform, CDK).
  • Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
  • Contribute to CI / CD pipelines using GitHub Actions.
  • Required Skills and Experience :

  • Strong proficiency in Python for data processing with hands-on expertise in Pandas.
  • Ability to quickly learn new frameworks such as Polars if needed.
  • Experience building backend services or APIs using frameworks like FastAPI.
  • Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.
  • Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).
  • Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar).
  • Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).
  • Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
  • Nice-to-Have / Preferred Qualifications :

  • Experience with Polars (not required).
  • Experience with orchestration tools like Apache Airflow or ETL frameworks like DBT.
  • Exposure to Snowflake (streams, tasks, stored procedures).
  • Experience working with DuckDB and / or DocTV / OpenTI XLarge for report generation.
  • Knowledge of Angular or frontend plugins for Excel is a plus but not required.
  • Familiarity with async workflows and distributed processing concepts.
  • Soft Skills & Cultural Fit :

  • Strong ownership mindset, proactive in identifying and solving problems.
  • Collaborative team player, able to work cross-functionally with architects, engineers, and stakeholders.
  • Comfortable working in a distributed, multicultural team across multiple time zones (Europe, India, U.S.).
  • Adaptable and open to learning emerging tools and technologies.
  • Work Environment / Time Zone Expectations :

  • Global team with flexibility on candidate location.
  • Current team members are distributed across the US, Latin America, Europe, and India.
  • Candidates from other regions will be considered, provided there is reasonable overlap with core collaboration hours.
  • Create a job alert for this search

    Data Engineer Python • Jhārkhand, Republic Of India, IN

    Related jobs
    Bim Coordinator

    Bim Coordinator

    BIM Elevate • Jhārkhand, Republic Of India, IN
    BIM Elevate provides a wide range of cutting-edge BIM services, including 3D modeling, clash detection, coordination, project management, and virtual design assistance. Committed to transforming the...Show more
    Last updated: 1 day ago • Promoted
    SBI Life Insurance - Manager - Sales

    SBI Life Insurance - Manager - Sales

    SBI LIFE • Jharkhand, India
    India, was incorporated in October 2000 and is registered with the Insurance Regulatory and Development Authority of India (IRDAI) since March 2001. The company offers a diverse range of products ca...Show more
    Last updated: 30+ days ago • Promoted
    Data Modeller Role

    Data Modeller Role

    Epergne Solutions • Gurgaon, Jharkhand, India
    Quick Apply
    Epergne Solutions is looking for Data Modeller.Long term Contract (with our Client).Chennai, Delhi, Pune, Bangalore, Indore, Gurgaon, Bhubaneshwar, Chandigarh, Hyderabad. Experience in data modellin...Show more
    Last updated: 30+ days ago
    MEAN Stack Developer

    MEAN Stack Developer

    Essex Pvt Ltd • Jharkhand
    Job Description : As a MEAN Stack Developer, you will join our dynamic team to create scalable, high-performance applications. You will leverage your experience in ful...Show more
    Last updated: 30+ days ago • Promoted
    US Sales Professional

    US Sales Professional

    ScaleneWorks • Gurgaon, Jharkhand, India
    Quick Apply
    We are seeking a high-performing, self-driven US Sales Professional to operate from India and lead new logo.This is a pure hunting role, focused on building and growing your own pipeline.You must h...Show more
    Last updated: 30+ days ago
    AWS Data Engineer

    AWS Data Engineer

    Epergne Solutions • Gurgaon, Jharkhand, India
    Quick Apply
    Job Roles & Responsibilities.Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-performance code using PySpark / Python with best practices.Perform code...Show more
    Last updated: 30+ days ago
    IAM Developer

    IAM Developer

    ScaleneWorks • Gurgaon, Jharkhand, India
    Quick Apply
    Skill set for Aveksa Role : 5 to 12 years of experience as a PL SQL\python\PS developer or Identity / Access Governance delivery and engineering. Well versed in writing stored procedures and writing co...Show more
    Last updated: 30+ days ago
    SQL Developer - Data Analytics

    SQL Developer - Data Analytics

    TechnoRight • Jharkhand
    Job Description : Job Responsibilities : - Design, develop, and maintain efficient database solutions...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer

    Principal Engineer

    ScaleneWorks • Gurgaon, Jharkhand, India
    Quick Apply
    Strong leadership qualities, including the ability to motivate, inspire, and guide the team.Strong analytical and problem-solving skills to identify challenges and develop effective solutions.Good ...Show more
    Last updated: 30+ days ago
    Solution Architect- Banking

    Solution Architect- Banking

    Saaki Argus & Averil Consulting • Gurgaon, Jharkhand, India
    Quick Apply
    Title : Solution Architect- Banking Domain.Lead and Execute RFI / RFP / RFQ / VDD / Proactive Proposals for the BFS domain. Will be responsible for overall Bid management, PreSales and team management of t...Show more
    Last updated: 30+ days ago
    Virtual Design and Construction Coordinator

    Virtual Design and Construction Coordinator

    BIM Elevate • Jhārkhand, Republic Of India, IN
    BIM Elevate provides a wide range of cutting-edge BIM services, including 3D modeling, clash detection, coordination, project management, and virtual design assistance. Committed to transforming the...Show more
    Last updated: 1 day ago • Promoted
    Power BI Developer

    Power BI Developer

    Epergne Solutions • Gurgaon, Jharkhand, India
    Quick Apply
    Job Title : Power BI Developer.Immediate / 15 Days Notice Period.We are looking for an experienced.The ideal candidate should have strong skills in data modeling, DAX, and visualization best practi...Show more
    Last updated: 12 days ago
    Garden's Need - Area Sales Manager

    Garden's Need - Area Sales Manager

    GARDEN'S NEED PRIVATE LIMITED • Jharkhand, India
    Description : Role Summary : Gardens Need Pvt.Consumer Products / Agri & Garden segment, is seeking a results-driven Area Sales Manager (ASM) to ...Show more
    Last updated: 10 days ago • Promoted
    Site Engineer

    Site Engineer

    Medhaj Techno Concept Pvt. Ltd. • Jharkhand, India, India
    We are looking for qualified professionals from the.Electrical / Electrical & Electronics Engineering (EE / EEE).V and above transmission networks. Option 1 : Graduate Engineer (EE / EEE).V or higher-c...Show more
    Last updated: 2 days ago • Promoted
    Data Analyst

    Data Analyst

    TechnoRight • Jharkhand
    Job description and Understanding : Salary : 12 to 70 LPA Profile : Data Analyst ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Saaki Argus & Averil Consulting • Gurgaon, Jharkhand, India
    Quick Apply
    We are looking to hire Azure Data Engineers for a client who is a leader in the AI and Analytics solution.You will work on a broad range of cutting-edge data analytics problems.Design and build sca...Show more
    Last updated: 30+ days ago
    Power Network Implementation Specialist

    Power Network Implementation Specialist

    Medhaj Techno Concept Pvt. Ltd. • Jhārkhand, Republic Of India, IN
    We are looking for qualified professionals from the.Electrical / Electrical & Electronics Engineering (EE / EEE).V and above transmission networks. Option 1 : Graduate Engineer (EE / EEE).V or higher-c...Show more
    Last updated: 2 days ago • Promoted
    SAP-Data Analyst (Finance)

    SAP-Data Analyst (Finance)

    Epergne Solutions • Gurgaon, Jharkhand, India
    Quick Apply
    Noida / Gurgaon / Hyderabad / Bangalore / Pune.Job Roles & Responsibilities : -.Collaborate with Finance & FBT Teams : Drive all data-related activities for the finance SAP deployment, ensuring align...Show more
    Last updated: 30+ days ago