Talent.com
Senior Python Data Engineer
Senior Python Data EngineeriVoyant • Bharatpur, Republic Of India, IN
Senior Python Data Engineer

Senior Python Data Engineer

iVoyant • Bharatpur, Republic Of India, IN
23 days ago
Job description

About the Project :

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it using efficient data processing libraries, and serving it through APIs. The team emphasizes scalability, maintainability, and developer productivity, incorporating spec-driven development powered by AI tools.

You’ll be contributing to the backend architecture and data pipeline powering this transformation, helping to evolve a high-performance system that's central to the client’s reporting domain.

Responsibilities :

  • Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas required;

Polars nice-to-have).

  • Develop and expose RESTful APIs using FastAPI or similar frameworks.
  • Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
  • Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
  • Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
  • Integrate with messaging and storage mechanisms (e.G., Service Bus, Storage Accounts).
  • Collaborate on infrastructure-as-code automation using Bicep similar tools (Terraform, CDK).
  • Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
  • Contribute to CI / CD pipelines using GitHub Actions.
  • Required Skills and Experience :

  • Strong proficiency in Python for data processing with hands-on expertise in Pandas.
  • Ability to quickly learn new frameworks such as Polars if needed.
  • Experience building backend services or APIs using frameworks like FastAPI.
  • Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.
  • Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).
  • Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar).
  • Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).
  • Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
  • Nice-to-Have / Preferred Qualifications :

  • Experience with Polars (not required).
  • Experience with orchestration tools like Apache Airflow or ETL frameworks like DBT.
  • Exposure to Snowflake (streams, tasks, stored procedures).
  • Experience working with DuckDB and / or DocTV / OpenTI XLarge for report generation.
  • Knowledge of Angular or frontend plugins for Excel is a plus but not required.
  • Familiarity with async workflows and distributed processing concepts.
  • Soft Skills & Cultural Fit :

  • Strong ownership mindset, proactive in identifying and solving problems.
  • Collaborative team player, able to work cross-functionally with architects, engineers, and stakeholders.
  • Comfortable working in a distributed, multicultural team across multiple time zones (Europe, India, U.S.).
  • Adaptable and open to learning emerging tools and technologies.
  • Work Environment / Time Zone Expectations :

  • Global team with flexibility on candidate location.
  • Current team members are distributed across the US, Latin America, Europe, and India.
  • Candidates from other regions will be considered, provided there is reasonable overlap with core collaboration hours.
  • Create a job alert for this search

    Data Engineer Python • Bharatpur, Republic Of India, IN

    Similar jobs
    Senior Python Developer

    Senior Python Developer

    Cactus Communications • Bharatpur, Republic Of India, IN
    You will be a part of Cactus Labs which is the R&D Cell of Cactus Communications.Cactus Labs is a high impact cell that works to solve complex technical and business problems that help keep us stra...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    TechKareer • Bharatpur, Republic Of India, IN
    We’re looking for a cracked Senior Software Engineer who lives and breathes Python and enjoys building reliable integrations, automations, and internal tools for a fast-growing US startup.You’ll ow...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • Bharatpur, Republic Of India, IN
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Bharatpur, Republic Of India, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Senovo IT Ltd • Bharatpur, Republic Of India, IN
    GST registration required! B2B contract.Design, implement, and manage large-scale cloud infrastructure on.Ensure cloud environments follow best practices for. Automate deployment, configuration, and...Show more
    Last updated: 1 day ago • Promoted
    Remote Python Engineer

    Remote Python Engineer

    Turing • Bharatpur, Republic Of India, IN
    Remote
    We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and ...Show more
    Last updated: 3 days ago • Promoted
    Lead Python Engineer

    Lead Python Engineer

    RoundCircle • Bharatpur, Republic Of India, IN
    MLOps workflows, and a keen interest in working with cutting-edge technologies in the.Design, implement, and maintain MLOps pipelines for model training, evaluation, deployment, and monitoring.Coll...Show more
    Last updated: 2 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    GEMRAJ TECHNOLOGIES LIMITED • Bharatpur, Republic Of India, IN
    LLM - Python for Machine Learning.Short Term Contract (2 months).Python in production environments.Expert-level proficiency in Python and core libraries (Pandas, NumPy, AsyncIO, FastAPI, or similar...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Emeritus • Bharatpur, Republic Of India, IN
    At Emeritus, we're committed to teaching you the skills of the future by making.We achieve this by collaborating with more than 80 top-tier universities across the United States, Europe, Latin Amer...Show more
    Last updated: 19 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Bharatpur, Republic Of India, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 23 days ago • Promoted
    Python Coder

    Python Coder

    Aceolution • Bharatpur, Republic Of India, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 7 days ago • Promoted
    Senior Python / / Ai Engineer

    Senior Python / / Ai Engineer

    Luxoft • Bharatpur, Republic Of India, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 15 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    BrightEdge • Bharatpur, Republic Of India, IN
    Senior Software Engineer, Remote.The Software Engineer will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable dat...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Developer (Freelance / Contract)

    Senior Python Developer (Freelance / Contract)

    VARITE INC • Bharatpur, Republic Of India, IN
    India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico.Months Contract / 2 Months Freelance.An organisation based in San Francisco, California, is the world’s leading research ac...Show more
    Last updated: 2 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    VARITE INC • Bharatpur, Republic Of India, IN
    We’re Hiring : 100+ Remote Python Developers & Gen AI Engineers!.We have an exciting opportunity for you to work on.Build, optimize, and scale high-performance Python systems.Work on AI / LLM projects...Show more
    Last updated: 1 day ago • Promoted
    Python Data Engineer

    Python Data Engineer

    TechKareer • Bharatpur, Republic Of India, IN
    We're helping one of the biggest debt consulting companies in the US expand their IT team.If you get selected, you will be directly working with them. Please apply if you match with all of the Gener...Show more
    Last updated: 1 day ago • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consulting • Bharatpur, Republic Of India, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more
    Last updated: 23 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Huptech HR Solutions • Bharatpur, Republic Of India, IN
    Job Description : - Senior Python Developer.Job Location - Ahmedabad (Remote).Software Development : Write clean, scalable, and efficient Python code to develop software applications.Backend Developm...Show more
    Last updated: 30+ days ago • Promoted