Talent.com
Senior Python Data Engineer

Senior Python Data Engineer

iVoyantJhārkhand, Republic Of India, IN
5 days ago
Job description

About the Project :

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it using efficient data processing libraries, and serving it through APIs. The team emphasizes scalability, maintainability, and developer productivity, incorporating spec-driven development powered by AI tools.

You’ll be contributing to the backend architecture and data pipeline powering this transformation, helping to evolve a high-performance system that's central to the client’s reporting domain.

Responsibilities :

  • Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas required;

Polars nice-to-have).

  • Develop and expose RESTful APIs using FastAPI or similar frameworks.
  • Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
  • Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
  • Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
  • Integrate with messaging and storage mechanisms (e.G., Service Bus, Storage Accounts).
  • Collaborate on infrastructure-as-code automation using Bicep similar tools (Terraform, CDK).
  • Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
  • Contribute to CI / CD pipelines using GitHub Actions.
  • Required Skills and Experience :

  • Strong proficiency in Python for data processing with hands-on expertise in Pandas.
  • Ability to quickly learn new frameworks such as Polars if needed.
  • Experience building backend services or APIs using frameworks like FastAPI.
  • Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.
  • Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).
  • Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar).
  • Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).
  • Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
  • Nice-to-Have / Preferred Qualifications :

  • Experience with Polars (not required).
  • Experience with orchestration tools like Apache Airflow or ETL frameworks like DBT.
  • Exposure to Snowflake (streams, tasks, stored procedures).
  • Experience working with DuckDB and / or DocTV / OpenTI XLarge for report generation.
  • Knowledge of Angular or frontend plugins for Excel is a plus but not required.
  • Familiarity with async workflows and distributed processing concepts.
  • Soft Skills & Cultural Fit :

  • Strong ownership mindset, proactive in identifying and solving problems.
  • Collaborative team player, able to work cross-functionally with architects, engineers, and stakeholders.
  • Comfortable working in a distributed, multicultural team across multiple time zones (Europe, India, U.S.).
  • Adaptable and open to learning emerging tools and technologies.
  • Work Environment / Time Zone Expectations :

  • Global team with flexibility on candidate location.
  • Current team members are distributed across the US, Latin America, Europe, and India.
  • Candidates from other regions will be considered, provided there is reasonable overlap with core collaboration hours.
  • Create a job alert for this search

    Data Engineer Python • Jhārkhand, Republic Of India, IN

    Related jobs
    • Promoted
    Big Data Developer (Hive, Pyspark)

    Big Data Developer (Hive, Pyspark)

    Tata Consultancy Servicesranchi, jharkhand, in
    Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex). Hands-on experience of Hadoop, Python, PySpark,...Show moreLast updated: 19 days ago
    • Promoted
    Python Developer

    Python Developer

    Tata Consultancy Servicesranchi, jharkhand, in
    Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.comranchi, jharkhand, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show moreLast updated: 2 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Live Connectionsranchi, jharkhand, in
    We’re Hiring – Senior Engineers.Open Position 1 – Senior Engineer.Strong frontend or strong full-stack expertise.Experience in design / architecture. Must have worked in a large e-commerce environment...Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesranchi, jharkhand, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.Airanchi, jharkhand, in
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 1 day ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connectionsranchi, jharkhand, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show moreLast updated: 9 days ago
    • Promoted
    Python Software Engineer

    Python Software Engineer

    Teamware Solutionsranchi, jharkhand, in
    Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Role : Python Software Engineer - IC.Location : Bangalore / Hyderabad / pune / Mumbai. Shift : (Flexibility Required) / ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutionsranchi, jharkhand, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careersranchi, jharkhand, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltdranchi, jharkhand, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 2 days ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyantranchi, jharkhand, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 5 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Forage AIranchi, jharkhand, in
    Role Overview (Hands‑on Player‑Coach).You’ll work closely with engineers—reviewing designs and PRs, pairing on tricky problems, and raising the bar on architecture, reliability, security, and perfo...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connectionsranchi, jharkhand, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesranchi, jharkhand, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 27 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Groupranchi, jharkhand, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 2 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR Techranchi, jharkhand, in
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 11 days ago
    • Promoted
    Python Developer

    Python Developer

    GoMLranchi, jharkhand, in
    We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show moreLast updated: 3 days ago