Senior Python Data EngineeriVoyant • indore, madhya pradesh, in
Senior Python Data Engineer
iVoyant • indore, madhya pradesh, in
17 hours ago
Job descriptionStrong proficiency in Python for data processing with hands-on expertise in Pandas. Ability to quickly learn new frameworks such as Polars if needed. Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding. Experience with Polars (not required). Experience with orchestration tools like Apache Airflow or ETL frameworks like DBT. Exposure to Snowflake (streams, tasks, stored procedures). Experience working with DuckDB and / or DocTV / OpenTI XLarge for report generation. Knowledge of Angular or frontend plugins for Excel is a plus but not required. Familiarity with async workflows and distributed processing concepts. Strong ownership mindset, proactive in identifying and solving problems. Collaborative team player, able to work cross-functionally with architects, engineers, and stakeholders. Comfortable working in a distributed, multicultural team across multiple time zones (Europe, India, U.S.). Adaptable and open to learning emerging tools and technologies. Global team with flexibility on candidate location. Current team members are distributed across the US, Latin America, Europe, and India. Candidates from other regions will be considered, provided there is reasonable overlap with core collaboration hours.
About the Project :
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it using efficient data processing libraries, and serving it through APIs. The team emphasizes scalability, maintainability, and developer productivity, incorporating spec-driven development powered by AI tools.
You’ll be contributing to the backend architecture and data pipeline powering this transformation, helping to evolve a high-performance system that's central to the client’s reporting domain.
Responsibilities :
- Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas required; Polars nice-to-have).
- Develop and expose RESTful APIs using FastAPI or similar frameworks.
- Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
- Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
- Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
- Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).
- Collaborate on infrastructure-as-code automation using Bicep similar tools (Terraform, CDK).
- Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
- Contribute to CI / CD pipelines using GitHub Actions.
Required Skills and Experience :
Nice-to-Have / Preferred Qualifications :
Soft Skills & Cultural Fit :
Work Environment / Time Zone Expectations :
Create a job alert for this search
Data Engineer Python • indore, madhya pradesh, in
Related jobs
For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer.
The Senior Data Engineer is responsible for the implementation of the set of...Show more
Senior Python Engineer
PICWA.io • indore, madhya pradesh, in
We're looking for a Senior Software Engineer with 9+ Years of experience as a Backend Engineer with expertise in Python and Flask.
Years of Python, particularly Flask Framework experience .Service-b...Show more
Last updated: 24 days ago • Promoted
Senior Data Engineer
Incept Labs, Inc. • indore, madhya pradesh, in
Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show more
Last updated: 1 hour ago • Promoted • New!
Senior AI / ML Engineer
Luxoft • indore, madhya pradesh, in
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 10 days ago • Promoted
Big Data Developer (Hive, Pyspark)
Tata Consultancy Services • indore, madhya pradesh, in
Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex).
Hands-on experience of Hadoop, Python, PySpark,...Show more
Last updated: 14 days ago • Promoted
Python Developer
True Tech Professionals • indore, madhya pradesh, in
Job Type : Full-time / Contractual.We’re looking for an experienced Data Engineer / Developer with strong hands-on expertise in Snowflake, Databricks, Python scripting, and REST API integration.The id...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD
All European Careers • indore, madhya pradesh, in
Remote
Last updated: 14 days ago • Promoted
Senior AWS Data Engineer
CYAN360 • indore, madhya pradesh, in
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
Last updated: 30+ days ago • Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Inc • indore, madhya pradesh, in
Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
Last updated: 13 days ago • Promoted
Data Engineer
Digitalzone • indore, madhya pradesh, in
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 14 days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • indore, madhya pradesh, in
TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services).
Strong expertise in Azure Data Engineering & ETL Co...Show more
Last updated: 30+ days ago • Promoted
AI Data Engineer
Peak Trust Global Real Estate • indore, madhya pradesh, in
This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical).
Build automated data collection workflows using tools suc...Show more
Last updated: 17 hours ago • Promoted • New!
Senior Python Developer
Intellify Solutions • indore, madhya pradesh, in
We are looking for an experienced.The ideal candidate should have a solid understanding of modern backend systems, architecture design, and performance optimization.
The role involves working on sca...Show more
Last updated: 11 days ago • Promoted
Backend Python Engineer - 17852
Turing • Indore, Madhya Pradesh, India
We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and ...Show more
Last updated: 11 days ago • Promoted
Big Data Developer(Hive, Pyspark)
Tata Consultancy Services • indore, madhya pradesh, in
Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Location : Bengaluru,Chennai,Hyderabad.Date of Interview : 6th Nov, 2025.
Mode of Interview : Virtual Drive( Cisco or WebEx).Hands-on ...Show more
Last updated: 27 days ago • Promoted
Azure Data Engineer
SystemBender • indore, madhya pradesh, in
Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show more
Last updated: 7 days ago • Promoted
LSE / Associate Architect - Big Data
Impetus • Indore, Madhya Pradesh, India
Lead Software Engineer / Associate Architect with proficiency in design and implmentation of scalable and robust data engineering solutions.
In-depth understanding of Big data concepts and distribut...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
NeerInfo Solutions • Indore, Madhya Pradesh, India
Professional & Technical Skills : .Must To Have Skills : Proficiency in Databricks Unified Data Analytics Platform.Good To Have Skills : Experience with Apache Spark and data warehousing solutions.Stro...Show more
Last updated: 19 hours ago • Promoted • New!
Azure data engineer
Stratus • indore, madhya pradesh, in
Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks.
Experience with Agile development methodologies and tools, such as Jira, t...Show more
Last updated: 7 days ago • Promoted