No longer accepting applications

Senior Python Data Engineer

iVoyantNellore, IN

6 days ago

Job description

About the Project :

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season. The core goal is to modernize and significantly accelerate the generation of Excel-based reports, reducing report generation time from minutes to seconds. This involves ingesting data from multiple upstream systems, transforming it using efficient data processing libraries, and serving it through APIs. The team emphasizes scalability, maintainability, and developer productivity, incorporating spec-driven development powered by AI tools.

You’ll be contributing to the backend architecture and data pipeline powering this transformation, helping to evolve a high-performance system that's central to the client’s reporting domain.

Responsibilities :

Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas required; Polars nice-to-have).
Develop and expose RESTful APIs using FastAPI or similar frameworks.
Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code.
Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).
Collaborate on infrastructure-as-code automation using Bicep similar tools (Terraform, CDK).
Participate in design discussions for future migration to Snowflake and / or a data lake architecture.
Contribute to CI / CD pipelines using GitHub Actions.

Required Skills and Experience :

Strong proficiency in Python for data processing with hands-on expertise in Pandas.

Ability to quickly learn new frameworks such as Polars if needed.

Experience building backend services or APIs using frameworks like FastAPI.

Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.

Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).

Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar).

Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).

Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.

Nice-to-Have / Preferred Qualifications :

Experience with Polars (not required).

Experience with orchestration tools like Apache Airflow or ETL frameworks like DBT.

Exposure to Snowflake (streams, tasks, stored procedures).

Experience working with DuckDB and / or DocTV / OpenTI XLarge for report generation.

Knowledge of Angular or frontend plugins for Excel is a plus but not required.

Familiarity with async workflows and distributed processing concepts.

Soft Skills & Cultural Fit :

Strong ownership mindset, proactive in identifying and solving problems.

Collaborative team player, able to work cross-functionally with architects, engineers, and stakeholders.

Comfortable working in a distributed, multicultural team across multiple time zones (Europe, India, U.S.).

Adaptable and open to learning emerging tools and technologies.

Work Environment / Time Zone Expectations :

Global team with flexibility on candidate location.

Current team members are distributed across the US, Latin America, Europe, and India.

Candidates from other regions will be considered, provided there is reasonable overlap with core collaboration hours.

Create a job alert for this search

Data Engineer Python • Nellore, IN

Related jobs

Promoted

Senior Python Data Engineer

iVoyantnellore, andhra pradesh, in

Promoted

Senior AI / ML Engineer

LuxoftNellore, IN

Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show moreLast updated: 15 days ago

Promoted

Data Engineer

AceolutionNellore, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Intellify SolutionsNellore, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 10 days ago

Promoted

Senior Oracle Data Engineer

Strattek ConsultingNellore, IN

This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 5 days ago

Promoted

AI Engineer (Backend) - Python

Edstem TechnologiesNellore, IN

We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show moreLast updated: 5 days ago

Promoted
New!

Senior Data Engineer

K&K Talentsnellore, andhra pradesh, in

Promoted

Senior Python Developer

Aarav Solutionsnellore, andhra pradesh, in

Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RecroNellore, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Live ConnectionsNellore, IN

Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago

Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European CareersNellore, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 5 days ago

Promoted

Senior / Lead / Principal SDET - Python automation(Storage)

DDNNellore, IN

This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

DonyatiNellore, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 5 days ago

Promoted

Data Engineer

DigitalzoneNellore, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 19 days ago

Promoted

Data Engineer (GCP)

HISH IT SERVICESNellore, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 11 days ago

Promoted

Data Engineer

TEKsystemsNellore, IN

Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications. Hands-on experience with ETL pipeline development, schema desi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Architect- Snowflake

USEReadyNellore, IN

USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show moreLast updated: 3 days ago

Promoted

Data Engineer

IntraEdgeNellore, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago