Talent.com
This job offer is not available in your country.
Python Developer - ETL & Data Pipeline Automation

Python Developer - ETL & Data Pipeline Automation

GeekTrustBangalore
6 days ago
Job description

Job Role / Title : Python Developer ETL & Data Pipeline Automation

Experience Range : 5-14

Location : Bangalore(Hybrid) -looking for Immediate to 20 days notice

About the Role :

We are looking for a Senior Python Developer (L6) to join our engineering team and lead the development of robust, scalable backend systems while integrating cutting-edge AI / LLM solutions.

This role sits at the intersection of backend engineering, data pipelines, and AI / GenAI integration, requiring strong expertise in Python, ETL workflows, distributed systems, and large-scale system design. Beyond writing high-quality code, you will lead by example, mentor peers, and collaborate cross-functionally to deliver high-impact, data-driven, and AI-powered solutions.

Key Responsibilities Architecture & Backend Engineering :

  • Architect, design, and implement secure, scalable backend systems using Python.
  • Develop and optimize ETL workflows and data pipelines leveraging Pandas, Hive SQL, and distributed data systems.
  • Design and maintain RESTful APIs using Flask / FastAPI, ensuring modularity, scalability, and reliability.
  • Integrate structured / unstructured data pipelines into backend services and AI workflows.
  • Ensure high performance, fault tolerance, and observability across all services.

AI / LLM & Data Integration :

  • Integrate Large Language Models (LLMs) and GenAI-powered features into core applications.
  • Build robust AI-driven systems with safeguards against hallucinations and reliability issues.
  • Leverage agentic frameworks and AI automation for workflow enhancement.
  • Practical experience with OpenAI developer ecosystem (Completions, Responses, Files) and SDKs (Agents SDK, Web Search).
  • Familiarity with AI debugging / monitoring tools (Phoenix, LangSmith, etc.).
  • Configure, monitor, and optimize Elasticsearch clusters for indexing, querying, and analytics performance.
  • Engineering Excellence & DevOps :

  • Define and enforce best practices in coding, testing, code reviews, and CI / CD automation.
  • Ensure strong observability through logging, monitoring, and alerting.
  • Write unit, integration, and functional tests to ensure high-reliability systems.
  • Build and maintain CI / CD pipelines to support automated testing, smooth deployments, and rollback strategies.
  • Collaboration & Leadership :

  • Partner with Data Scientists, Analysts, and cross-functional teams to enable data-driven applications and reporting.
  • Mentor junior engineers and champion a culture of engineering excellence.
  • Collaborate with stakeholders to align solutions with business and product goals.
  • Document pipeline architecture, automation logic, and API specifications clearly.
  • Required Skills & Experience :

  • 5 to 12+ years of professional Python development experience.
  • Proven expertise in backend system design, microservices, and APIs at scale.
  • Strong experience with data pipelines, ETL frameworks, and distributed data systems.
  • Hands-on experience with Pandas, Hive SQL, Elasticsearch, and workflow orchestration.
  • Expertise in LLMs, GenAI integrations, and AI-enhanced / agentic workflows.
  • Proficiency in Flask / FastAPI for backend / API development.
  • Strong database experience (e.g., PostgreSQL) across real-time and batch workloads.
  • Solid knowledge of DevOps practices including CI / CD, monitoring, and observability.
  • Excellent debugging, problem-solving, and communication skills.
  • Demonstrated leadership in mentoring, cross-team collaboration, and stakeholder management
  • (ref : hirist.tech)

    Create a job alert for this search

    Python Developer Etl • Bangalore