This job offer is not available in your country.
Senior Python Developer - ETL & Data Pipeline Automation
Geektrust.comBangalore11 days ago
Job descriptionDesign, develop, and automate scalable ETL workflows using Python and Pandas. Implement and manage data ingestion and transformation processes using Hive SQL for data warehousing. Configure, monitor, and optimize Elasticsearch clusters for indexing, searching, and analytics performance. Build and maintain RESTful APIs using Flask to facilitate secure data exchange. Collaborate with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting tools. Ensure high standards of data quality, reliability, and integrity throughout the pipeline. Monitor performance, debug issues, and tune queries for maximum efficiency. Document data flows, pipeline architecture, and automation logic clearly. 8-12+ years of experience in professional Python development. Proven expertise in designing and building backend systems and APIs at scale. Strong experience with LLMs, GenAI integrations, Agentic workflows and AI-enhanced workflows. Solid understanding of microservices architecture and distributed systems. Proficiency in automated testing and observability best practices. Hands-on experience building and maintaining CI / CD pipelines. Strong problem-solving, communication, and stakeholder management skills. Python, LLD / HLD, AI / LLM, Unit Testing, Code Reviews, CI / CD pipelines, Frameworks like Fast API, Database like Postgres, Monitoring and visualisation tools like Prometheus and Grafana, Team Leading Architect and develop secure, scalable backend systems using Python. Lead high- and low-level design (HLD / LLD) with a focus on modularity, fault tolerance, and API best practices. Champion performance optimization and drive observability improvements across services. Integrate Large Language Models (LLMs) and GenAI-powered features into core applications. Build robust systems that mitigate hallucinations and improve AI reliability. Leverage agentic frameworks and AI-driven automation for process enhancement Practical experience with OpenAI developer ecosystem, including APIs (Completions, Responses, Files) and tools / SDKs (Agents SDK, Web Search). Familiarity with agent debugging / monitoring tools (Phoenix, LangSmith, or similar). Define and enforce engineering best practices across testing, code reviews, and quality gates. Ensure strong observability through logging, monitoring, and alerting tools. Write unit, integration, and functional tests to support high-reliability systems. Build and manage CI / CD pipelines for automated testing and smooth deployments. Ensure deployment processes support rollback, scalability, and system health. Collaborate closely with product, data, business, and DevOps teams to align on solution delivery. Mentor and support junior engineers, fostering a culture of continuous improvement and technical excellence. Strong Python development skills with experience in frameworks like FastAPI Proven experience designing REST APIs, microservices, and backend architectures. Experience integrating with databases (e.g., PostgreSQL) for real-time and batch workloads. Experience working with data pipelines and ETL frameworks (e.g., jobs moving data from GCP - Postgres) and integrating this data into backend services or AI workflows.
Role overview :
- Proficient in Python, with hands-on experience using Pandas for large dataset processing.
- Solid knowledge of ETL frameworks and pipeline automation strategies.
- Experience with Elasticsearch : indexing, querying, and optimizing for performance.
- Strong command of Hive SQL and working with distributed data systems.
- Experience building APIs using Flask or similar Python frameworks.
- Understanding of data modeling, schema design, and workflow orchestration.
- Strong debugging, analytical, and communication skills.
What would you do here :
Senior Level :
Required Skills & Experience :
Must Have :
Key Responsibilities :
System Architecture & Design :
AI / LLM Integration :
Engineering Excellence :
DevOps & Deployment :
Collaboration & Leadership :
Python & Backend Engineering :
(ref : hirist.tech)
Create a job alert for this search
Senior Etl Developer • Bangalore
Related jobs
- Promoted
- New!
Python Automation Lead
Sourcebaehosur, tamil nadu, in Python scripting, Pytest, and CI / CD pipelines, preferably with experience in storage or embedded systems.The role involves designing automation frameworks, validating systems, and collaborating wit...Show moreLast updated: 12 hours ago
- Promoted
ETL Developer
Pinnacle Group, Inc.hosur, tamil nadu, in PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes.
Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
- Promoted
ETL LEAD with IBM DataStage experienced
IntraEdgehosur, tamil nadu, in ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
- Promoted
Python Developer - ETL & Data Pipeline Automation
GeekTrustBangalore Job Role / Title : Python Developer ETL & Data Pipeline Automation Experience Range : 5-14 Location : Ba...Show moreLast updated: 6 days ago
- Promoted
NucleusTeq - Senior Python Developer - ETL / SQL
NucleusTeq Consulting Pvt. Ltd.Bangalore Experience : 6 Year + Role Description : - Strong Python programming with experience on building modular applications, API integrations and packaging.Stron...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Deltacubeshosur, tamil nadu, in Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
- Promoted
Python Automation - Storage
DDNhosur, tamil nadu, in This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades.
DataDirect Networks (DDN) is a globa...Show moreLast updated: 30+ days ago
- Promoted
AI developer / Support
Dexian Indiahosur, tamil nadu, in Understanding of the Basics of Machine Learning.Knowledge of Natural Language Processing (NLP) and NLP Algorithms.Familiarity with Vector Databases.
Experience with Azure Cloud and Deployments.Profi...Show moreLast updated: 26 days ago
- Promoted
- New!
Senior Data Engineer - Python / ETL
VSHR UNNATI LLPBangalore About The Role : We are looking for a detail-oriented and proactive Senior ETL Data Engineer with strong experience in data integration, transformation, and pipeline...Show moreLast updated: 6 hours ago
- Promoted
- New!
SnapLogic ETL & Python Lead
Swift Strategic Solutions IncBengaluru, Karnataka, India Our technology services client is seeking multiple.These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period.Below are further d...Show moreLast updated: 16 hours ago
- Promoted
- New!
Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)
Tech One ITBengaluru, IN We are seeking a highly skilled.EMDA (Environmental Monitoring Data Analytics) team.The role focuses on developing, deploying, and maintaining ETL workflows for a.
Pfizer’s global manufacturing site...Show moreLast updated: 16 hours ago
- Promoted
Data Engineer
INFEC Serviceshosur, tamil nadu, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
- Promoted
Backend Python / AI Engineer
JuiceLabs AIhosur, tamil nadu, in Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
SAIVA AIhosur, tamil nadu, in We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
- Promoted
Python Developer - ETL / ElasticSearch
geektrustBangalore What You'll Do : - Design & automate ETL workflows using Python and Pandas.Build and optimize data pipelines with Hive SQL & Elasticsearch.Develop RESTful APIs usi...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer - ETL / Python
East VantageBangalore Position : Senior Data Engineer Location : Bengaluru, India (Work From Anywhere) Job Type : Full-timeShow moreLast updated: 5 days ago
- Promoted
Senior ETL Developer
BCE Global TechBengaluru, Karnataka, India At BCE Global Tech, immerse yourself in exciting projects that are shaping the future of both consumer and enterprise telecommunications.
This involves building innovative mobile apps to enhance use...Show moreLast updated: 24 days ago
- Promoted
Python Automation Governance
Vista Applied Solutions Group Inchosur, tamil nadu, in Client is looking for Governance and Automation Platform for enforcing best practices.This is remote position from India.
Strong Python skills with emphasis on testing frameworks & automation.Experi...Show moreLast updated: 17 days ago