This job offer is not available in your country.
Lead Python Platform Engineer
Persistent Systemspune, maharashtra, in26 days ago
Job descriptionArchitecture and reuse : Design and build a shared component library / SDK for pipelines : ingestion, parsing / OCR, extraction (RegEx now, LLM / SLM later), validation, enrichment, publishing. Define patterns / templates for Apache Beam pipelines and Databricks jobs; standardize configuration, packaging, versioning, CI / CD, and documentation. Create pluggable interfaces so multiple teams can swap extractors (Regex / LLM), OCR providers, and EMR publishers without code rewrites. Define repo strategy - shared / child repos for each use case Performance and reliability : Own end-to-end profiling and tuning : cProfile / py-spy / line_profiler, memory (tracemalloc), CPU vs I / O analysis. Instrument services with Elastic APM and correlate traces / metrics with Splunk logs; build dashboards and runbooks. Implement concurrency best practices : asyncio for I / O-bound, ThreadPool / ProcessPool for CPU-bound, batching, rate limiting, retries, etc. Implement robust LLM API rate limiting / governance : enforce provider TPM and concurrency caps, request queueing / token budgeting, and emit APM / Splunk metrics (throttle rate, queue depth, cost per job) with alerts. Establish SLOs / alerts for throughput, latency, error rates; set up DLQs and recovery patterns. Team enablement : Mentor devs, lead design reviews, codify best practices, write clear docs and examples. Partner with ML engineers on the future LLM / SLM path (evaluation harness, safety / PII, cost / perf). 7+ years Python with strong depth in performance and concurrency (asyncio, concurrent.futures, multiprocessing), profiling and memory tuning. Observability expertise : Elastic APM instrumentation and dashboarding; Splunk for logs and correlation; OpenTelemetry familiarity. Must have implemented LLM based solutions and supported them in production API engineering for high-throughput integrations (REST, OAuth2), resilience patterns, and secure handling of sensitive data. Strong architecture / design skills : clean interfaces, packaging shared libs, versioning, CI / CD (GitHub Actions / Azure DevOps), testing. 3+ years building large-scale data pipelines with Apache Beam and / or Spark, including hands-on Databricks experience (Jobs, Delta Lake, cluster tuning). Document processing : OCR (Tesseract, AWS Textract, Azure Form Recognizer), PDF parsing, text normalization. LLM / SLM integration experience (e.g., OpenAI / Azure AI, local SLMs), prompt / eval frameworks, PII redaction / guardrails. Cloud and tooling : AWS / Azure / GCP, Dataflow / Flink, Terraform, Docker; cost / performance tuning on Databricks. Security / compliance mindset (HIPAA), secrets management, least-privilege access. Competitive salary and benefits package Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
About Position :
We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc.,
- Role : Lead Python Platform Engineer – Architecture & Performance
- Location : All PSL Locations
- Experience : 3 to 7 Years
- Job Type : Full Time Employment
What You'll Do :
Expertise You'll Bring :
Benefits :
Values-Driven, People-Centric & Inclusive Work Environment :
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
Let’s unleash your full potential at Persistent - persistent.com / careers
“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”
Create a job alert for this search
Lead Engineer Python • pune, maharashtra, in
Related jobs
- Promoted
Lead Python Platform Engineer
Persistent SystemsPune, Maharashtra, India We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc.Role : Lead Python Platform Engineer – Architecture & Performance.
Job Type : Full Time Employment.Desi...Show moreLast updated: 25 days ago
- Promoted
Platform Engineer
Persistent SystemsPune, Maharashtra, India We are looking for platform engineer with hands on experience with kubernates, grafan, cloud with python.Location : All Persistent Locations.
Job Type : Full Time Employment.Build reusable workflows u...Show moreLast updated: 18 days ago
- Promoted
Python Dev Lead with React
Persistent SystemsPune, Maharashtra, India Technical Architect with expert knowledge in Python (Django, Flask) and React frontend technologies, combined with strong expertise in the Travel and Hospitality industry.The candidate will design ...Show moreLast updated: 18 days ago
- Promoted
Technical Lead
Xponential Technology ServicesPune, Maharashtra, India Tech Lead / System Analyst At XTS we are redefining how learning content is created and delivered.We’re building an AI-powered SaaS platform using React, Python, OpenAI, and AWS, empowering organi...Show moreLast updated: 7 days ago
- Promoted
- New!
▷ Urgent : Lead Python Platform Engineer
Persistent SystemsPune, Maharashtra, India About Position : We are hiring for Lead Python engineer with hands on experience with Apache Beam, databricks etc.Role : Lead Python Platform Engineer – Architecture & Performance - Location : All PS...Show moreLast updated: 3 hours ago
- Promoted
Senior Software Engineer - Python Programming
HyrEzy Talent SolutionsPune Job Description : Responsibilities : - Responsible for handling the product issues' analysis, troubleshooting, and resoluti...Show moreLast updated: 30+ days ago
- Promoted
CrelioHealth - Technical Lead - Python
CRELIANT SOFTWARE PRIVATE LIMITEDPune Role : Technical Lead.Experience : 5 - 13 Years.Location : Pune, Baner.Job Description : - Design, build and maintai...Show moreLast updated: 30+ days ago
- Promoted
Rapid7 - Senior Software Engineer - Python
Rapid7Pune About the Role : The Senior Software Engineer on the Vulnerability Coverage team will play a pivotal role in expanding the Rapid7 coverage portfolio to provide custome...Show moreLast updated: 30+ days ago
- Promoted
Backend Python / AI Engineer
JuiceLabs AIPune, IN Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 9 days ago
- Promoted
GCP Cloud Platform Engineer @ Pune
Quess IT StaffingPune, Maharashtra, India Position : GCP Cloud Platform Engineer Location : Pune Duration : Contract to Hire Job Description : GCP Platform Engineering Kubernetes, Terraform.Show moreLast updated: 30+ days ago
- Promoted
Sensia Global - Lead Engineer - Python
Sensia GlobalPune About the Role : We're looking for a highly skilled and experienced Lead Engineer to join our team.You will be a key player in designing, developing, and deploy...Show moreLast updated: 13 days ago
- Promoted
Technical Lead - Python Development
HARP Technologies and ServicesPune Role : Technical Lead Python Developer Location : Pune / Bengaluru / Chennai / Noida <...Show moreLast updated: 25 days ago
- Promoted
Rapid7 - Principal Software Engineer - Python Technologies
Rapid7Pune Prinicipal Software Engineer on the Vulnerability Coverage team will help set technical direction for delivering accurate vulnerability detections to our customers in a timely manner.They...Show moreLast updated: 13 days ago
- Promoted
- New!
Python lead
Solytics PartnersPune, Maharashtra, India Strong proficiency in Python with at least 5 years of hands-on experience.Deep understanding of the Django framework and asynchronous programming.
Proficient in working with SQL databases and Elasti...Show moreLast updated: 5 hours ago
- Promoted
AWS Cloud Engineer - Terraform
People Prime World WidePune Key Responsibilities : - Design, implement, and manage cloud infrastructure using AWS and Terraform.Develop and maintain configuration ma...Show moreLast updated: 25 days ago
- Promoted
Zywave - Senior Data Platform Engineer - Python / Tableau
ZywavePune About the job : Job Title : Senior Data Platform Engineer Location : Pune, India Work Mode : Wor...Show moreLast updated: 27 days ago
- Promoted
Solytics Partners - Python Lead - Django Framework
Solytics partnersPune Position : Python Lead Experience : 5+ Years Job Type : Full-time Job Summ...Show moreLast updated: 2 days ago
- Promoted
Technical lead - Platform Engineer
MUFG Pension & Market ServicesPune, Maharashtra, India Description for Internal Candidates.The Individual will lead the team from a technical perspective and provide IT support related to the MPMS Retirement Solutions application environments and inter...Show moreLast updated: 25 days ago
- Promoted
Technical Lead - Python Frameworks
LIFTU TECHNOLOGY PRIVATE LIMITEDPune Technical Lead : At ChiStats, were looking for a Technical Lead to drive high-impact engineering outcomes for a forward-...Show moreLast updated: 1 day ago
- Promoted
- New!
Senior Python Developer
Programmers.ioPune, Maharashtra, India The ideal candidate will have strong expertise in.REST APIs, webhooks, and advanced authentication mechanisms.You should also have practical exposure to.
Experience Required : 5-10 Years.Python devel...Show moreLast updated: 5 hours ago