This job offer is not available in your country.
Data Integration Engineer - Python Frameworks
Velodata Global Pvt LtdKerala13 days ago
Job description4+ years of backend / data engineering experience Python (FastAPI, pydantic, httpx / requests, Playwright / Selenium), solid TypeScript for smaller services / SDKs Azure : Functions / Container Apps or AKS jobs, Storage / Blob, Key Vault, Monitor / Log Analytics Messaging : Service Bus / Queues, idempotence & exactly-once semantics, pragmatic approach Databases : PostgreSQL, pgvector, query design & performance tuning Clean ETL / ELT patterns, testability (pytest), observability (OpenTelemetry) NLP / IE experience (spaCy / regex / rapidfuzz), document parsing (pdfminer / textract) Experience with license / ToS-compliant data retrieval, captcha / anti-bot strategies (legally compliant) Working method : API-first, clean code, trunk-based development, mandatory code reviews Tools / stack : GitHub, GitHub Actions / Azure DevOps, Docker, pnpm / Turborepo (Monorepo), Jira / Linear, Notion / Confluence On-call / support : rotating, "you build it, you run it"
About the job
Designation : Data & Integration Engineer (Python / TypeScript, Azure, Integrations)
Experience : 4 -8 Years
Location : Cochin
Job Summary :
Build data pipelines (crawling / parsing, deduplication / delta, embeddings) and connect external systems and interfaces.
Key Responsibilities :
- Development of crawling / fetch pipelines (API-first; playwright / requests only where permitted)
- Parsing / normalization of job postings & CVs, deduplication / delta logic (seen hash, repost heuristics)
- Embeddings / similarity search (controlling Azure OpenAI, vector persistence in pgvector)
- Integrations : HR4YOU (API / webhooks / CSV import), SerpAPI, BA job board, email / SMTP
- Batch / stream processing (Azure Functions / container jobs), retry / backoff, dead-letter queues
- Telemetry for data quality (freshness, duplicate rate, coverage, cost per 1,000 items)
- Collaboration with FE for exports (CSV / Excel, presigned URLs) and admin configuration
Must Have Requirements :
Nice-to-have :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer Python • Kerala
Related jobs
- Promoted
Senior Data Engineer
DeltacubesKottayam, IN Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 14 days ago
- Promoted
Backend Python / AI Engineer
JuiceLabs AIKottayam, IN Where creative engineering meets applied AI.At JuiceLabs, we’re building vertical AI-native tools that unlock fresh insights and creative superpowers for our clients in advertising, ecommerce, and ...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
Manuh TechnologiesKottayam, IN Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing.
Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Aceolutionmount, kerala, in We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
CoreTek Labskottayam, kerala, in We’re Hiring for Top MNC –Senior Data Engineer! 📢.Notice Period : immediate to October joiners.Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer).
Do not go for data bricks or dat...Show moreLast updated: 5 days ago
- Promoted
Senior Data Engineer
SAIVA AIKottayam, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
Tredence Inc.kottayam, kerala, in Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake.
Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Eucloid Data Solutionsmount, kerala, in Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 6 days ago
- Promoted
Backend and Data Pipeline Engineer
JRD SystemsKochi, IN Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
Innodata Inc.Kottayam, IN CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 24 days ago
- Promoted
Senior Data Engineer
Manuh TechnologiesKottayam, IN Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing.
Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Exult Globalkochi, kerala, in Proficient in Python (Including popular python packages e.Strong background in distributed data processing and storage (e.
Large scale (TBs of data) data engineering skills - Model data, create prod...Show moreLast updated: 19 days ago
- Promoted
Senior Data Engineer
Straivemount, kerala, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
INFEC Servicesernakulam, kerala, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 3 days ago
- Promoted
AI Engineer
GumoKottayam, IN Design, build, and maintain our AI-driven knowledge graph creation pipeline.Integrate third-party APIs for web scraping (e.
Tavily), and multimedia processing.Develop and refine sophisticated prompt...Show moreLast updated: 3 days ago
- Promoted
Data Analyst - Python / SQL
PLEXO HR SolutionsKottayam, IN Seeking experienced Data Analyst to join our analytics team! Work with cutting-edge tools and technologies.Perfect opportunity for data enthusiasts to make strategic impact through insights and ana...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
HISH IT SERVICESKottayam, IN Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Canopus Infosystems - A CMMI Level 3 CompanyKottayam, IN Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 17 days ago
- Promoted
Data Integration & LLM Engineer
Chargebeemount, kerala, in We are seeking a highly motivated.This role is ideal for engineers who enjoy working at the intersection of.APIs, SaaS connectors, and ETL / ELT pipelines to ensure reliable and scalable data flows.B...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
VAANTECHmount, kerala, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago