Senior Data EngineerAmerican Inference • Kottayam, IN
Senior Data Engineer
American Inference • Kottayam, IN
21 days ago
Job descriptionDesign lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg Build scalable PySpark pipelines for batch and streaming data Implement data quality, validation, and lineage tracking Integrate pipelines with MLflow for experiment tracking Optimize Spark performance and cloud cost Ensure data governance, PII protection, and security compliance Mentor developers and document patterns and runbooks Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization) Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks) MLflow integration for MLOps pipelines Kafka / Event Hubs for streaming data Strong Python and data modeling (dimensional, Data Vault) 5+ years hands-on in data engineering with production-grade systems Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation Experience with data governance technologies (such as MS Purview or similar) Certifications : Azure Data Engineer / Databricks DE UG : B.Tech / B.E. – Computer Science / Information Technology PG : M.Tech / M.E. / Any Postgraduate (preferred) Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization. Growth : Help shape and build our data-driven culture from the ground up. Learning : Work with the latest in AI, code, and data technologies. Culture : Flat hierarchy, collaborative, and outcome-driven team.
Note : Please apply directly through for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.
About the Company
We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :
- Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
- SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
- Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
- Government Contracting : Developing secure, compliant AI solutions for the public sector.
Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.
We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.
Role Overview
You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.
Key Responsibilities
Required Skills
Nice to Have
Education
Why Join Us
Create a job alert for this search
Senior Data Engineer • Kottayam, IN
Related jobs
Senior Data Engineer
VRIZE • Kottayam, IN
Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database.
Develop and optimize complex SQL queries for data extract...Show more
Last updated: 2 days ago • Promoted
Data Engineer
Randstad Enterprise • Kottayam, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Kottayam, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Donyati • Kottayam, IN
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 9 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • kottayam, India
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
Intellify Solutions • Kottayam, IN
Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a.
Required : Cloud Data Warehouse experi...Show more
Last updated: 14 days ago • Promoted
Data Engineer
IntraEdge • Kottayam, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Data Acquisition
InfoBeans • Kottayam, IN
We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
Last updated: 16 days ago • Promoted
Senior Data Engineer
Live Connections • Kottayam, IN
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RapidBrains • Kottayam, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 14 days ago • Promoted
Senior Data Engineer
Mindlance • Kottayam, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 7 days ago • Promoted
Senior Data Engineer
Arenema • Kottayam, IN
India (remote – Bangalore / Karnataka area preferred).Full-time contractor / employee.You will be a core member of the team building a data platform that maps economic, advertising and real-estate ac...Show more
Last updated: 9 hours ago • Promoted • New!
Data Engineer
Recro • Kottayam, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
BayOne Solutions • Kottayam, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Vriba Solutions • Kottayam, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Sr. Data Engineer
HNR Tech • Kottayam, IN
We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
Last updated: 16 days ago • Promoted
Senior Oracle Data Engineer
Strattek Consulting • Kottayam, IN
This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show more
Last updated: 9 days ago • Promoted
Data Engineer
Insight Global • Kottayam, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted