Senior Data EngineerAmerican Inference • Lucknow, IN
No longer accepting applications
Senior Data Engineer
American Inference • Lucknow, IN
18 days ago
Job descriptionDesign lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg Build scalable PySpark pipelines for batch and streaming data Implement data quality, validation, and lineage tracking Integrate pipelines with MLflow for experiment tracking Optimize Spark performance and cloud cost Ensure data governance, PII protection, and security compliance Mentor developers and document patterns and runbooks Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization) Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks) MLflow integration for MLOps pipelines Kafka / Event Hubs for streaming data Strong Python and data modeling (dimensional, Data Vault) 5+ years hands-on in data engineering with production-grade systems Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation Experience with data governance technologies (such as MS Purview or similar) Certifications : Azure Data Engineer / Databricks DE UG : B.Tech / B.E. – Computer Science / Information Technology PG : M.Tech / M.E. / Any Postgraduate (preferred) Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization. Growth : Help shape and build our data-driven culture from the ground up. Learning : Work with the latest in AI, code, and data technologies. Culture : Flat hierarchy, collaborative, and outcome-driven team.
Note : Please apply directly through for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.
About the Company
We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :
- Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
- SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
- Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
- Government Contracting : Developing secure, compliant AI solutions for the public sector.
Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.
We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.
Role Overview
You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.
Key Responsibilities
Required Skills
Nice to Have
Education
Why Join Us
Create a job alert for this search
Senior Data Engineer • Lucknow, IN
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Senior Data Engineer
DataOrbit AI • Lucknow, IN
DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness.
By uniting strategy, data preparation, technology, and execution, w...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Intellias • Lucknow, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 20 days ago • Promoted
Data Engineer
Recro • Lucknow, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Live Connections • Lucknow, IN
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
MyData Insights Pvt Ltd • Lucknow, IN
The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
Last updated: 4 days ago • Promoted
Data Engineer
Aceolution • Lucknow, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Tata Consultancy Services • Lucknow, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Insight Global • Lucknow, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Mindlance • Lucknow, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 4 days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • Lucknow, IN
Remote
Last updated: 6 days ago • Promoted
Data Engineer
BayOne Solutions • Lucknow, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Intellify Solutions • Lucknow, IN
Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a.
Required : Cloud Data Warehouse experi...Show more
Last updated: 11 days ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Lucknow, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
K&K Talents • Lucknow, IN
This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai.
Tableau | ETL / ELT | SQL | Python | Snow...Show more
Last updated: 1 day ago • Promoted
Data Engineer
IntraEdge • Lucknow, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Digitalzone • Lucknow, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 20 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • lucknow, uttar pradesh, in
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 10 hours ago • Promoted • New!
Data Engineer (GCP)
HISH IT SERVICES • Lucknow, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 12 days ago • Promoted