Data Engineer - Python / SQL / ETL

SUPERSOURCING TECHNOLOGIES PRIVATE LIMITEDIndore

1 day ago

Job description

Job Title : Data Engineer

Experience : 5+ Years

Location : Indore

Employment Type : Full-Time

Mandatory Tech Stack :

Programming : Python
Big Data Processing : PySpark
Database : SQL
ETL Tools & Processes
Platform : Databricks

Key Responsibilities :

Design, develop, and maintain scalable data pipelines and ETL workflows.

Work with large datasets using PySpark for data transformation and processing.

Write and optimize SQL queries for data extraction, reporting, and analytics.

Implement data quality checks, validation, and monitoring mechanisms.

Collaborate with Data Scientists, Analysts, and Business stakeholders to deliver insights.

Develop and maintain solutions on Databricks for data integration and analytics.

Ensure compliance with data governance, security, and performance standards.

Troubleshoot data-related issues and optimize pipeline performance.

Required Skills & Experience :

Minimum 5+ years of experience in Data Engineering.

Strong expertise in Python and PySpark for big data processing.

Proven ability to design and maintain ETL pipelines.

Proficiency in SQL and working with relational as well as NoSQL databases.

Hands-on experience with Databricks.

Good understanding of data modeling, data warehousing concepts, and distributed systems.

Strong analytical and problem-solving skills.

Excellent communication and teamwork abilities.

Good to Have :

Experience with cloud platforms (AWS, Azure, GCP).

Familiarity with Delta Lake, Apache Kafka, or similar technologies.

Exposure to Agile methodologies and DevOps practices.

Knowledge of data security, compliance, and governance frameworks.

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Indore

Related jobs

Promoted

Azure Data Engineer

K&K Talents - Indiaindore, madhya pradesh, in

This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent. We are seeking an experienced Data Engineer with strong...Show moreLast updated: 24 days ago

Promoted

Backend and Data Pipeline Engineer

JRD Systemsindore, madhya pradesh, in

Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIindore, madhya pradesh, in

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Python Data Engineer

iVoyantindore, madhya pradesh, in

One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 14 days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicesindore, madhya pradesh, in

TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 12 days ago

Promoted

Data Engineer(Azure / AWS, Python / Pyspark, SQL)

Sail Analyticsindore, madhya pradesh, in

Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeindore, madhya pradesh, in

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response Informaticsindore, madhya pradesh, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

LTIMindtreeindore, madhya pradesh, in

We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Dexian Indiaindore, madhya pradesh, in

Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

Straiveindore, madhya pradesh, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted

Platform Engineer – Python / Databricks / Notebooks / Kubernetes

Syntasaindore, madhya pradesh, in

Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

AIMLEAPindore, madhya pradesh, in

Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

Intelliasindore, madhya pradesh, in

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 3 days ago

Promoted
New!

Remote - Python SQL Developer

KPG99 INCindore, madhya pradesh, in

Remote

Position : Python SQL Developer.Long term annually extending contract.Minimum of 7 years’ experience in a similar role, with a focus on data management and process automation.NEED SOMEONE WHO CAN H...Show moreLast updated: 6 hours ago

Promoted

Sr Data Engineer

Mitchell Martin Inc.indore, madhya pradesh, in

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 16 days ago

Promoted

Data Engineer

Tata Consultancy Servicesindore, madhya pradesh, in

Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago

Promoted

Python Developer

LTIMindtreeindore, madhya pradesh, in

Experience : 5 years to 12 years.Notice : Immediate to 30 Days only.Mandatory skills : Python Data Engineer, AWS and services. Strong programming skills in Python, including libraries like Pandas, NumP...Show moreLast updated: 1 day ago