Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from various sources and storage systems.
Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
Leading the implementation of algorithms and prototypes to transform raw data into useful information.
Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
Creating innovative data validation methods and data analysis tools.
Ensuring compliance with data governance and security policies.
Interpreting data trends and patterns to establish operational alerts.
Developing analytical tools, programs, and reporting mechanisms.
Conducting complex data analysis and presenting results effectively.
Preparing data for prescriptive and predictive modeling.
Continuously exploring opportunities to enhance data quality and reliability.
Applying strong programming and problem-solving skills to develop scalable solutions.
Passion for testing strategy, problem-solving, and continuous learning.
Willingness to acquire new skills and knowledge.
Possess a product / engineering mindset to drive impactful data solutions.
Experience working in distributed environments with global teams.
Technical Skills and Experience requirements :
Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Python, Scala and Spark for applied large-scale data processing.
Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Experience with RDBMS and OLAP databases like MySQL, Snowflake.
Familiarity with Agile methodologies.
Obsession for service observability, instrumentation, monitoring, and alerting.
Knowledge or experience in architectural best practices for building data lakes.
Create a job alert for this search
Data Engineer Python • rajkot, India
Related jobs
Senior Data Engineer
SAIVA AI • Rajkot, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
IntraEdge • Rajkot, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Senior Python Data Engineer
iVoyant • Rajkot, IN
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
Last updated: 15 days ago • Promoted
Lead Data Engineer
People Prime Worldwide • Rājkot, Republic Of India, IN
We’re Hiring : Senior / Lead Data Engineer – Python & GCP | Hyderabad (Hybrid).Are you someone who loves building scalable data pipelines, designing cloud-native solutions, and solving complex data ...Show more
Last updated: 21 days ago • Promoted
Azure Data Engineer
Sigmoid • rajkot, India
We are looking for a skilled TL Azure Data Engineer with 9+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures.The ideal candidate will...Show more
Last updated: 2 hours ago • Promoted • New!
AWS Data Engineer
ValueMomentum • rajkot, India
Job Title : SSE – Data Engineer.Primary Skill : Python, Pyspark Mandatory, StepFunctions, Lamda, Iceberg, Lake Formation and AWS Services and pipelines and experience in.
Location : Hyderabad / Pune / Co...Show more
Last updated: 8 hours ago • Promoted • New!
Data Engineer
BLJ Tech Geeks • rajkot, India
Notice Period - Serving only till 31st Dec not more than this.We are looking for a skilled and detail-oriented.You will be responsible for building and maintaining scalable data pipelines, optimizi...Show more
Last updated: 8 hours ago • Promoted • New!
Senior Data Engineer
Zeza Technologies • rajkot, India
Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportuni...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - GCP
People Prime Worldwide • rajkot, India
Senior Data Engineer - GCP + Python.Our client is a trusted global innovator of IT and business services, present in 50+ countries.
They specialize in digital & IT modernization, consulting, managed...Show more
Last updated: 24 days ago • Promoted
Data Engineer
Response Informatics • rajkot, India
Designation : AWS Data Engineer.Skill Tech stack : AWS Data Engineer, Python, Pyspark, SQL, Data Pipeline, AWS, AWS Glue, lambda.
Notice Period – Immediate to 4 week Joiner only (Don’t submit more th...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Aceolution • Rajkot, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Data Support Engineer ( Azure, Databricks )
Kumaran Systems • Rajkot, IN
We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
Last updated: 7 days ago • Promoted
Python + Redis Data Engineer
People Prime Worldwide • Rājkot, Republic Of India, IN
Important Note (Please Read Before Applying).You have less than 9 years or more than 13 years of experience.You do not have hands-on Python Developer with Radis DB 5+ experience.You are on a notice...Show more
Last updated: 13 days ago • Promoted
Data Engineer
AS Technology Corporation • rajkot, India
We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions.
This role involves working with cloud platforms, big data framew...Show more
Last updated: 6 hours ago • Promoted • New!
PySpark Data Engineer
EXTRAGIG • Rajkot, IN
Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role.
Execute creative software and data solutions, including des...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Staffingine LLC • Rajkot, IN
The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions.
This role requires strong Python programming skills, expertise...Show more
Last updated: 4 days ago • Promoted
Data Engineer (DOMO & Python / Kafka)
Smart Moves Consultants • Rajkot, IN
We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest.
Design, build, and maintain scala...Show more