Coditas - Senior Data Engineer - PythonCoditas Technologies Pvt. Ltd. • Pune
Coditas - Senior Data Engineer - Python
Coditas Technologies Pvt. Ltd. • Pune
30+ days ago
Job descriptionMinimum 6-10 years of progressive experience building solutions in Big Data environments. Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement. Hands-on experience of Apache Spark with Python for batch and stream processing. Should have knowledge of experience in batch and stream data processing. Exposure working on projects across multiple domains. Strong hands on capabilities on SQL and NoSQL technologies. Minimum 3+ years of experience with AWS services like S3, DMS, Redshift, Glue, Lambda, Kinesis, MSK etc. is must have or similar services of either Azure / GCP. Strong analytical / quantitative skills and comfortable working with huge sets of data. Excellent written and verbal communication skills.
Roles and Responsibilities :
- Understand Business requirements and implement scalable solutions.
- Translate complex technical and functional requirements into detailed designs.
- Develop a highly scalable, reliable, and high-performance data processing pipeline to.
- Extract, transform and load data from various systems to the Enterprise Data warehouse / Data Lake / Data Mesh.
- Provide research, high-level design and estimates for data transformation and data integration from source applications to end-use.
- Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.
- Develop comprehensive data products and implement them on cloud or in-house servers for production use.
Technical Skills :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer Python • Pune
Related jobs
Lead / Senior Engineer - Python
TESTQ Technologies Limited • Pune
About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RapidBrains • Pune, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 14 days ago • Promoted
Capco - Senior Data Engineer - Python / Snowflake
Capco Technologies Pvt Ltd • Pune
Job Summary : We are seeking a highly experienced Senior Data Engineer with 9+ years of experience, specializing in building advanced Data Engineering solutions on t...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
eClerx • Pune, India
We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.
The ideal candidate will have deep exp...Show more
Last updated: 13 days ago • Promoted
Rapid7 - Senior Software Engineer - Python
Rapid7 • Pune
About the Role : The Senior Software Engineer on the Vulnerability Coverage team will play a pivotal role in expanding the Rapi...Show more
Last updated: 30+ days ago • Promoted
Senior Python / / AI Engineer
Luxoft • Pune, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Persistent Systems • Pune, Maharashtra, India
Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks.
Proven ability to design and optimize high-performance data pipelines,...Show more
Last updated: 30+ days ago • Promoted
Senior Python & Cloud Engineer - CI / CD Pipeline
Web Idea Solution LLP • Pune
Description : Job Title : Senior Python & Cloud Engineer Experience : 5-8 years &l...Show more
Last updated: 30+ days ago • Promoted
Python Data Engineer
Synechron • Pune, Maharashtra, India
Looking for immediate to 30 days' joiners.At Synechron, we believe in the power of digital to transform businesses for the better.
Our global consulting firm combines creativity and innovative techn...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Aceolution • Pune, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Pune, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
EXL • Pune, Maharashtra, India
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 23 days ago • Promoted
Senior Data Engineer
vConstruct Private Limited • Pune, Maharashtra, India
Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer ( Palantir)
Lear Corporation • Pune, Maharashtra, India
Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
Last updated: 20 days ago • Promoted
Senior Data Engineer- AWS
InfoCepts • Pune, India
Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
Should be able to design comple...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Python / Scala
hirezy.ai • Pune
Job Responsibilities : As a Senior Data Engineer, your responsibilities will include : - Designing, developing, optimizing, and maintaining dat...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
Populace World Solutions • Pune
Description : Location : Pune (Kharadi), India Experience : 8+ Years About the Role : Show more
Last updated: 30+ days ago • Promoted
Senior MLOps Engineer - Python
AI Start Up • Pune
Description : - Manage and optimize Databricks platform (Workspaces, Jobs, Unity Catalog, Delta Lake) - Implement the whole ML lifecycle : model...Show more
Last updated: 7 days ago • Promoted