Lead PySpark Data Engineer _ Exp: 7+ YearsAtyeti Inc • aurangabad, maharashtra, in
No longer accepting applications
Lead PySpark Data Engineer _ Exp : 7+ Years
Atyeti Inc • aurangabad, maharashtra, in
18 hours ago
Job description
Job Description : Roles and Responsibility :
Build and maintain all facets of Data Pipelines for Data Engineering team.
Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
Engage in proof of concepts, technical demos and interaction with customers and other technical teams
Participate in the agile ceremonies
Ability to solve complex data-driven scenarios and triage towards defects and production issues
Technical Skills
Must Have Skills :
Proficient with Python, PySpark and Airflow
Strong understanding of Object-Oriented Programming and Functional Programming paradigm
Must have experience working with Spark and its architecture
Knowledge of Software Engineering best practices
Advanced SQL knowledge (preferably Oracle)
Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.
Good to Have Skills :
Knowledge of ‘Data’ related AWS Services
Knowledge of GitHub and Jenkins
Automated testing
Create a job alert for this search
Lead Data Engineer • aurangabad, maharashtra, in
Related jobs
Lead Data Engineer
INDI Staffing Services • Maharashtra, India, India
At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer - Data Acquisition
InfoBeans • aurangabad, maharashtra, in
We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
Last updated: 2 days ago • Promoted
Lead Python Data Engineer _ Exp : 7+ Years
Atyeti Inc • Aurangabad, IN
Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.
Python; strong SQL and cloud-native development experience ...Show more
Last updated: 23 hours ago • Promoted
Azure Data Engineer
LTIMindtree • aurangabad, maharashtra, in
Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Dexian India • Aurangabad, IN
Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Python, ...Show more
Last updated: 2 days ago • Promoted
Data Engineer
Digitalzone • Aurangabad, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 10 days ago • Promoted
Data Engineer
Aceolution • Aurangabad, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
IntraEdge • Aurangabad, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RapidBrains • Aurangabad, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 23 hours ago • Promoted
Senior Data Engineer
SAIVA AI • Aurangabad, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Data & Analytics Engineer
APPIT Software Inc • Aurangabad, IN
Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience.
Data Modelling & Data Warehouse -Mandatory -Hands...Show more
Last updated: 7 days ago • Promoted
Azure Data Engineer
People Consultancy Services (PCS) • Aurangabad, IN
Shift Timing : 11 : 00 AM – 8 : 00 PM (India Time).Looking for 5+ Years experience in Advanced SQL, Azure Data Factory (ADF), Databricks (with PySpark).
Experience with Azure Synapse (added advantage).St...Show more
Last updated: 4 days ago • Promoted
Data Engineer
Vriba Solutions • Aurangabad, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Straive • aurangabad, maharashtra, in
The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer
Cimpress • aurangabad, maharashtra, in
Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
Last updated: 10 days ago • Promoted
Lead Data Engineer
Saras Analytics • aurangabad, maharashtra, in
We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show more
Last updated: 4 days ago • Promoted
Senior Data Engineer
Intellias • Aurangabad, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 10 days ago • Promoted
Data Engineer
Veraxion • Aurangabad, IN
Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more