Lead PySpark Data Engineer _ Exp: 7+ YearsAtyeti Inc • mumbai, maharashtra, in
No longer accepting applications
Lead PySpark Data Engineer _ Exp : 7+ Years
Atyeti Inc • mumbai, maharashtra, in
4 days ago
Job descriptionMust Have Skills : Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working with Spark and its architecture Knowledge of Software Engineering best practices Advanced SQL knowledge (preferably Oracle) Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources. Good to Have Skills : Knowledge of ‘Data’ related AWS Services Knowledge of GitHub and Jenkins Automated testing
Job Description : Roles and Responsibility :
- Build and maintain all facets of Data Pipelines for Data Engineering team.
- Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
- Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
- Engage in proof of concepts, technical demos and interaction with customers and other technical teams
- Participate in the agile ceremonies
- Ability to solve complex data-driven scenarios and triage towards defects and production issues
Technical Skills
Create a job alert for this search
Lead Data Engineer • mumbai, maharashtra, in
Related jobs
)
Senior Data Engineer
Veraxion • Thane, IN
We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization.
If you love solving complex da...Show more
Last updated: 1 hour ago • Promoted • New!
Senior Data Engineer
SGS & Co • dombivli, maharashtra, in
Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show more
Last updated: 14 days ago • Promoted
Senior Data Engineer
Intellias • Kalyan-Dombivli, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 14 days ago • Promoted
Data Engineer
People Prime Worldwide • Kalyan-Dombivli, IN
Immediate Joiners Only (≤15 days).Python, PySpark, AWS / Snowflake.Our client is a global leader in IT and business services, operating in.
With a strong commitment to continuous innovation, they he...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
EXL • Thane, IN
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Trinity Technology Solutions LLC • Thane, IN
Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL.
Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show more
Last updated: 1 hour ago • Promoted • New!
Data Engineer
IntraEdge • Thane, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
One Tapp Consulting • Thane, IN
Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles.
Data Platform Management : Implement and manage data proce...Show more
Last updated: 1 hour ago • Promoted • New!
Data Engineer Lead
JRD Systems • Thane, IN
The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica.
This role will lead the design and delivery of.Databricks (PySpark, ...Show more
Last updated: 1 hour ago • Promoted • New!
Data Engineer
HCLTech • Kalyan-Dombivli, IN
We are hiring for GCP Data Engineer role for the location #Chennai #Hyderabad.Experience : 4 Years to 13 Years.Cloud Composer or Airflow (Anyone is fine).
Dataflow or Dataproc or Datafusion (Anyone i...Show more
Last updated: 30+ days ago • Promoted
Data Engineer (4 to 6 Years exp)
DXFactor • Thane, IN
DXFactor is a US-based tech company working with customers across the globe.We are looking for candidates for.Data Engineer (4 to 6 Yrs exp).
Designation : Data Engineer (Expertise in SnowFlake, AWS ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Tata Consultancy Services • Kalyan-Dombivli, IN
Job Title : Senior Data Engineer.Required Skillset : Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda).
Master Databricks tools (job creation, cluster, notebook) and be able to qu...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Kalyan-Dombivli, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
TekIT Software Solutions Pvt. Ltd. (India & USA) • Kalyan-Dombivli, IN
Job Title : Senior Data Engineer.Kochi / Trivandrum / Bangalore.We are seeking a highly skilled.Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks.The ideal can...Show more
Last updated: 5 days ago • Promoted
Data Engineer
Aceolution • Thane, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Quantiphi • Kalyan-Dombivli, IN
Experience Level : 4 to 7 Years.Work location : Mumbai, Bangalore, Trivandrum.Bachelor’s degree in Computer Science or similar field or equivalent work experience.
Data Warehousing, Data Engineering o...Show more
Last updated: 30+ days ago • Promoted
Senior Databricks Engineer (AWS,Spark / databricks, SQL)
SID Information Technologies • Thane, IN
Role : Senior Data Engineer (Python, Spark / Databricks, SQL, AWS).Hybrid (3 days / week in-office).S3, Glue, Redshift, EMR, Lambda.
Strong SQL skills for data transformation and analytics.Expertise in s...Show more
Last updated: 1 hour ago • Promoted • New!
Data Engineer
Digitalzone • Kalyan-Dombivli, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 14 days ago • Promoted