Lead PySpark Data Engineer _ Exp: 7+ YearsAtyeti Inc • Thoothukudi, IN
No longer accepting applications
Lead PySpark Data Engineer _ Exp : 7+ Years
Atyeti Inc • Thoothukudi, IN
4 days ago
Job descriptionMust Have Skills : Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working with Spark and its architecture Knowledge of Software Engineering best practices Advanced SQL knowledge (preferably Oracle) Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources. Good to Have Skills : Knowledge of ‘Data’ related AWS Services Knowledge of GitHub and Jenkins Automated testing
Job Description : Roles and Responsibility :
- Build and maintain all facets of Data Pipelines for Data Engineering team.
- Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
- Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
- Engage in proof of concepts, technical demos and interaction with customers and other technical teams
- Participate in the agile ceremonies
- Ability to solve complex data-driven scenarios and triage towards defects and production issues
Technical Skills
Create a job alert for this search
Lead Data Engineer • Thoothukudi, IN
Related jobs
)
Senior Data Engineer
Intellias • Thoothukudi, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 14 days ago • Promoted
Data Engineer
Tata Consultancy Services • Thoothukudi, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Adastra • Thoothukudi, IN
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 18 hours ago • Promoted • New!
Data Engineer (GCP)
HISH IT SERVICES • Thoothukudi, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 5 days ago • Promoted
Sr Data Engineer
Mitchell Martin Inc. • Thoothukudi, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show more
Last updated: 27 days ago • Promoted
Azure Databricks+Pyspark
Tata Consultancy Services • Thoothukudi, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
Last updated: 14 days ago • Promoted
GCP Data Engineer
HCLTech • Thoothukudi, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 14 days ago • Promoted
Data Engineer
Mastek • Thoothukudi, IN
Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show more
Last updated: 7 days ago • Promoted
Data Engineer
Aceolution • Thoothukudi, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Azure Data Engineer
People Consultancy Services (PCS) • Thoothukudi, IN
Shift Timing : 11 : 00 AM – 8 : 00 PM (India Time).Looking for 5+ Years experience in Advanced SQL, Azure Data Factory (ADF), Databricks (with PySpark).
Experience with Azure Synapse (added advantage).St...Show more
Last updated: 8 days ago • Promoted
Data Engineer
IntraEdge • Thoothukudi, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Sikich India • Thoothukudi, IN
Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Insight Global • Thoothukudi, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Recro • Thoothukudi, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Thoothukudi, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Digitalzone • Thoothukudi, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 14 days ago • Promoted
Lead Data Engineer
NexGen Tech Solutions • Thoothukudi, IN
Lead Data Engineer– Wealth Management.Must Have : Wealth Management Domain.We are seeking a highly skilled.Experience in building end-to-end Data Lake and Modern Data Platform programs covering the ...Show more
Last updated: 18 hours ago • Promoted • New!
Data Engineer
TEKsystems • Thoothukudi, IN
Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications.
Hands-on experience with ETL pipeline development, schema desi...Show more
Last updated: 30+ days ago • Promoted