Aws Data Engineer
TerraGiGPanchkula, Republic Of India, IN14 days ago
Job descriptionDemonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals. Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs. Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below : Basic proficiency in Databricks, including creating jobs and configuring clusters. Exposure to connecting external data sources (e.G., Amazon S3) to Databricks. Understanding of Unity Catalog and its role in data governance. Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability. Candidates must have actual hands-on work experience , not just home projects or academic exercises. Profiles should clearly state how much experience they have in each skill area , as this helps streamline the interview process. Candidates must know their CV / profile inside out , including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership. They should be able to confidently explain their past experience, challenges handled, and technical contributions.
Role
AWS Data Engineer
Experience
8+ years
Location
Remote
Time Zone
UK
Duration
2 months (Extendable)
Job Description
- Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
- Writing reusable, testable, and efficient code
- Integration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark scripts.
- Need to ensure overall build delivery quality is good and on-time delivery is done at all times.
- Should be able to handle meetings with customers with ease.
- Need to have excellent communication skills to interact with the customer.
- Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore)
- 5+ years of experience in programming with python. Strong proficiency in python
- Familiarity with functional programming concepts
- 3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR
- Experience in building pipelines and data lake for large enterprises on AWS
- Good understanding of Spark’s Dataframe and API
- Experience in configuring EMR clusters on AWS
- Experience in dealing with AWS S3 object storage from Spark.
- Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI
- Performance tuning of Spark jobs.
- Understanding fundamental design principles behind business processes
Process Knowledge and Expertise :
Databricks-Specific Skills :
Important Pointers :
Create a job alert for this search
Aws Data Engineer • Panchkula, Republic Of India, IN
Related jobs
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticspanchkula, haryana, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Recrobaddi, himachal pradesh, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
thinkbridgebaddi, himachal pradesh, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight Globalpanchkula, haryana, in GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Veraxionbaddi, himachal pradesh, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 14 days ago
- Promoted
Data Engineer
Response Informaticspanchkula, haryana, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer
LTIMindtreebaddi, himachal pradesh, in Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
VAANTECHbaddi, himachal pradesh, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer
K&K Talents - Indiabaddi, himachal pradesh, in This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent.
We are seeking an experienced Data Engineer with strong...Show moreLast updated: 24 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesbaddi, himachal pradesh, in TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 12 days ago
- Promoted
AWS Data Engineer / Snowflake Data Engineer
Numeric Technologiespanchkula, haryana, in Please apply only if you are comfortable to work in rotational shift.Apply only if you are an immediate to 15 days joiner.
Work Mode - Monthly once to office in Bangalore.Years of experience - 2 to ...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladebaddi, himachal pradesh, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
AI / ML & Data Engineer
Mindfire Solutionspanchkula, haryana, in We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 16 days ago
- Promoted
Data & Analytics Engineer
APPIT Software Incpanchkula, haryana, in Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience.
Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 1 day ago
- Promoted
AWS Data Engineer
TerraGiGpanchkula, haryana, in Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 14 days ago
- Promoted
AWS Data Engineer
Insight Globalbaddi, himachal pradesh, in We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud.
The ideal candidate will have experie...Show moreLast updated: 1 day ago
- Promoted
Data Engineer (Analyst)
Canopus Infosystems - A CMMI Level 3 Companypanchkula, haryana, in We are looking for an experienced .The ideal candidate should have a strong understanding of SQL, cloud data warehouses (preferably Snowflake), and hands-on experience with advertising or marketing...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
IntraEdgebaddi, himachal pradesh, in Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago