AWS Data Engineer
TerraGiGrajahmundry, andhra pradesh, in12 days ago
Job descriptionDemonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals. Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs. Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below : Basic proficiency in Databricks, including creating jobs and configuring clusters. Exposure to connecting external data sources (e.g., Amazon S3) to Databricks. Understanding of Unity Catalog and its role in data governance. Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability. Candidates must have actual hands-on work experience , not just home projects or academic exercises. Profiles should clearly state how much experience they have in each skill area , as this helps streamline the interview process. Candidates must know their CV / profile inside out , including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership. They should be able to confidently explain their past experience, challenges handled, and technical contributions.
Role
AWS Data Engineer
Experience
8+ years
Location
Remote
Time Zone
UK
Duration
2 months (Extendable)
Job Description
- Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
- Writing reusable, testable, and efficient code
- Integration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark scripts.
- Need to ensure overall build delivery quality is good and on-time delivery is done at all times.
- Should be able to handle meetings with customers with ease.
- Need to have excellent communication skills to interact with the customer.
- Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore)
- 5+ years of experience in programming with python. Strong proficiency in python
- Familiarity with functional programming concepts
- 3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR
- Experience in building pipelines and data lake for large enterprises on AWS
- Good understanding of Spark’s Dataframe and API
- Experience in configuring EMR clusters on AWS
- Experience in dealing with AWS S3 object storage from Spark.
- Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI
- Performance tuning of Spark jobs.
- Understanding fundamental design principles behind business processes
Process Knowledge and Expertise :
Databricks-Specific Skills :
Important Pointers :
Create a job alert for this search
Aws Data Engineer • rajahmundry, andhra pradesh, in
Related jobs
For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer.
The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 1 day ago
- Promoted
- New!
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incrajahmundry, andhra pradesh, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 22 hours ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladerajahmundry, andhra pradesh, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RecroRajahmundry, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti IncRajahmundry, IN Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 1 day ago
- Promoted
AWS Cloud Engineer
ProgliteRajahmundry, IN Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments.
Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Mastekrajahmundry, andhra pradesh, in We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD
All European Careersrajahmundry, andhra pradesh, inRemote
- Promoted
AWS Data Engineer
TerraGiGRajahmundry, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 12 days ago
- Promoted
AI Data Engineer (AWS / Snowflake)
EntechRajahmundry, IN AI Data Engineer (AWS / Snowflake).Entech Consulting is supporting our client, an AI-driven company that helps global organizations reduce the cost and time-to-market for promotional assets through i...Show moreLast updated: 14 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesrajahmundry, andhra pradesh, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 9 days ago
- Promoted
AI / ML & Data Engineer
Mindfire SolutionsRajahmundry, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 14 days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsrajahmundry, andhra pradesh, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
- Promoted
AWS Database Eng
Tata Consultancy Servicesrajahmundry, andhra pradesh, in Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 1 day ago
- Promoted
Snowflake Data Engineer
Newpage SolutionsRajahmundry, IN Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives.
We partner with life sciences organizations—including p...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Response Informaticsrajahmundry, andhra pradesh, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechRajahmundry, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 10 days ago
- Promoted
AWS Engineer
Spryc SystemsRajahmundry, IN We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment.
The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 1 day ago
- Promoted
Azure Data Engineer
LTIMindtreerajahmundry, andhra pradesh, in Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago