This job offer is not available in your country.
Data Engineer-AWS
Crazy SolutionsPune, Maharashtra, India18 hours ago
Job descriptionAdvanced SQL skills, with experience in writing optimized and complex queries for data extraction and transformation. Strong experience with AWS cloud services or similar cloud Services (e.g.,S3, Lambda, Glue, Eventhub, EC2, IAM). Familiarity with Hadoop, Spark, or similar big data processing frameworks. Proficiency in Python or other programming languages for data manipulation and data automation. Proficiency with ETL tools (e.g., Glue, Apache Airflow, Talend, Informatica) or custom ETL pipeline development. Third party API calling with Postman, swagger or similar tools and implement calling in python. Experience with data warehousing solutions such as Snowflake, Amazon Redshift, or Google BigQuery. Expertise in SQL Server databases, including design, optimization, and management. Excellent problem-solving skills and attention to detail. Strong communication skills and the ability to work collaboratively in a remote team environment. ETL(Extract, Transform, Load) - 2 Years Python - 3 Years AWS - 3 Years Data Warehousing - 2 Years SQL - 2 Years
Data Engineer-AWS
Responsibilities :
- Design, develop, and maintain scalable and efficient data pipelines using industry-standard tools and technologies.
- Design, implement, and optimize complex SQL queries to extract, transform, and load (ETL) data from various sources with data Quality and Reliability.
- Develop and maintain robust data models, including star and snowflake schemas, to support analytics and reporting needs.
- Call third party APIs to fetch data using python and perform ETL on the same.
- Monitor and improve the performance of existing data pipelines and workflows, addressing any issues related to data quality or efficiency.
- Designed and maintained SQL Server databases, ensuring high availability and performance.
- Contribute to the overall system design and architecture, ensuring scalability and maintainability.
- Stay current with emerging trends and technologies in data engineering and propose new solutions to enhance the data infrastructure.
Requirements :
Good to have : Knowledge of Numpy ,Pandans and similar Python libraries
Job Type
Payroll
Categories
DevOps Engineers (Software and Web Development)
Database Administrator (Software and Web Development)
Systems Analysts (Information Design and Documentaion)
Cloud Architects (Software and Web Development)
Must have Skills
Create a job alert for this search
Data • Pune, Maharashtra, India
Related jobs
- Promoted
AWS Database Eng
Tata Consultancy ServicesPune, Maharashtra, India Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 3 days ago
- Promoted
Data Engineer
IntraEdgePune, IN Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Kanerika Incpune, maharashtra, in Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders.
Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 22 days ago
- Promoted
Celebal Technologies - AWS Data Engineer
Celebal TechnologiesPune DATA ENGINEER (Databricks & AWS) Overview : As a Data Engineer, you will work with multiple teams to deliver solutions on the AWS Cl...Show moreLast updated: 8 days ago
- Promoted
Senior Cloud Engineer AWS
Matrix USAPune, IN We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
ACL Digitalpune, maharashtra, in Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable.
Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
- Promoted
TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Pune
Tata Consultancy ServicesPune, Maharashtra, India Job Title : AWS Senior Data Engineer with Pyspark, AWS, Glue_Pune.PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing.
Hadoop, Teradata Background, IaC[Clo...Show moreLast updated: 10 days ago
- Promoted
Sr. AWS Cloud Engineer
MastekPune, IN Cloud Engineer Job description : .Have work experience in the following areas : .Experience in designing, building, and maintaining AWS Cloud Infrastructure.
Proficient in AWS services including EC2, S3...Show moreLast updated: 28 days ago
- Promoted
Data Engineer
Bahwan CyberTekpune, maharashtra, in We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services.
The ideal candidate will have hands-on ...Show moreLast updated: 21 days ago
- Promoted
Databricks Data Engineer
AscendionPune, Maharashtra, India Job Title : Senior Data Engineer Experience : 3+ years Location : Gurgaon / Pune / Bangalore Skills : PySpark, SQL, Databricks, AWS.
Role Summary : We are looking for 3–4 experienced Databricks Develop...Show moreLast updated: 30+ days ago
- Promoted
Cloud Engineer Lead (AWS)
Datapel SystemsPune, IN The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 21 days ago
- Promoted
AWS Cloud Engineer
ProglitePune, IN Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments.
Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 11 days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsPune, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 11 days ago
- Promoted
Senior Data Engineer (AWS cloud ecosystem) | Green Card holders or valid H1B | Jersey City, New Jer
Trupti Solutions - IndiaPune, Maharashtra, India We are seeking Senior Data Engineers with 8–12 years of experience to join our client's team in Jersey City.This is a hybrid role that requires both strong technical expertise in cloud-based data e...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer (AWS cloud ecosystem) | Green Card holders or valid H1B | Jersey City, New Jersey,USA
Trupti Solutions - IndiaPune, Maharashtra, India We are seeking Senior Data Engineers with 8–12 years of experience to join our client's team in Jersey City.This is a hybrid role that requires both strong technical expertise in cloud-based data e...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer- AWS
InfoCeptsPune, Maharashtra, India Key Result Areas and Activities : .Study existing technology landscape and understand current data integration framework and do impact assessment for the requirements.
Develop spark jobs using Scala f...Show moreLast updated: 14 days ago
- Promoted
Data Engineer
PeoplefyPune, Maharashtra, India Lead the design and development of scalable data pipelines using AWS (Glue, Redshift, Athena).Drive architecture decisions for data systems that support business analytics and application features....Show moreLast updated: 30+ days ago
- Promoted
Lead Aws Data Engineer
ACL DigitalPune, Maharashtra, India Multi-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling.
Knowledge of columnar and NoSQL databases, pre...Show moreLast updated: 20 days ago
- Promoted
Accenture - AWS Data Engineer
Accenture OperationPune Management Level : 9- Consultant Location : Open Must-have skills : Data Engineering, AWS(mandate) Show moreLast updated: 23 days ago
- Promoted
Cloud Engineer
DBiz.aiPune, IN We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 11 days ago