Senior Data Engineer- AWS
InfoCeptsMaharashtra, India1 day ago
Job descriptionIn-depth knowledge of the following AWS services : S3, EC2, EMR, Athena, AWS Glue, Lambda Experience with at least one MPP database : AWS Redshift, Snowflake, SingleStore Proficiency in Big Data technologies : Apache Spark, Databricks Must have strong programming skills in Python Responsible for building data pipelines in AWS And Databricks Experience with Big Data table formats, such as Delta Lake (open source) Must have very strong SQL skills Experience with orchestration tools like Apache Airflow Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc. Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required Strong understanding of data warehousing concepts Cloud Databases – Snowflake, AWS Aurora Big Data – Hadoop, Hive Cloud Databases– AWS Aurora Associate Level or Professional Level AWS Certification or Databricks Certification Overall, 7+ years of IT Exp 5+ years of relevant experience in AWS related project Bachelor’s degree in computer science, engineering, or related field (master's degree is a plus) Demonstrated continued learning through one or more technical certifications or related methods. Hold strong technical knowledge and experience Should have the capability to deep dive and research in various technical related fields Self-motivated and focused on delivering outcomes for a fast-growing team and firm Able to communicate persuasively through speaking, writing, and client presentations Able to consult, write, and present persuasively Able to work in a self-organized and cross-functional team Able to iterate based on new information, peer reviews, and feedback Prior experience of working in a large media company would be added advantage
Key Result Areas and Activities :
- Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
- Should be able to design complex Big Data use cases using AWS Services and Databricks, under guidance of Architect
- Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance and durability.
- Should be able to suggest optimizations in existing designs.
- Project documentation adheres to quality guidelines & schedules.
- Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
- Articulate design decisions very clearly with stakeholders.
- Perform Proof-of-Concepts and document all observations before proposing a new solution.
- Conduct design review sessions with other teams and identify scope of improvement.
- Suggests automation to improve existing processes.
Work and Technical Experience :
Must-Have :
Good to have :
Qualifications :
Qualities :
Create a job alert for this search
Senior Data Engineer • Maharashtra, India
Related jobs
For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer.
The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti IncAurangabad, IN Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
SGS & Coaurangabad, maharashtra, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 2 days ago
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incaurangabad, maharashtra, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
AWS Database Eng
Tata Consultancy Servicesaurangabad, maharashtra, in Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD
All European CareersAurangabad, INRemote
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsaurangabad, maharashtra, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
- Promoted
- New!
AWS Data Engineer
Insight Globalaurangabad, maharashtra, in We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud.
The ideal candidate will have experie...Show moreLast updated: 13 hours ago
- Promoted
AWS Engineer
Spryc SystemsAurangabad, IN We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment.
The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 2 days ago
- Promoted
- New!
AWS Lead Data engineer
Tata Consultancy Servicesaurangabad, maharashtra, in In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 13 hours ago
- Promoted
Senior Data Engineer
Mastekaurangabad, maharashtra, in We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
- Promoted
Senior Snowflake Data Engineer
iVoyantAurangabad, IN One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
SAIVA AIAurangabad, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Guidanz IncAurangabad, IN BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladeaurangabad, maharashtra, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
TerraGiGAurangabad, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 13 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesaurangabad, maharashtra, in TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 11 days ago
- Promoted
- New!
Senior Data Engineer
SII Group Indiaaurangabad, maharashtra, in Databricks, GCP, and Data Pipeline Development.The ideal candidate will have a deep understanding of.Design, develop, and optimize scalable.
Cloud Build, BigQuery, Firestore.Collaborate with cross-f...Show moreLast updated: 13 hours ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechAurangabad, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 11 days ago