Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
Should be able to design complex Big Data use cases using AWS Services and Databricks, under guidance of Architect
Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance and durability.
Should be able to suggest optimizations in existing designs.
Project documentation adheres to quality guidelines & schedules.
Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
Articulate design decisions very clearly with stakeholders.
Perform Proof-of-Concepts and document all observations before proposing a new solution.
Conduct design review sessions with other teams and identify scope of improvement.
Suggests automation to improve existing processes.
Work and Technical Experience :
Must-Have :
In-depth knowledge of the following AWS services : S3, EC2, EMR, Athena, AWS Glue, Lambda
Experience with at least one MPP database : AWS Redshift, Snowflake, SingleStore
Proficiency in Big Data technologies : Apache Spark, Databricks
Must have strong programming skills in Python
Responsible for building data pipelines in AWS And Databricks
Experience with Big Data table formats, such as Delta Lake (open source)
Must have very strong SQL skills
Experience with orchestration tools like Apache Airflow
Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.
Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required
Strong understanding of data warehousing concepts
Good to have :
Cloud Databases – Snowflake, AWS Aurora
Big Data – Hadoop, Hive
Cloud Databases– AWS Aurora
Associate Level or Professional Level AWS Certification or Databricks Certification
Qualifications :
Overall, 7+ years of IT Exp
5+ years of relevant experience in AWS related project
Bachelor’s degree in computer science, engineering, or related field (master's degree is a plus)
Demonstrated continued learning through one or more technical certifications or related methods.
Qualities :
Hold strong technical knowledge and experience
Should have the capability to deep dive and research in various technical related fields
Self-motivated and focused on delivering outcomes for a fast-growing team and firm
Able to communicate persuasively through speaking, writing, and client presentations
Able to consult, write, and present persuasively
Able to work in a self-organized and cross-functional team
Able to iterate based on new information, peer reviews, and feedback
Prior experience of working in a large media company would be added advantage
Create a job alert for this search
Senior Data Engineer • Pune, Maharashtra, India
Related jobs
Senior Data Engineer
Donyati • pune, maharashtra, in
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 8 days ago • Promoted
AWS Data Engineer
Capgemini Invent • Pune, Maharashtra, India
At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
Last updated: 7 days ago • Promoted
Senior Data Engineer
Mastek • pune, maharashtra, in
We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
Last updated: 30+ days ago • Promoted
AWS Data Platform Engineer
Persistent Systems • Pune, Maharashtra, India
We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment.You’ll work with our BI and Data Engineering teams to build secure, automated, and r...Show more
Last updated: 15 days ago • Promoted
Azure Senior Data Engineer
Tata Consultancy Services • Pune, Maharashtra, India
Greetings from TCS!!!! TCS is hiring for AWS Data Engineer Experience : 5 to 10yrs Location : Pan India Mode of Driving : Virtual Date : 15-Nov-25 (Saturday) Job Description : Technical Experience 4...Show more
Last updated: 16 days ago • Promoted
Senior Data Engineer
Persistent Systems • Pune, Maharashtra, India
Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks.
Proven ability to design and optimize high-performance data pipelines,...Show more
Last updated: 30+ days ago • Promoted
Senior AWS Data Engineer
Epergne Solutions • Pune, Maharashtra, India
Quick Apply
Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show more
Last updated: 30+ days ago
Senior Data Engineer
Saras Analytics • pune, maharashtra, in
We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • Pune, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Tata Consultancy Services • Pune, Maharashtra, India
Required Technical Skill Set AWS Redshift, Glue, PySpark.Desired Experience Range 4-10 Years.Location of Requirement Chennai / Pune.
Desired Competencies (Technical / Behavioral Competency).Must-Have • ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
EXL • Pune, Maharashtra, India
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 22 days ago • Promoted
Data Engineer
Tata Consultancy Services • Pune, Maharashtra, India
TCS is hiring for AWS Data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Hyderabad / Pune / Indore.
Skills Required - AWS, Pyspark, EMR, Glue.AMI Rehydration, Cloud for...Show more
Last updated: 30+ days ago • Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Inc • Pune, Maharashtra, India
Required Skills & Qualifications Bachelor’s or Master’s degree in Computer Science or equivalent experience 5+ years of hands-on experience as an Application Developer or in similar software engine...Show more
Last updated: 21 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • pune, maharashtra, in
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 1 day ago • Promoted
Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )
HARP • Pune, India
Cloud : AWS Cloud Infrastructure.Monitoring Tools : Grafana, Datadog, or similar.Containerization : Kubernetes (Moderate level knowledge).
Technical Skills – Nice to Have.Database : MySQL (Basic knowled...Show more
Last updated: 13 days ago • Promoted
Senior Data Engineer - Snowflake / AWS
Resourcetree • Pune
About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show more
Last updated: 30+ days ago • Promoted
Infocepts - Senior Data Engineer - AWS
InfoCepts Technologies Pvt. Ltd. • Pune
Description : - Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.Should be able t...Show more
Last updated: 27 days ago • Promoted
Senior Data Engineer- AWS
Confidential • Pune, India
Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
Should be able to design comple...Show more