Talent.com
Senior Data Engineer- AWS

Senior Data Engineer- AWS

InfoCeptsPune, Maharashtra, India
30+ days ago
Job description

Key Result Areas and Activities :

  • Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
  • Should be able to design complex Big Data use cases using AWS Services and Databricks, under guidance of Architect
  • Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance and durability.
  • Should be able to suggest optimizations in existing designs.
  • Project documentation adheres to quality guidelines & schedules.
  • Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
  • Articulate design decisions very clearly with stakeholders.
  • Perform Proof-of-Concepts and document all observations before proposing a new solution.
  • Conduct design review sessions with other teams and identify scope of improvement.
  • Suggests automation to improve existing processes.

Work and Technical Experience :

Must-Have :

  • In-depth knowledge of the following AWS services : S3, EC2, EMR, Athena, AWS Glue, Lambda
  • Experience with at least one MPP database : AWS Redshift, Snowflake, SingleStore
  • Proficiency in Big Data technologies : Apache Spark, Databricks
  • Must have strong programming skills in Python
  • Responsible for building data pipelines in AWS And Databricks
  • Experience with Big Data table formats, such as Delta Lake (open source)
  • Must have very strong SQL skills
  • Experience with orchestration tools like Apache Airflow
  • Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.
  • Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required
  • Strong understanding of data warehousing concepts
  • Good to have :

  • Cloud Databases – Snowflake, AWS Aurora
  • Big Data – Hadoop, Hive
  • Cloud Databases– AWS Aurora
  • Associate Level or Professional Level AWS Certification or Databricks Certification
  • Qualifications :

  • Overall, 7+ years of IT Exp
  • 5+ years of relevant experience in AWS related project
  • Bachelor’s degree in computer science, engineering, or related field (master's degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods.
  • Qualities :

  • Hold strong technical knowledge and experience
  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to consult, write, and present persuasively
  • Able to work in a self-organized and cross-functional team
  • Able to iterate based on new information, peer reviews, and feedback
  • Prior experience of working in a large media company would be added advantage
  • Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLPune, Maharashtra, India
    Summary : We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgePune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesPune, Maharashtra, India
    Role AWS Data Engineer Required Technical Skill Set AWS Redshift, Glue, PySpark Desired Experience Range 4-10 Years Location of Requirement Chennai / Pune Desired Competencies (Technical / Behavior...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Platform Engineer

    AWS Data Platform Engineer

    Persistent SystemsPune, Maharashtra, India
    We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment.You’ll work with our BI and Data Engineering teams to build secure, automated, and r...Show moreLast updated: 8 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Pune, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Engineer

    AWS Engineer

    Spryc SystemsPune, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesPune, Maharashtra, India
    TCS is hiring for AWS Data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Hyderabad / Pune / Indore. Skills Required - AWS, Pyspark, EMR, Glue.AMI Rehydration, Cloud for...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiPune, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Persistent Systemspune, maharashtra, in
    We are seeking for Data engineer with AWS, databricks experience.Location : All Persistent Location.Job Type : Full Time Employment. Must have knowledge and working experience in Databricks, PySpark a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncPune, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear CorporationPune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labs, Inc.pune, maharashtra, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Capgemini Inventpune, maharashtra, in
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 2 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIPune, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXLPune, Maharashtra, India
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 24 days ago
    • Promoted
    • New!
    Senior Data Engineer (AWS / GCP)

    Senior Data Engineer (AWS / GCP)

    Armakunipune, India
    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show moreLast updated: 20 hours ago