Talent.com
Senior Data Engineer- AWS
Senior Data Engineer- AWSInfoCepts • Pune, Maharashtra, India
Senior Data Engineer- AWS

Senior Data Engineer- AWS

InfoCepts • Pune, Maharashtra, India
30+ days ago
Job description

Key Result Areas and Activities :

  • Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
  • Should be able to design complex Big Data use cases using AWS Services and Databricks, under guidance of Architect
  • Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance and durability.
  • Should be able to suggest optimizations in existing designs.
  • Project documentation adheres to quality guidelines & schedules.
  • Works hand in hand with Architect & PM for successful delivery of project and provide estimation, scoping, scheduling assistance.
  • Articulate design decisions very clearly with stakeholders.
  • Perform Proof-of-Concepts and document all observations before proposing a new solution.
  • Conduct design review sessions with other teams and identify scope of improvement.
  • Suggests automation to improve existing processes.

Work and Technical Experience :

Must-Have :

  • In-depth knowledge of the following AWS services : S3, EC2, EMR, Athena, AWS Glue, Lambda
  • Experience with at least one MPP database : AWS Redshift, Snowflake, SingleStore
  • Proficiency in Big Data technologies : Apache Spark, Databricks
  • Must have strong programming skills in Python
  • Responsible for building data pipelines in AWS And Databricks
  • Experience with Big Data table formats, such as Delta Lake (open source)
  • Must have very strong SQL skills
  • Experience with orchestration tools like Apache Airflow
  • Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.
  • Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required
  • Strong understanding of data warehousing concepts
  • Good to have :

  • Cloud Databases – Snowflake, AWS Aurora
  • Big Data – Hadoop, Hive
  • Cloud Databases– AWS Aurora
  • Associate Level or Professional Level AWS Certification or Databricks Certification
  • Qualifications :

  • Overall, 7+ years of IT Exp
  • 5+ years of relevant experience in AWS related project
  • Bachelor’s degree in computer science, engineering, or related field (master's degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods.
  • Qualities :

  • Hold strong technical knowledge and experience
  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to consult, write, and present persuasively
  • Able to work in a self-organized and cross-functional team
  • Able to iterate based on new information, peer reviews, and feedback
  • Prior experience of working in a large media company would be added advantage
  • Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    AWS Data Engineer

    AWS Data Engineer

    Capgemini Invent • Pune, Maharashtra, India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 7 days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • Pune, IN
    We are seeking an experienced Senior Cloud Engineer to design, implement, and manage scalable cloud infrastructure and DevOps pipelines. The ideal candidate will have deep expertise in AWS services,...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Mastek • pune, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Platform Engineer

    AWS Data Platform Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment.You’ll work with our BI and Data Engineering teams to build secure, automated, and r...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Epergne Solutions • Pune, Maharashtra, India
    Quick Apply
    Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Saras Analytics • pune, maharashtra, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Pune, Maharashtra, India
    Required Technical Skill Set AWS Redshift, Glue, PySpark.Desired Experience Range 4-10 Years.Location of Requirement Chennai / Pune. Desired Competencies (Technical / Behavioral Competency).Must-Have • ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Pune, Maharashtra, India
    TCS is hiring for AWS Data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Hyderabad / Pune / Indore. Skills Required - AWS, Pyspark, EMR, Glue.AMI Rehydration, Cloud for...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • Pune, Maharashtra, India
    Required Skills & Qualifications Bachelor’s or Master’s degree in Computer Science or equivalent experience 5+ years of hands-on experience as an Application Developer or in similar software engine...Show more
    Last updated: 21 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • pune, maharashtra, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )

    Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )

    HARP • Pune, India
    Cloud : AWS Cloud Infrastructure.Monitoring Tools : Grafana, Datadog, or similar.Containerization : Kubernetes (Moderate level knowledge). Technical Skills – Nice to Have.Database : MySQL (Basic knowled...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    Resourcetree • Pune
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show more
    Last updated: 30+ days ago • Promoted
    Infocepts - Senior Data Engineer - AWS

    Infocepts - Senior Data Engineer - AWS

    InfoCepts Technologies Pvt. Ltd. • Pune
    Description : - Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.Should be able t...Show more
    Last updated: 27 days ago • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    Confidential • Pune, India
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRO • Pune, Maharashtra, India
    Position : Senior Data Engineer Location : Bengaluru Experience : 5+ years Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data ...Show more
    Last updated: 30+ days ago • Promoted