Talent.com
This job offer is not available in your country.
Senior Data Platform Engineer (Python and SQL programming)

Senior Data Platform Engineer (Python and SQL programming)

GuidewireBengaluru, Karnataka, India
11 hours ago
Job description

Responsibilities :

  • Design and Development of cloud-based microservices to collect data
  • Design and Development of REST API to serve Data as a Service
  • Design and Development of Data Quality framework to enable automated data quality checks across data pipelines
  • Responsible for developing and maintaining CI / CD pipelines
  • Maintain and stabilize existing data pipelines and infrastructure to provide timely, quality and accurate data
  • Analysis, Performance Improvement, Development, Deployment and Contribute to overall product requirements
  • Perform code review and develop best coding practices
  • Indulge in brainstorming sessions to help team gain technical knowledge and grow equally
  • Define release process improvements along with management of pipeline changes
  • Collaborate with peer teams and support each other’s on deliverables

Qualification

  • Bachelor’s or Master’s degree in Computer Science or equivalent industry technical skills
  • 8+ years of professional development experience
  • In-depth knowledge on strong experience in Python programming language and should be an expert Object Oriented Programming
  • Strong experience in AWS service - EC2, ECS, Lambda, Step Function, S3, SQS preferred. Experience in other AWS services are added advantage
  • Expertise in both SQL and NoSQL databases.
  • Experience in Postgres, Redshift, MongoDB and DynamoDB are preferred
  • Experience in Linux and Shell scripting preferred
  • Experience in Docker, Kubernetes, or MicroService preferred
  • Experience in Airflow and Jenkins preferred
  • Experience in FAST API, Flask Framework, SQLalchemy are preferred
  • Expertise in version control tools Git, Bitbucket preferred
  • Experience in creating and implementing a strong data quality system that checks data accuracy at every step, backed by thorough monitoring and observability features
  • Create a job alert for this search

    Data Engineer Python • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Senior Data Platform Engineer (Azure Databricks)

    Senior Data Platform Engineer (Azure Databricks)

    Antal InternationalBengaluru, Karnataka, India
    Senior) Data Platform Engineer (Azure Databricks).Azure Databricks platform, ensuring it is secure, reliable, scalable, and cost-efficient. This role is pivotal in empowering our Data- & AIOps team ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

    Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 7 hours ago
    • Promoted
    • New!
    Senior Databricks Engineer_22583

    Senior Databricks Engineer_22583

    DXC TechnologyBengaluru, Karnataka, India
    At least 5+ years’ of relevant hands on development experience as Azure Data Engineering role.Proficient in Azure technologies like ADB, ADF, SQL(capability of writing complex SQL queries), ADB, Py...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS)

    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Python SQL- Senior Software Engineer- GR- 39568-69931- JR165811

    Python SQL- Senior Software Engineer- GR- 39568-69931- JR165811

    Carelon Global SolutionsBrookefield, Karnataka, India
    Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Software Engineer- Data Platform

    Senior Software Engineer- Data Platform

    MoEngage Inc.Bengaluru, Karnataka, India
    Responsible for systems end to end - development to delivery.Keep scalability / availability / resilience in mind while building. Interfacing with multiple stakeholders to understand the requirements an...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    GCP Senior Data Engineer

    GCP Senior Data Engineer

    TalentOlaBengaluru, Karnataka, India
    GCP Senior Data Engineer Job description as below : .Solid knowledge about developing.Dataflow, Fusion, Cloud Composer, Pub / Sub, Cloud Function, Kubernetes.Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    DatabricksBengaluru, Karnataka, India
    At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the w...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Software Engineer ( Java, Python, SQL, AWS / Oracle)

    Senior Software Engineer ( Java, Python, SQL, AWS / Oracle)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Blend360Bengaluru, Karnataka, India
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    News CorpBengaluru, Karnataka, India
    Business Title : Senior Data Engineer.We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL / BI, Python, Composer / Airflow, SQL, GCP Services...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer - Python / SQL / AWS

    Data Engineer - Python / SQL / AWS

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ParexelBengaluru, Karnataka, India
    When our values align, there's no limit to what we can achieve.With a focus on automating testing and DevOps, use Microsoft Azure data PaaS services, design, build, modify, and support data pipelin...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Databricks Engineer_22586

    Senior Databricks Engineer_22586

    DXC TechnologyBengaluru, Karnataka, India
    At least 5+ years’ of relevant hands on development experience as Azure Data Engineering role.Proficient in Azure technologies like ADB, ADF, SQL(capability of writing complex SQL queries), ADB, Py...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior Principal Consultant- Sr. Snowflake Data Engineer (Python+Cloud)!

    Senior Principal Consultant- Sr. Snowflake Data Engineer (Python+Cloud)!

    GenpactBengaluru, Karnataka, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 11 hours ago