Senior Data Platform Engineer (Python and SQL programming)
GuidewireBengaluru, Karnataka, India
11 hours ago
Job description
Responsibilities :
Design and Development of cloud-based microservices to collect data
Design and Development of REST API to serve Data as a Service
Design and Development of Data Quality framework to enable automated data quality checks across data pipelines
Responsible for developing and maintaining CI / CD pipelines
Maintain and stabilize existing data pipelines and infrastructure to provide timely, quality and accurate data
Analysis, Performance Improvement, Development, Deployment and Contribute to overall product requirements
Perform code review and develop best coding practices
Indulge in brainstorming sessions to help team gain technical knowledge and grow equally
Define release process improvements along with management of pipeline changes
Collaborate with peer teams and support each other’s on deliverables
Qualification
Bachelor’s or Master’s degree in Computer Science or equivalent industry technical skills
8+ years of professional development experience
In-depth knowledge on strong experience in Python programming language and should be an expert Object Oriented Programming
Strong experience in AWS service - EC2, ECS, Lambda, Step Function, S3, SQS preferred. Experience in other AWS services are added advantage
Expertise in both SQL and NoSQL databases.
Experience in Postgres, Redshift, MongoDB and DynamoDB are preferred
Experience in Linux and Shell scripting preferred
Experience in Docker, Kubernetes, or MicroService preferred
Experience in Airflow and Jenkins preferred
Experience in FAST API, Flask Framework, SQLalchemy are preferred
Expertise in version control tools Git, Bitbucket preferred
Experience in creating and implementing a strong data quality system that checks data accuracy at every step, backed by thorough monitoring and observability features
Create a job alert for this search
Data Engineer Python • Bengaluru, Karnataka, India
Related jobs
Promoted
New!
Senior Data Platform Engineer (Azure Databricks)
Antal InternationalBengaluru, Karnataka, India
Senior) Data Platform Engineer (Azure Databricks).Azure Databricks platform, ensuring it is secure, reliable, scalable, and cost-efficient.
This role is pivotal in empowering our Data- & AIOps team ...Show moreLast updated: 11 hours ago
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 7 hours ago
Promoted
New!
Senior Databricks Engineer_22583
DXC TechnologyBengaluru, Karnataka, India
At least 5+ years’ of relevant hands on development experience as Azure Data Engineering role.Proficient in Azure technologies like ADB, ADF, SQL(capability of writing complex SQL queries), ADB, Py...Show moreLast updated: 11 hours ago
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
Carelon Global SolutionsBrookefield, Karnataka, India
Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler.
It is the largest managed health care company in the Blue Cross Blue Shield ...Show moreLast updated: 11 hours ago
Promoted
New!
Senior Software Engineer- Data Platform
MoEngage Inc.Bengaluru, Karnataka, India
Responsible for systems end to end - development to delivery.Keep scalability / availability / resilience in mind while building.
Interfacing with multiple stakeholders to understand the requirements an...Show moreLast updated: 11 hours ago
Promoted
New!
GCP Senior Data Engineer
TalentOlaBengaluru, Karnataka, India
GCP Senior Data Engineer Job description as below : .Solid knowledge about developing.Dataflow, Fusion, Cloud Composer, Pub / Sub, Cloud Function, Kubernetes.Show moreLast updated: 11 hours ago
Promoted
New!
Senior Software Engineer - Data Platform
DatabricksBengaluru, Karnataka, India
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development.
We do this by building and running the w...Show moreLast updated: 11 hours ago
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
Promoted
New!
Senior Data Engineer
Blend360Bengaluru, Karnataka, India
Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client.
This role is part of a strategic initiative to enable ro...Show moreLast updated: 11 hours ago
Promoted
New!
Senior Data Engineer
News CorpBengaluru, Karnataka, India
Business Title : Senior Data Engineer.We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL / BI, Python, Composer / Airflow, SQL, GCP Services...Show moreLast updated: 11 hours ago
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
Promoted
New!
Data Engineer - Python / SQL / AWS
The Nielsen CompanyBengaluru, Karnataka, India
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 11 hours ago
Promoted
New!
Senior Data Engineer
ParexelBengaluru, Karnataka, India
When our values align, there's no limit to what we can achieve.With a focus on automating testing and DevOps, use Microsoft Azure data PaaS services, design, build, modify, and support data pipelin...Show moreLast updated: 11 hours ago
Promoted
New!
Senior Databricks Engineer_22586
DXC TechnologyBengaluru, Karnataka, India
At least 5+ years’ of relevant hands on development experience as Azure Data Engineering role.Proficient in Azure technologies like ADB, ADF, SQL(capability of writing complex SQL queries), ADB, Py...Show moreLast updated: 11 hours ago
Promoted
New!
Senior Principal Consultant- Sr. Snowflake Data Engineer (Python+Cloud)!
GenpactBengaluru, Karnataka, India
Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 11 hours ago