Senior Data Engineer
ImpetusKarnataka, India1 day ago
Job descriptionDevelop efficient ETL pipelines as per business requirements, following the development standards and best practices. Perform integration testing of different created pipeline in Cloud env. Provide estimates for development, testing & deployments on different env. Participate in code peer reviews to ensure our applications comply with best practices. Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization. Writes unit / integration tests, contributes to engineering wiki, and documents work. Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Works closely with a team of frontend and backend engineers, product managers, and analysts. Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models. Designs data integrations and data quality framework.
Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune
Immediate Joiners are preferred.
Qualification
- 4 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
- Good hands-on experience of python and Bash Scripts
- Good understanding of SQL and data warehouse concepts
- Strong analytical, problem-solving, data analysis and research skills
- Demonstrable ability to think outside of the box and not be dependent on readily available tools
- Excellent communication, presentation and interpersonal skills are a must
- Hands-on experience with using Cloud Platform provided Big Data technologies
- Orchestration with Airflow and Any job scheduler experience
- Experience in migrating workload from on-premises to cloud and cloud to cloud migrations
Roles & Responsibilities
Mandatory Skills - Any Cloud, Python Programming, SQL, Pyspark
Create a job alert for this search
Senior Data Engineer • Karnataka, India
Related jobs
- Promoted
Lead Software Engineer - Data Platform Engineering,ITC
NIKEKarnataka, Karnataka, India At Nike, we leverage the power of data and technology to serve athletes • around the world.The Data & AI (DAI) team is at the forefront of this mission—building scalable, secure, and intelligent pla...Show moreLast updated: 11 days ago
- Promoted
Lead Data Engineer
ImpetusKarnataka, India GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Alp Consulting Ltd.Karnataka, India Please find the below JD for your reference : .Hands-on experience with AWS or similar cloud platform building data engineering solutions for analytics and science.
Must have experience building compl...Show moreLast updated: 9 days ago
- Promoted
Senior Data Engineer, ITC
NIKEKarnataka, Karnataka, India You will be a part of the larger Global Technology organization working on Nike’s internal product tools and report to the team’s Engineering Director.
You will work day-to-day with a team of engine...Show moreLast updated: 30+ days ago
- Promoted
Senior Software Engineer - Databricks, Global Converse,ITC
NIKEKarnataka, Karnataka, India You will be part of the Digital Design & Merchandising, Product Creation, Planning, and Manufacturing Technology team at Converse.
You will take direction and work primarily with the Demand and Supp...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Sonata SoftwareKarnataka, India Experience building data pipelines.Highly proficient in python, Data frames.Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB.
Highly proficient in SQL Query.Snowflake or experi...Show moreLast updated: 9 days ago
- Promoted
Azure Data Engineer
LTIMindtreeKarnataka, India Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 1 day ago
- Promoted
Lead Software Engineer, ITC
NIKEKarnataka, Karnataka, India You will partner with globally distributed teams of engineering, product and program teams to ensure that.You will work with your peers to develop key innovation features and report into the Engine...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Nityo InfotechKarnataka, India We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show moreLast updated: 1 day ago
- Promoted
L2 / L3 Data Plane developer
ACL DigitalKarnataka, India, India ACL Digital is hiring for Data Plane Developer for Bangalore location.Senior Software Engineer – C Programming (L2 / L3 Dataplane Development).
We are looking for a highly skilled.The ideal candidate ...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer - Contractor
GigsRemoteKarnataka, India GigsRemote connects trusted companies with top tech contractors.IT projects of varying complexity and duration.Our aim is to create an ongoing opportunity for gig talent allowing them to work from ...Show moreLast updated: 1 day ago
- Promoted
Lead Data Engineer - Databricks
Tredence Inc.Karnataka, India Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI.
Headquartered in San Jose, Cali...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
SelectorKarnataka, India Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer (AWS / Databricks)
AccoladeKarnataka, India The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Networth CorpKarnataka, India Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services.
End to end development lifecycle of complex large-scale and ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
LTIMindtreeKarnataka, India We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 1 day ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail AnalyticsKarnataka, India Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equiva...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
AppsForBharatKarnataka, India We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale.
This platform supports business...Show moreLast updated: 1 day ago