SENIOR DATA ENGINER
Tredence Inc.bangalore, karnataka, in14 days ago
Job descriptionBachelor's and / or master’s degree in computer science or equivalent experience Must have total 6+ yrs. of IT experience and 4+ years' experience in Data warehouse / ETL projects Deep understanding of Star and Snowflake dimensional modelling Strong knowledge of Data Management principles Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture Should have hands-on experience in SQL, Python and Spark (PySpark) Candidate must have experience in Azure stack Desirable to have ETL with batch and streaming (Kinesis) Experience in building ETL / data warehouse transformation processes Experience with Apache Kafka for use with streaming data / event-based data Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala) Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J) Experience working with structured and unstructured data including imaging & geospatial data Experience working in a Dev / Ops environment with tools such as Terraform, CircleCI, GIT Proficiency in RDBMS, complex SQL, PL / SQL, Unix Shell Scripting, performance tuning and troubleshoot Databricks Certified Data Engineer Associate / Professional Certification (Desirable) Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects Should have experience working in Agile methodology Strong verbal and written communication skills
Primary Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Databricks and Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW / BI leads to understand new ETL pipeline development requirements
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications :
Create a job alert for this search
Senior Data • bangalore, karnataka, in
Related jobs
- Promoted
Senior Data Engineer - Databricks
Tredence Inc.bangalore, karnataka, in Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI.
Headquartered in San Jose, Cali...Show moreLast updated: 1 day ago
- Promoted
Senior SAP Data Engineer
Bosch Global Software TechnologiesBengaluru, Karnataka, India We are seeking a seasoned SAP Data Analytics Lead / Senior Consultant to drive the design, development, and delivery of advanced analytics solutions leveraging SAP Datasphere, SAP BW, and SAP Analy...Show moreLast updated: 5 days ago
- Promoted
Senior Data Engineer
Tredence Inc.Bengaluru, Karnataka, India Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues.
Work with business to understand the need in...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Futran Solutionshosur, tamil nadu, in We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.
The ideal candidate will have a proven track record of designing, imp...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer
Straivebangalore district, karnataka, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ACL Digitalbangalore, karnataka, in Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show moreLast updated: 5 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladehosur, tamil nadu, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
FinastraBengaluru, Karnataka, India Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our business units and 8000+ custome...Show moreLast updated: 3 hours ago
- Promoted
- New!
Senior Data Engineer
Acuity Knowledge PartnersBengaluru, Karnataka, India The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of ...Show moreLast updated: 20 hours ago
- Promoted
Senior Data Engineer
Mastekbangalore, karnataka, in We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIBengaluru, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Xebiabangalore, karnataka, in Job Title : Senior Data Engineer.Notice Period : immediate - 15 days.We are looking for Data Engineer with hands on experience on Python , Pyspark , Hadoop Hive, HDFS, Oozie, Yarn.Design, develop a...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer
SGS & Cohosur, tamil nadu, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer
Live Connectionshosur, tamil nadu, in Databricks Engineer, Azure Databricks, SQL, Pyspark.Databricks Engineer, Azure Databricks, SQL.Job Title : Senior Data Engineer.
Design, build, and maintain scalable data pipelines and ETL processes....Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Incept Labshosur, tamil nadu, in Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer(Big Data)
Andor TechBengaluru, Karnataka, India If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC.
Work on cutting-edge big data solutions f...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer
HealthyMe AIhosur, tamil nadu, in We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
- Promoted
SENIOR DATA ENGINER
Tredence Inc.Bengaluru, Karnataka, India Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show moreLast updated: 15 days ago