SENIOR DATA ENGINER
Tredence Inc.Bengaluru, Karnataka, India10 hours ago
Job descriptionBachelor's and / or master’s degree in computer science or equivalent experience Must have total 6+ yrs. of IT experience and 4+ years' experience in Data warehouse / ETL projects Deep understanding of Star and Snowflake dimensional modelling Strong knowledge of Data Management principles Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture Should have hands-on experience in SQL, Python and Spark (PySpark) Candidate must have experience in Azure stack Desirable to have ETL with batch and streaming (Kinesis) Experience in building ETL / data warehouse transformation processes Experience with Apache Kafka for use with streaming data / event-based data Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala) Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J) Experience working with structured and unstructured data including imaging & geospatial data Experience working in a Dev / Ops environment with tools such as Terraform, CircleCI, GIT Proficiency in RDBMS, complex SQL, PL / SQL, Unix Shell Scripting, performance tuning and troubleshoot Databricks Certified Data Engineer Associate / Professional Certification (Desirable) Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects Should have experience working in Agile methodology Strong verbal and written communication skills
Primary Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Databricks and Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW / BI leads to understand new ETL pipeline development requirements
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications :
Create a job alert for this search
Senior Data • Bengaluru, Karnataka, India
Related jobs
- Promoted
Senior Data Engineer
USEReadyBangalore Urban, Karnataka, India Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 24 days ago
- Promoted
Senior Data Engineer
DataWeaveBengaluru, Karnataka, India APIs powering dashboards and integrations.Collaborate with cross-functional teams in a.Elasticsearch, Cassandra, Solr.Good communication and problem-solving skills.
Mentorship, learning opportunitie...Show moreLast updated: 13 days ago
- Promoted
Senior Data Engineer
SAIVA AIBangalore, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Tata Consultancy ServicesBengaluru, Karnataka, India Desired Experience Range : 7 - 10 yrs.Notice Period : Immediate to 90Days only.We are currently planning to do a Virtual.
Python, Scala / Java, Spark, SQL, Snowflake, Airflow, Databricks, AWS Big data t...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ValueLabsBengaluru, Karnataka, India With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries.
Our teams are empowered to solve complex challenges, build secure system...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Tredence Inc.Bengaluru, Karnataka, India Collaborate with DW / BI leads to understand new ETL pipeline development requirements.Triage issues to find gaps in existing pipelines and fix the issues.
Work with business to understand the need in...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ImpetusBengaluru, Karnataka, India Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune Immediate Joiners are preferred.Qualification - 4 years of good hands-on exposure with Big Data technologies – pySpark (Data fra...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
ZetaBengaluru, India Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future.It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015.Our flagship process...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
Straivevijayapura, India The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 7 days ago
- Promoted
Data Engineer_Immediate Joiners
VXI Global Solutionsvijayapura, India VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
Coffeee.iohosur, India Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
AvathonBengaluru, Karnataka, India AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 24 days ago
- Promoted
- New!
AWS Data Engineer
Tata Consultancy Serviceshosur, tamil nadu, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 20 hours ago
- Promoted
Senior Data Engineer
AIQUvijayapura, India We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable.
The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
Societe Generale Global Solution CentreBengaluru, India The role is a Senior Data Engineer who will help shape the future of data-driven auditing.With 710 years of experience, you will design and maintain scalable data pipelines, ensure compliance wit...Show moreLast updated: 4 days ago
- Promoted
Staff / Senior Data Engineer
HG Insightsbangalore, India At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 7 days ago
- Promoted
SENIOR DATA ENGINER
Tredence Inc.Bengaluru, Karnataka, India Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
Guidewire SoftwareBengaluru, Karnataka, India Architect, design, and develop robust, scalable, and efficient data pipelines.Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.W...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
Response Informaticshosur, tamil nadu, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 24 days ago
- Promoted
Senior Data Engineer
Saras Analyticshosur, India We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show moreLast updated: 7 days ago