SENIOR DATA ENGINER
Tredence Inc.Karnataka, India3 hours ago
Job descriptionBachelor's and / or master’s degree in computer science or equivalent experience Must have total 6+ yrs. of IT experience and 4+ years' experience in Data warehouse / ETL projects Deep understanding of Star and Snowflake dimensional modelling Strong knowledge of Data Management principles Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture Should have hands-on experience in SQL, Python and Spark (PySpark) Candidate must have experience in Azure stack Desirable to have ETL with batch and streaming (Kinesis) Experience in building ETL / data warehouse transformation processes Experience with Apache Kafka for use with streaming data / event-based data Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala) Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J) Experience working with structured and unstructured data including imaging & geospatial data Experience working in a Dev / Ops environment with tools such as Terraform, CircleCI, GIT Proficiency in RDBMS, complex SQL, PL / SQL, Unix Shell Scripting, performance tuning and troubleshoot Databricks Certified Data Engineer Associate / Professional Certification (Desirable) Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects Should have experience working in Agile methodology Strong verbal and written communication skills
Primary Roles and Responsibilities :
- Developing Modern Data Warehouse solutions using Databricks and Azure Stack
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW / BI leads to understand new ETL pipeline development requirements
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications :
Create a job alert for this search
Senior Data • Karnataka, India
Related jobs
- Promoted
Data Engineer
Alp Consulting Ltd.Karnataka, India Please find the below JD for your reference : .Hands-on experience with AWS or similar cloud platform building data engineering solutions for analytics and science.
Must have experience building compl...Show moreLast updated: 12 days ago
- Promoted
Lead Data Engineer
ImpetusKarnataka, India GCP Lead for Bangalore / Gurgaon location.We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer,...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
Pretium Enterprise Services, IndiaKarnataka, India Would be an individual contributor responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects are desired.Collaborate within Ag...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer, ITC
NIKEKarnataka, Karnataka, India You will be a part of the larger Global Technology organization working on Nike’s internal product tools and report to the team’s Engineering Director.
You will work day-to-day with a team of engine...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Sonata SoftwareKarnataka, India Experience building data pipelines.Highly proficient in python, Data frames.Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB.
Highly proficient in SQL Query.Snowflake or experi...Show moreLast updated: 12 days ago
- Promoted
Senior Data Engineer
Nityo InfotechKarnataka, India We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
PRI GlobalKarnataka, India Demonstrated ownership and accountability for end-to-end delivery.Applications / Software Developer 4.Strong sense of ownership and commitment to high-quality outcomes.Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer
Pretium Enterprise Services, IndiaKarnataka, India Would be a lead responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects is required.
Would collaborate within Agile teams to ...Show moreLast updated: 1 day ago
- Promoted
Senior Azure Data Engineer / Lead
Ekfrazo Technologies Private LimitedKarnataka, India Role : Senior Data Engineer / Lead.Location : Bangalore , Noida, Gurgaon, Pune, Mumbai, Kochi – Bangalore ( preferred) – Hybrid Model ( weekly 2 days ).
Position 1 - Job Details – Data Engineer Lead.Ex...Show moreLast updated: 1 day ago
- Promoted
Senior Data Engineer - Contractor
GigsRemoteKarnataka, India GigsRemote connects trusted companies with top tech contractors.IT projects of varying complexity and duration.Our aim is to create an ongoing opportunity for gig talent allowing them to work from ...Show moreLast updated: 4 days ago
- Promoted
Lead Data Engineer - Databricks
Tredence Inc.Karnataka, India Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI.
Headquartered in San Jose, Cali...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
AccoladeKarnataka, India The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, ...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
Networth CorpKarnataka, India Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services.
End to end development lifecycle of complex large-scale and ...Show moreLast updated: 4 days ago
- Promoted
Senior GCP Data Engineer (5+ Years)
AwignKarnataka, India Only immediate joiner- Within 7-15 days.Chennai, Bangalore, Hyderabad, Pune (HYRBID).We are looking for an experienced.The ideal candidate will have strong hands-on experience with.Work closely wit...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
LTIMindtreeKarnataka, India We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
Flexton Inc.Karnataka, India Immediate Joiners preferred! or Max 3 - 4 weeks.Seeking a skilled Data Engineer with strong experience in SQL coding, Spark development, and Python or Scala programming.
The role involves building a...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
AppsForBharatKarnataka, India We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale.
This platform supports business...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
SynechronKarnataka, India We have immediate opportunity for.Data Engineer (Python, Spark / Scala).Data Engineer (Python, Spark / Scala).Notice Period : Immediate joiner only.
At Synechron, we believe in the power of digital to tr...Show moreLast updated: 12 days ago