This job offer is not available in your country.

Data Engineer

IntraEdgebhopal, madhya pradesh, in

30+ days ago

Job description

Website-https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
Automate manual processes and create a platform in favor of self-service data consumption
Deploy and configure components to production environments.
Participate in on-call schedule to provide emergency incident support
Mentor and train teammates on design and operation of data platform
Stay current with industry trends, making recommendations as needed to help the company excel
Other job-related duties as assigned Skills,

Experience and Qualifications

Bachelor’s Degree in Computer Science or Engineering a plus

5+ years of relevant industry experience in Data Engineering working with large scale data driven systems

Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment

Experience fine-tuning queries around large, complex data sets

Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)

Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)

Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)

Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)

Experience working with and administering a BI tool (Tableau preferred)

Expertise in object-oriented and / or functional programming languages (Python preferred)

Strong programming skills, able to write modular, maintainable code

Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code

Understanding of polyglot data persistence (relational, key / value, document, column)

Excellent problem-solving skills and the ability to proactively solve issues

Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines

Ability to be flexible with working in tandem with a team of engineers or alone, as required

Create a job alert for this search

Data Engineer • bhopal, madhya pradesh, in

Related jobs

Promoted

Lead Data Engineer

Eucloid Data Solutionsbhopal, madhya pradesh, in

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 20 days ago

Promoted

Data Engineer

Namasys Analyticsbhopal, madhya pradesh, in

Immediate joiners preferred; up to 15 days acceptable.Seeking a Data Engineer to design, build, and maintain scalable data pipelines that automate ingestion and transformation from multiple data so...Show moreLast updated: 8 days ago

Promoted

Data Engineer

VAANTECHbhopal, madhya pradesh, in

Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Sikich Indiabhopal, madhya pradesh, in

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago

Promoted

Principal Data Engineer

Xebiabhopal, madhya pradesh, in

We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 30+ days ago

Promoted

GCP Big Data Engineer

Talentmaticsbhopal, madhya pradesh, in

The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 18 days ago

Promoted

Data Engineer

INFEC Servicesbhopal, madhya pradesh, in

Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 17 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladebhopal, madhya pradesh, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 8 days ago

Promoted

Data Engineer

Kumaran Systemsbhopal, madhya pradesh, in

Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 20 days ago

Promoted

Data Engineer

Vriba Solutionsbhopal, madhya pradesh, in

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 8 days ago

Promoted

Data Engineer

Bahwan CyberTekbhopal, madhya pradesh, in

We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Searce Incbhopal, madhya pradesh, in

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 7 days ago

Promoted

Data Engineer(Azure / AWS, Python / Pyspark, SQL)

Sail Analyticsbhopal, madhya pradesh, in

Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 6 days ago

Promoted

Data Engineer

Everisebhopal, madhya pradesh, in

Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 18 days ago

Promoted

Data Engineer

RevXbhopal, madhya pradesh, in

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 20 days ago

Promoted

Lead Data Engineer

ITQube LTDbhopal, madhya pradesh, in

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

USEReadybhopal, madhya pradesh, in

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 8 days ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 Companybhopal, madhya pradesh, in

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago