Data EngineerKoantek • Meerut, IN
No longer accepting applications
Data Engineer
Koantek • Meerut, IN
4 days ago
Job descriptionCollaborate with cross-functional teams to understand data, and deliver effective BI Implement data ingestion, transformation, and processing workflows using Spark Develop and maintain data models, ETL / ELT processes ensuring high performance, Build and maintain APIs and data services to support analytics, reporting, and Ensure data quality, integrity, and security across all stages of the data lifecycle. Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment. Integrate data from various sources, including APIs, relational and non-relational Ensure adherence to data governance, security, and compliance policies. Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 3-6 years of hands-on experience in data engineering, with a strong focus on Strong programming skills in Python / PySpark and / or Scala, with a deep understanding Experience with Azure Databricks. Strong SQL skills for data manipulation, analysis, and performance tuning. Strong understanding of data structures and algorithms, with the ability to apply them to Strong understanding of data architecture, data modeling, ETL / ELT processes, and Experience building and maintaining ETL / ELT pipelines in production environments. Familiarity with Delta Lake, Unity Catalog, or similar technologies. Experience working with structured and unstructured data, including JSON, Parquet, Familiarity with CI / CD pipelines and tools like Azure DevOps, version control (Git), and Excellent problem-solving skills, attention to detail, and ability to work independently or Strong communication skills to interact with technical and non-technical stakeholders. Experience with Delta Lake and Databricks Workflows. Exposure to real-time data processing and streaming technologies (Kafka, Spark Exposure to data visualization tool Databricks Genie for data analysis and reporting. Knowledge of data governance, security, and compliance best practices.
We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry
experience. The ideal candidate will have a proven track record of working on live projects.
He / she will play a key role in developing and maintaining scalable data solutions using
Databricks and related technologies.
Key Responsibilities :
- Develop, and deploy end-to-end data pipelines and solutions on Databricks,
integrating with various data sources and systems.
solutions.
(PySpark / Scala), SQL, and Databricks notebooks.
reliability, scalability and data quality.
application integration.
databases, IoT devices, and external data providers.
Required Skills and Experience :
Databricks and Apache Spark.
of Apache Spark.
optimize code and implement efficient solutions.
data warehousing concepts.
Avro, and time-series data.
DevOps practices for data engineering.
as part of a team.
Preferred Qualifications :
Streaming).
Must Have Skills : Spark, Migration Experience, ETL
Create a job alert for this search
Data Engineer • Meerut, IN
Related jobs
Data Engineer
Recro • Meerut, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Randstad Enterprise • Ghaziabad, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer
INDI Staffing Services • Meerut, IN
At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
Last updated: 14 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Meerut, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 6 days ago • Promoted
Data Engineer (4 to 6 Years exp)
DXFactor • Meerut, IN
DXFactor is a US-based tech company working with customers across the globe.We are looking for candidates for.Data Engineer (4 to 6 Yrs exp).
Designation : Data Engineer (Expertise in SnowFlake, AWS ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
One Tapp Consulting • Ghaziabad, IN
Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles.
Data Platform Management : Implement and manage data proce...Show more
Last updated: 11 hours ago • Promoted • New!
Data Engineer
BayOne Solutions • Meerut, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
Data Engineer Lead
JRD Systems • Meerut, IN
The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica.
This role will lead the design and delivery of.Databricks (PySpark, ...Show more
Last updated: 11 hours ago • Promoted • New!
Data Engineer
People Prime Worldwide • Meerut, IN
Immediate Joiners Only (≤15 days).Python, PySpark, AWS / Snowflake.Our client is a global leader in IT and business services, operating in.
With a strong commitment to continuous innovation, they he...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Adastra • Meerut, IN
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 1 day ago • Promoted
Lead Data Engineer
Searce Inc • Meerut, IN
Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
LTIMindtree • Meerut, IN
Greetings from LTIMindtree !!!.We are really impressed by your GCP experience.We are having multiple opportunities and projects which are based on GCP, Bigquery.
I’d love to tell you a little more a...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Digitalzone • Ghaziabad, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 14 days ago • Promoted
Data Engineer
Azilen Technologies • Ghaziabad, IN
Manage and create design schema, SQL query tuning, and code review.Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show more
Last updated: 11 hours ago • Promoted • New!
Data Engineer
Idyllic Services • Ghaziabad, IN
We are looking for an enthusiastic GCP Data Engineer to join our dynamic and growing project team.In this role, you will have the opportunity to develop your skills while contributing to large-scal...Show more
Last updated: 11 hours ago • Promoted • New!
Data Engineer
Natlov Technologies Pvt Ltd • Meerut, IN
Hiring : Cloud Data Engineer | Remote | Full-Time | Immediate Joiner.Ltd is looking for a Cloud Data Engineer with strong AWS expertise and working experience in Azure.
In this role, you will design,...Show more
Last updated: 11 hours ago • Promoted • New!
Data Engineer
Insight Global • Ghaziabad, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Atyeti Inc • Ghaziabad, IN
Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform.
Build and maintain all facets of Data Pipel...Show more
Last updated: 11 hours ago • Promoted • New!