This job offer is not available in your country.
Data Engineer - Data Engineer
DeqodeChennai30+ days ago
Job descriptionUniversity or advanced degree in engineering, computer science, mathematics, or a related field Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity Catalog, workflows, Optimization techniques) Experience with at least one cloud provider solution (GCP preferred) Strong experience working with relational SQL databases. Strong experience with object-oriented / object function scripting language : Python. Working knowledge in any transformation tools, DBT preferred. Ability to work with Linux platform. Strong knowledge of data pipeline and workflow management tools (Airflow) Working knowledge of Git hub / Git Toolkit Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation Experience creating Data pipelines that prepare data for ingestion & consumption appropriately. Experience in maintaining and optimizing databases / filesystems for production usage in reporting, analytics. Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well. Good verbal and written communication skill
Responsibilities :
- Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation.
- Work closely with analysts / data scientists to understand impact to the downstream data models.
- Write efficient and well-organized software to ship products in an iterative, continual release environment.
- Contribute to and promote good software engineering practices across the team
- Communicate clearly and effectively to technical and non-technical audiences.
Minimum Qualifications :
ref : hirist.tech)
Create a job alert for this search
Data Engineer • Chennai
Related jobs
InfyStrat is seeking a dedicated Data Engineer to join our data team and contribute to the development and maintenance of our robust data infrastructure.
In this role, you will be responsible for de...Show moreLast updated: 30+ days ago
Validates correctness and completeness of requirements defined by product owners, implements data logic, and ensures it is adequately tested and of high quality for at least one service within a te...Show moreLast updated: 28 days ago
Data Engineer
InfyStratINRemote
Quick Apply
- Promoted
Data Engineer
Cleantech Industry ResourcesChennai, Tamil Nadu, India Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
Data Engineer
MphasisChennai, Tamil Nadu, India AWS Glue, EMR (Spark), Redshift, Step Functions : Deep experience in using AWS tools for data processing and pipeline orchestration.
Python, SQL, PySpark / Scala : Advanced skills in Python and SQL, as ...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
DevfiChennai, IN Our client is looking for a Senior Data Engineer with Strong Python and AWS.I thought this might catch your interest.Client is looking for someone who is willing to work in US Eastern Time zone - N...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
CentrilogicChennai, IN Over 15 years, we have become a premier global provider of multi-cloud management, cloud-native application development solutions, and strategic end-to-end digital transformation services.Headquart...Show moreLast updated: 25 days ago
Data Engineer
Ideas2IT TechnologiesChennai, Tamil Nadu, India As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL, and collaborating with data team...Show moreLast updated: 10 days ago
Data Engineer
Saint-Gobain India Private Limited - Glass BusinessChennai, Tamil Nadu, India Looking for a dynamic, energetic, and self-driven Azure Data Engineer to design, implement, and maintain scalable data solutions.
The role focuses on integrating data from multiple sources across al...Show moreLast updated: 1 day ago
Data Engineer
Excelencia iTech Consulting Pvt LtdChennai, TN, inQuick Apply
- Promoted
Data Engineer
FinacPlusChennai, IN FinacPlus provides virtual business process services to various types of overseas clients and this position is to be part of the team which provides IT services to a leading provider of data, insig...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
HiPaaS Inc.Chennai, IN You’ll work on high-impact projects like foundational data tables, ETL frameworks, and data lineage, collaborating with cross-functional teams to drive data quality, accessibility, and innovation.D...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Vista Applied Solutions Group IncChennai, IN Client is looking for Data Engineer and this remote position from India.Python scripting for automation.Heavy focus on the data modeling.
Retail & eCommerce experience required.Adobe web analytics u...Show moreLast updated: 1 day ago
Data Engineer
Ztek ConsultingChennai, Tamil Nadu, India Lead and manage end-to-end data engineering projects, collaborating with cross-functional teams including analytics, product, and engineering.
Design and maintain scalable ETL / ELT pipelines using Re...Show moreLast updated: 1 day ago
Data Engineer
ValueLabsChennai, Tamil Nadu, India PySpark : Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.Cloudera Data Platform : Strong experience with Cloudera Data Platform (CDP) components...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Clustrex Data Private LimitedChennai, Tamil Nadu, India Madipakkam, Chennai - work from office.Build and optimize data pipelines for efficient data processing.Conduct query performance analysis and enhance database efficiency.
Perform statistical analysi...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
NEXUS CONSULTING SOLUTIONSChennai, IN Years / Mid-Senior Level / As per requirement].We are seeking a skilled and motivated.The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure effic...Show moreLast updated: 17 days ago
Data Engineer
IntraEdgeChennai, Tamil Nadu, India Data Engineer (Backend Java & Python).We are looking for a highly skilled.In this role, you will design and implement robust data models and architectures, build scalable data ingestion pipelines, ...Show moreLast updated: 13 days ago
Data Engineer
Tata Consultancy ServicesChennai, Tamil Nadu, India TCS present an excellent opportunity for Data Engineer.Experience required : 5-12 yrs.Skills : Apache Spark, Python, PySpark, Java, GCP BQ,BIG Data, Python, SQL, PySpark GCP.Walk in Interview date : ...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
Teamware SolutionsChennai, Tamil Nadu, India Buyer OPEN POSITION NOTIFICATION.Competency Group : All Information Systems.The GRADE / BAND for this Order is : 1.Maximum number of resumes to be submitted per position : 2.
Note : Appropriate Affirmativ...Show moreLast updated: 1 day ago