Data Engineer
GEMRAJ TECHNOLOGIES LIMITEDChennai, IN11 hours ago
Job descriptionProven experience designing and managing data flows Expertise in designing systems and APIs for data integration 8+ years of hands-on experience with Linux, Bash, Python, and SQL 4+ years working with Spark and other components in the Hadoop ecosystem 4+ years of experience using AWS cloud services, particularly : EMR Glue Athena Redshift 4+ years of experience managing a development team Deep passion for technology and enthusiasm for solving complex, real-world problems using cutting-edge tools BS, MS, or PhD in Computer Science, Engineering, or equivalent practical experience Strong experience with Python, C++, or other widely-used languages Experience working with petabyte-scale data infrastructure Solid understanding of : Data organization : partitioning, clustering, file sizes, file formats Data cataloging : Hive / Hive Metastore, AWS Glue, or similar Background working with relational databases Proficiency with Hadoop, Hive, Spark, or similar tools Exposure to modern data stack technologies like dbt, airbyte Experience building scalable data pipelines (e.g., Airflow is a plus) Strong background with AWS and / or Google Cloud Platform (GCP) Demonstrated ability to independently lead projects from concept through launch and ongoing support
Job Title : Data Engineer
Location : Remote
Position : Full-time
Exp- Must Have 8+ Years
Position Overview
We are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data engineering, and is excited about blending these disciplines to create innovative solutions.
You will be responsible for one or more software and data products, participating in architectural decisions, design, development, and evaluation of new technical solutions. This role also involves leading a small team of developers.
Key Responsibilities
- Manage and optimize data and compute environments to enable efficient use of data assets
- Design, build, test, and deploy scalable and reusable systems capable of handling large volumes of data
- Lead a small team of developers; conduct code reviews and mentor junior engineers
- Continuously learn and help teach emerging technologies to the team
- Collaborate with cross-functional teams to integrate data into broader applications
Required Skills
Additional Skills (Preferred)
Create a job alert for this search
Data Engineer • Chennai, IN
Related jobs
- Promoted
Data Engineer
Impetuschennai, tamil nadu, in Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Cleantech Industry ResourcesChennai, Tamil Nadu, India Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
TalogyChennai, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
EXLChennai, Tamil Nadu, India Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
ITQube LTDchennai, tamil nadu, in Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
Trantorchennai, India We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS.
Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
KaarTechChennai, Tamil Nadu, India Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.
Data Integration : Integrate data from multiple sources and ens...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
AAA GlobalChennai, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
V2Softchennai, tamil nadu, in Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala.
Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
Response Informaticschennai, tamil nadu, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
INFEC Serviceschennai, tamil nadu, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 27 days ago
- Promoted
Data / ML Engineer
Lilochennai, tamil nadu, in Lilo is revolutionizing procurement for Commercial Real Estate (CRE) businesses by providing a single platform to automate and optimize procurement processes using AI.
From hotels to gyms, schools, ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
RevXchennai, India RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
VAANTECHChennai, Tamil Nadu, India Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Randstad EnterpriseChennai, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Searce IncChennai, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
IntraEdgeChennai, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Bahwan CyberTekchennai, tamil nadu, in We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services.
The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago