Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.
Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.
Optimize data processing workflows for maximum performance and efficiency.
Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.
Implement best practices for data governance, security, and compliance.
Document technical designs, processes, and procedures to support knowledge sharing across teams.
Requirements :
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
4+ years of experience as a Big Data Engineer or in a similar role.
Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.
Extensive experience with programming languages such as Python, Scala, or Java.
Knowledge of data modeling and data warehousing concepts.
Familiarity with NoSQL databases like Cassandra or MongoDB.
Proficient in SQL for data querying and analysis.
Strong analytical and problem-solving skills.
Excellent communication and collaboration abilities.
Ability to work independently and effectively in a fast-paced environment.
Benefits :
Competitive salary and benefits package.
Opportunity to work on cutting-edge technologies and solve complex challenges.
Dynamic and collaborative work environment with opportunities for growth and career advancement.
Regular training and professional development opportunities.
(ref : hirist.tech)
Create a job alert for this search
Big Data Engineer • Chennai
Related jobs
Promoted
Senior Data Engineer
Eucloid Data SolutionsChennai, Tamil Nadu, India
Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 8 days ago
Promoted
Big Data Specialist
Brilliochennai, tamil nadu, in
We are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distribute...Show moreLast updated: 26 days ago
Promoted
Data Engineer
VAANTECHchennai, tamil nadu, in
Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
Promoted
Senior Data Engineer
InfogainChennai, IN
Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
Promoted
Lead Data Engineer
Eucloid Data SolutionsChennai, IN
Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
Promoted
Big Data Engineer - Hadoop / Spark
ImpacteersChennai
Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 13 days ago
Promoted
Senior Data Engineer - Big Data / Kafka
SMARTWORK IT SERVICESChennai
Position : Senior Data Engineer (ETL / Big Data / Streaming) Experience : 810 years Location : Onsite Hybder...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Innodata Inc.Chennai, IN
CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
Promoted
Senior Data Engineer
BrightEdgechennai, tamil nadu, in
BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results.
Our platform processes massive amounts of da...Show moreLast updated: 26 days ago
Promoted
Senior Big Data Engineer
VeltrisChennai, IN
Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 14 days ago
Promoted
Data Engineer
HISH IT SERVICESChennai, IN
Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
Promoted
Data Engineer
ACL Digitalchennai, tamil nadu, in
Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable.
Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
Tata Consultancy ServicesChennai, Tamil Nadu, India
Greetings from TCS Human Resources Team!!!.Skill : Snowflake Data Engineer.Required Technical Skill Set : Snowflake, dbt, FiveTran, Snowpipe, AWS services : Managed Airflow (MWAA), S3, Lambda.Minimum ...Show moreLast updated: 26 days ago
Promoted
Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location
USTchennai, tamil nadu, in
CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with.
Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
Deltacubeschennai, tamil nadu, in
Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
Promoted
Data Engineer
Kumaran Systemschennai, tamil nadu, in
Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
Promoted
Data Engineer
ImpetusChennai, Tamil Nadu, India
Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
Collaborates with analytics and business...Show moreLast updated: 24 days ago
Promoted
Big Data Developer
IntraEdgeChennai, Tamil Nadu, India
Senior Big Data Engineer (Python).Immediate to 30 Days Preferred.The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing ...Show moreLast updated: 30+ days ago