Design, develop, and optimize data pipelines and ETL workflows using Databricks.
Implement scalable data integration solutions for large datasets across diverse data sources.
Build and maintain data architectures for real-time and batch processing.
Collaborate with data scientists, analysts, and stakeholders to ensure the delivery of high-quality data solutions.
Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.
Ensure data governance, security, and compliance in all processes.
Qualifications :
Should have very clear understanding of Data Lake / Data Warehouse / Lakehouse Concepts
strong background in data engineering practices, cloud platforms, big data technologies and big data processing frameworks.
Strong hands-on experience with Databricks, including Spark, Delta Lake
3+ Year Hands-on experience on Spark is mandatory using Databricks, Azure / AWS and associated data services.
3+ Years Hands-on experience in SQL, Unix & advanced Unix Shell Scripting, Kafka
Expertise in Python / Java / Scala
Experience in GIT, SVN, Build Tools like Ant, Maven etc., CI / CD pipelines
Hands on file transfer mechanism (NDM, sFTP etc)
Knowledge of Schedulers like airflow, TWS etc.
Strong problem-solving skills and the ability to work in an agile environment.
Educational Background :
Bachelors or Masters degree in Computer Science, Engineering, or a related field.
(ref : hirist.tech)
Create a job alert for this search
Engineer Warehousing • Pune
Related jobs
Promoted
Data Engineer
Bits In Glasspune, maharashtra, in
Senior Data Engineer / ETL Engineer.As a Senior Data Engineer / ETL Engineer, you will be instrumental in designing, developing, and optimizing data processing systems that support our organization...Show moreLast updated: 6 days ago
Promoted
New!
Principal Software Engineer - Data Engineer
Accion LabsMore, India
We are a team of Engineers, Designers, Thinkers, Product Managers, Problem solvers and more.We are bound by our commitment to help teams succeed with our culture of learning & innovation.We seek so...Show moreLast updated: 2 hours ago
Promoted
New!
Data Engineer
Talent Worxpune, India
We are looking for an experienced and talented Data Engineer- Databricks to join our growing data engineering team.Role : Data Engineer- Databricks.
Job Type : Full Time Employment.Design and maintain...Show moreLast updated: 2 hours ago
Promoted
New!
Data Engineer
Netlinkpune, India
Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.Work closely with data scientists, analysts, and other engineers to ensure smooth da...Show moreLast updated: 2 hours ago
Promoted
New!
Data Engineer with GCP, Databricks & PySpark Expertise
SynechronHinjawadi, India
Synechron is seeking a skilled Data Engineer experienced in Google Cloud Platform (GCP), Databricks, PySpark, and SQL.In this role, you will design, develop, and maintain scalable data pipelines an...Show moreLast updated: 2 hours ago
Promoted
Senior Data Engineer
Deltacubespune, maharashtra, in
Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
Promoted
ETL LEAD with IBM DataStage experienced
IntraEdgepune, maharashtra, in
ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Innodata Inc.Pune, IN
CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago
Promoted
New!
Data ETL Engineer
IDT Corporationpune, India
IDT () is a communications and financial services company founded in 1990 and headquartered in New Jersey, US.Today it is an industry leader in prepaid communication and payment services and one of...Show moreLast updated: 2 hours ago
Promoted
Lead Data Engineer
Eucloid Data SolutionsPune, IN
Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
Promoted
ETL Developer
Pinnacle Group, Inc.Pune, IN
PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes.
Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
Promoted
New!
Data Engineer
ALIQAN Technologiespune, India
Responsible for designing, developing, and maintaining data pipelines and ETL processes.Databricks and Azure Data Factory.
Good experience in using SQL, Python and Spark within Databricks notebooks ...Show moreLast updated: 2 hours ago
Promoted
New!
Data Engineer
Aumni Techworkspune, India
We are looking for an experienced Data Engineer with 3 to 5 years of experience to join our team and contribute to building scalable, reliable, and high-performing data pipelines.The ideal candidat...Show moreLast updated: 2 hours ago
Promoted
Data Engineer
Insight GlobalPune, IN
Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume.
Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
Promoted
New!
Data Engineer
Axiom Software Solutions Limitedpune, India
Establish technical designs to meet requirements aligned with architectural and data standards.Optimize ETL / data pipelines balancing performance, functionality, and operational requirements.Fine-tu...Show moreLast updated: 2 hours ago
Promoted
New!
Data Engineer
Screen Magic Mobile Media Pvt Ltdpune, India
Job Title : Data Engineer – Workflow Automation & Analytics.We are seeking a technically strong and highly analytical Data Engineer to join our onsite team.
This role demands hands-on expertise in wo...Show moreLast updated: 2 hours ago
Promoted
New!
Senior Data Engineer (Snowflake)
Crazy Solutionspune, India
Senior Data Engineer (Snowflake).Agivant is seeking a talented and passionate.In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-m...Show moreLast updated: 2 hours ago
Promoted
Data Engineer
Otomeyt AIPune, IN
We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago