This job offer is not available in your country.

Data Engineer

ACL Digitalvizianagaram, andhra pradesh, in

30+ days ago

Job description

Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.

Design, develop, and optimize AWS pipeline as applicable.

Implement and manage GitHub asset bundles for version control, CI / CD workflows, and collaborative development.

Leverage Databricks capabilities including Delta Lake, MLflow, and notebooks to build robust data solutions.

Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready datasets.

Ensure data quality, integrity, and security across all stages of the pipeline.

Monitor and troubleshoot performance issues in Spark jobs and Databricks clusters.

Document technical designs, workflows, and best practices.

Required Qualifications

Minimum 5+ years of hands-on experience with Spark in a production environment.
Strong proficiency in Databricks platform and ecosystem.
Solid understanding of GitHub asset bundle management, including branching strategies, pull requests, and release workflows.
Proficient in Python, Scala, or SQL for data engineering tasks.
Experience with Delta Lake, Structured Streaming, and Databricks Workflows.
Familiarity with cloud platform (AWS) and AWS data services.
Excellent problem-solving and communication skills.

Create a job alert for this search

Data Engineer • vizianagaram, andhra pradesh, in

Related jobs

Promoted

Senior Data Engineer

EXLVisakhapatnam, IN

We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 23 days ago

Promoted

Data Engineer

Kumaran SystemsVisakhapatnam, IN

Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 5 days ago

Promoted

Data Engineer

XebiaVisakhapatnam, IN

We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 3 days ago

Promoted

Principal Data Engineer

XebiaVisakhapatnam, IN

We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 19 days ago

Promoted

Data Engineer

AceolutionVisakhapatnam, IN

We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 5 days ago

Promoted

Data Engineer

HISH IT SERVICESVisakhapatnam, IN

Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 4 days ago

Promoted

Data Engineer

R SystemsVisakhapatnam, IN

Offshore candidates accepted (Singapore Based Company).Please don't apply if less than 4 years exp in Data Engineer).ETL pipelines, real-time streaming, and data transformations.RDDs, transformatio...Show moreLast updated: 24 days ago

Promoted

Data Engineer

EveriseVisakhapatnam, IN

Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 4 days ago

Promoted

Data Engineer

RevXVisakhapatnam, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Eucloid Data SolutionsVisakhapatnam, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 5 days ago

Promoted

Data Engineer

IntraEdgeVisakhapatnam, IN

Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Bahwan CyberTekVisakhapatnam, IN

Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 15 days ago

Promoted

Senior Data Engineer

DeltacubesVisakhapatnam, IN

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago

Promoted

Data / ML Engineer

GleantapVisakhapatnam, IN

Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost). Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 20 days ago

Promoted

Data Engineer

Insight GlobalVisakhapatnam, IN

Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

EvolentVisakhapatnam, IN

Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 21 days ago

Promoted

Data Engineer

Otomeyt AIVisakhapatnam, IN

We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Innodata Inc.Visakhapatnam, IN

CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago

Promoted

Data Engineer

Manuh TechnologiesVisakhapatnam, IN

Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

InfogainVisakhapatnam, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago