Data EngineerMRF • hyderabad, India

No longer accepting applications

Data Engineer

MRF • hyderabad, India

1 day ago

Job description

Azure / SQL / Application - Data Engineer

Job description :

Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc.,
Responsible for user access management on data upload and download
Working with functional team to manage the required data in a structured manner
Make use of Azure services like Data Factory, Data Lake, Machine Learning, SQL Warehouse, Data Bricks for data extraction.
Building real-time data pipelines from on-prem SAP DB to cloud along with required API.
Python model development and continuous improvement through containerization. Conduct basic exploratory analytics for insights.
Working with Azure SQL databases and NoSQL Databases (Azure Cosmos DB) for data management

Desired candidate education and experience :

A minimum of 2-3 years of experience in Data engineering and migration

Graduation / Post graduation or equivalent. BE CS / B. Tech IT / MCA preferred

SQL knowledge to create complex queries.

Experience in working with relational databases, Time-series Database as well as working familiarity with a variety of databases (structured & Unstructured).

Good experience in object-oriented programming in python and using python tools such as PySpark, NumPY, TensorFlow and Jupyter etc.

Experience in API creation.

Performance Monitoring & Troubleshooting Azure data pipeline performance, identify bottlenecks, and troubleshoot complex issues in production environments.

Hands on Experience in working on Kafka.

Knowledge on continuous integration / continuous deployment.

Experience of data migration and deployment from On-Prem to Cloud environment and vice-versa.

Ability to identify problems, mediate issues, develop solutions, and implement appropriate courses of action.

Good oral and written English communication skills

Role : Data Engineer

Department : Digital Technology

Employment Type : Full Time

Create a job alert for this search

Data Engineer • hyderabad, India

Related jobs

Data Engineer

Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India

Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

TerraGiG • Hyderabad, IN

Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more

Last updated: 30+ days ago • Promoted

Lead Data Engineer

ValueMomentum • Hyderabad, Telangana, India

Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data Lake.About the Job We are seeking a Tech Lead –. Databricks Data Engineer with experience ...Show more

Last updated: 5 days ago • Promoted

Databricks Data Engineer

zRanga LLC • Hyderabad, Telangana, India

Ranga is a specialized staffing and talent solutions provider helping enterprises scale quickly with high-quality technology and business professionals. With a team backed by 50+ years of combined i...Show more

Last updated: 4 days ago • Promoted

Data Engineer

HCLTech • Hyderabad, Telangana, India

Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more

Last updated: 26 days ago • Promoted

Data Engineer / Databricks

ValueMomentum • Hyderabad, Telangana, India

Databricks Engineer-Databricks.Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data lake. Design and develop ETL pipelines using ADF for data i...Show more

Last updated: 6 days ago • Promoted

Data Engineer

RapidBrains • Hyderabad, Telangana, India

Design, develop, and optimize large-scale data analytics and data warehouse solutions using Azure Data Factory and Azure Databricks. Build and maintain data lake architectures to process multi-forma...Show more

Last updated: 6 days ago • Promoted

Data Engineer

Radiant Digital • Hyderabad, Telangana, India

As a Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and storage solutions in a complex, enterprise-scale data warehouse environment.You will contrib...Show more

Last updated: 8 days ago • Promoted

AWS Data Engineer

iDWTeam • hyderabad, telangana, in

The ideal candidate has strong hands-on experience with AWS data services, scalable ETL / ELT pipelines, and modern data architecture patterns. You will work collaboratively with analytics, engineerin...Show more

Last updated: 4 hours ago • Promoted • New!

Data Engineer

ADP • Hyderabad, Republic Of India, IN

Position : Data Engineer with 3 to 10 Years experience in PySpark and Data bricks.In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data so...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Trigent Software Private Limited • Hyderabad, Telangana, India

As an Application Lead you will lead the effort to design build and configure applications acting as the primary point of contact. Your typical day will involve collaborating with various teams to e...Show more

Last updated: 20 days ago • Promoted

Data Engineer - Palantir Foundry

NP Group • Hyderabad, Telangana, India

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript Fully Remote - Long Term (initially 6 months) full time contract c$12. We have an immediate requirement for an experienced Data En...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Thermo Fisher Scientific • Hyderabad, Telangana, India

This job is with Thermo Fisher Scientific, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Straive • Hyderabad, Telangana, India

Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python; author efficient Spark DataFrame / Dataset jobs. Write and optimize complex SQL for ingestion, transformation and ...Show more

Last updated: 16 days ago • Promoted

Lead Data Engineer

Sonatype • Hyderabad, Republic Of India, IN

Sonatype is the software supply chain security company.We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Kyndryl • Hyderabad, Telangana, India

This job is with Kyndryl, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Who We Are At Ky...Show more

Last updated: 7 days ago • Promoted

Data Engineer - Snowflake

Prudent Technologies and Consulting, Inc. • Hyderabad, Telangana, India

We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show more

Last updated: 16 days ago • Promoted

Cloud Data Engineer

iDWTeam • Hyderabad, Republic Of India, IN

The ideal candidate will have strong expertise in Databricks, Spark, and cloud platforms (Azure / AWS / GCP), along with a solid understanding of data engineering best practices.You will work closely w...Show more

Last updated: 8 hours ago • Promoted • New!