Talent.com
This job offer is not available in your country.
Big Data Python Engineer

Big Data Python Engineer

Virtusahyderabad, India
10 hours ago
Job description

Big Data Python Engineer - CREQ Description Role GDT WS Big Data Python Engineer

Exp 5+

Location Pune / Hyderabad

MUST Have Skills

Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.

Airflow

Jenkins

Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.

Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.

Collaborate with data and business analysts to implement data solutions that meet business requirements.

Nice to have skills

API experience Java

Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills PySpark Years of Experience 5 Qualification

Role GDT WS Big Data Python Engineer

Exp 5+

Location Pune / Hyderabad

MUST Have Skills

Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.

Airflow

Jenkins

Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.

Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.

Collaborate with data and business analysts to implement data solutions that meet business requirements.

Nice to have skills

API experience Java

Travel No

Create a job alert for this search

Data Engineer Python • hyderabad, India

Related jobs
  • Promoted
  • New!
Big data engineer

Big data engineer

Virtusahyderabad, India
Big data engineer - CREQ Description.Primary : big data concepts, aws, pyspark.Create Trigger based automation framework for Data Migration. Identify roles / access needed for data migration from fede...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Data Engineer- Snowflake

Data Engineer- Snowflake

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India
We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 5 hours ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

DeltacubesHyderabad, IN
Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
  • Promoted
  • New!
Bigdata Python

Bigdata Python

Virtusahyderabad, India
Bigdata Python - CREQ Description Role GDT WS Big Data Python Engineer.Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, Map...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Big Data Hadoop Engineer

Big Data Hadoop Engineer

Anicalls (Pty) Ltdhyderabad, India
Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Azure Data Engineer with Big Data

Azure Data Engineer with Big Data

Anicalls (Pty) Ltdhyderabad, India
Azure Data Factory • Azure Databricks • Python,.Spark • HIVE / HIVE LLAP / HBASE / CosmoDb • Azure Active Directory Domain Services • Apache Ranger / Apache Ambari • Azure Key Vault • Expertise in ...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Data Engineer

Data Engineer

VDart Software Services Pvt. Ltd.hyderabad, India
Data Engineer : 7+ years (3+ Azure), DevOps, SQL, Python, Spark, RESTful service.Design, build, and maintain scalable data pipelines and data solutions on. Collaborate with DevOps teams to automate d...Show moreLast updated: 10 hours ago
  • Promoted
Big Data Engineer

Big Data Engineer

Rapinno Tech Solutions Pvt.Ltd.hyderabad, telangana, in
Locations : Hyderabad | Chennai | Pune | Bangalore.Skills : Scala, Python, Apache Spark, PySpark, AWS, CI / CD.Strong hands-on experience in Scala & distributed data processing.Show moreLast updated: 8 days ago
  • Promoted
Bigdata Engineer

Bigdata Engineer

TAO Digital SolutionsHyderabad, Telangana, India
Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques.Candidate will possess experience in developing highly scalable Big Data pipelines, stron...Show moreLast updated: 8 days ago
  • Promoted
  • New!
Python Data Engineer

Python Data Engineer

Talent Worxhyderabad, India
Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a leading Big4 Consulting firm and provider of financial intelligence, data analytics, and AI-...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Data Engineer - Data Warehouse& BigData& Python and SQL

Data Engineer - Data Warehouse& BigData& Python and SQL

ECS | Enterprise Change Specialistshyderabad, India
We are seeking a skilled Data Engineer to join our team and contribute to designing, developing, and managing data solutions, including pipelines and data warehouses. The ideal candidate will handle...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Mid-level Big Data Engineer

Mid-level Big Data Engineer

SkySyshyderabad, India
Full-Time Contract (40hrs / week).Hybrid - Hyderabad, India (3x days onsite).Our Client is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team.This hybrid role...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Bigdata Engineer - E6871

Bigdata Engineer - E6871

Nisumhyderabad, India
Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services. Integrate new data sources a...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Sr Cloud Big Data Engineer, SMAI

Sr Cloud Big Data Engineer, SMAI

Micronhyderabad, India
Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 10 hours ago
  • Promoted
Backend and Data Pipeline Engineer

Backend and Data Pipeline Engineer

JRD SystemsHyderabad, IN
Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 5 days ago
  • Promoted
  • New!
Big Data Engineer

Big Data Engineer

Saaki Argus & Averil Consultinghyderabad, India
Notice Period : Immediate Joiner or 30 Day.Hands-on experience on technologies like.Hive, Scala, Spark, AWS, HBase.Proficient in Hadoop distributions such as. Good working experience on technologies...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Big Data Engineer

Big Data Engineer

Anicalls (Pty) Ltdhyderabad, India
Bachelor's Degree or more in Computer.A solid track record of data management showing your flawless execution.Strong knowledge of and experience with statistics. Programming experience, ideally in ,...Show moreLast updated: 10 hours ago
  • Promoted
  • New!
Data and Analytics (D&A) Big Data A...

Data and Analytics (D&A) Big Data A...

Anicalls (Pty) Ltdhyderabad, India
Robust Business Intelligence development experience.Experience with AWS BI Services (QuickSight, EMR, Glue, etc.Aurora, Spark, and MySQL Experience is a Plus.Show moreLast updated: 10 hours ago