P99Soft - Data Engineer - ETL/PythonP99SOFT PRIVATE LIMITED • Hyderabad

P99Soft - Data Engineer - ETL / Python

P99SOFT PRIVATE LIMITED • Hyderabad

21 days ago

Job description

Description :

Experience : 3-4 yrs.

Location : Hyderabad (Hybrid).

As a Data Engineer, you will be involved in the entire development lifecycle, from brainstorming ideas to implementing scalable solutions that unlock data insights.

You will collaborate with stakeholders to gather requirements, design data models, and build pipelines that support reporting, analytics, business intelligence (BI), and exploratory analysis.

Job Description :

Primary Skillset : Tableau / Power BI, Python, Snowflake / Red Shift / Big Query, SQL.
Secondary Skillset : Kafka, Spark, Trino.

Key Responsibilities :

Design, build, and sustain efficient, scalable, and performant Data Engineering Pipelines to ingest, sanitize, transform (ETL / ELT), and deliver high-volume, high-velocity data from diverse sources.

Ensure reliable and consistent processing of versatile workloads of granularity such as Real Time, Near Real Time, Mini-batch, Batch, and On-demand.

Translate business requirements into technical specifications, design and implement solutions with clear documentation.

Develop, optimize, and support production data workflows to ensure comprehensive and accurate datasets for analytics and BI reporting.

Apply a Software Engineering mindset / discipline, adopting best practices in writing modular code that is maintainable, scalable, and performant.

Use orchestration and scheduling tools (e.g., Airflow, GitLab Runners) to streamline workflows.

Automate deployment and monitoring of data workflows using CI / CD best practices.

Use DevOps best practices to instrument retries and self-healing to minimize, if not avoid, manual intervention.

Use AI / Gen AI tools and technologies to build / generate reusable code.

Collaborate with Engineering Groups, Analysts, Product / Program Management, and other stakeholders to deliver end-to-end solutions.

Promote strategies to improve our data modelling, quality, architecture, and BI capabilities.

Mentor junior engineers and contribute to team knowledge sharing.

Have an analytics and BI mindset to explore and identify opportunities for improved metrics, insights, and dashboards contributing to business growth.

Qualifications :

Masters or bachelors degree in computer science or associated discipline with relevant industry experience in a data engineering role.

Strong proficiency in writing and analysing complex SQL, Python, or any 4GL.

Strong hands-on experience with Cloud Data Warehouses like Snowflake, Redshift, Big Query.

Expertise & experience with open table formats (e.g., Apache Iceberg).

Expertise & experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Beam, Trino).

Experience with real-time / streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming).

Experience in using Airflow.

Deep knowledge in data modelling, performance optimization techniques, and BI best practices.

Experience in version control and CI / CD workflows (e.g., Git).

Strong familiarity with BI tools such as Looker, Tableau, Power BI, dashboard design.

Experience working in Agile development environments and with tools like JIRA or Confluence.

Strong problem-solving, analytical, and debugging skills.

Excellent communication and collaboration skills, with the ability to work across business, analytics, BI, and engineering teams.

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Hyderabad

Related jobs

Senior Data Engineer

Intellias • Hyderabad, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more

Last updated: 21 days ago • Promoted

AWS Data Engineer

Vista Applied Solutions Group Inc • Hyderabad, IN

Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more

Last updated: 6 days ago • Promoted

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • Hyderabad, IN

Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more

Last updated: 1 day ago • Promoted

Data Engineer

IntraEdge • Hyderabad, IN

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - Snowflake

Prudent Technologies and Consulting, Inc. • hyderabad, telangana, in

We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show more

Last updated: 7 days ago • Promoted

Data Engineer - ETL / PySpark

INTEGRATED PERSONNEL SERVICES LIMITED • Hyderabad

Description : Role : Data Engineer.Key Responsibilities : Show more

Last updated: 28 days ago • Promoted

Senior Data Engineer

Quadrant Technologies • Hyderabad, Telangana, India

Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - ETL / Python

Tekgence India Private Limited • Hyderabad

Description : Job Summary We are seeking an experienced Data Engineer with strong hands-on expertise in Sca...Show more

Last updated: 9 days ago • Promoted

P99Soft - Data Engineer II - Java / Python

P99SOFT PRIVATE LIMITED • Hyderabad

Description : Job Title : Data Engineer II.We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data...Show more

Last updated: 30+ days ago • Promoted

PySpark Data Engineer

EXTRAGIG • Hyderabad, IN

Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Straive • hyderabad, telangana, in

Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python; author efficient Spark DataFrame / Dataset jobs. Write and optimize complex SQL for ingestion, transformation and ...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Live Connections • secunderabad, telangana, in

Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more

Last updated: 30+ days ago • Promoted

ETL Data Engineer

BPMLinks • Secunderabad, Telangana, India

Overview : In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and ...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Innova Solutions • Hyderabad, Telangana, India

INNOVA Hiring Immediate Joiner For.AWS Data Engineer with SCD -1 / 2 ,AWS, SQL, Pyspark, Python @ Hyderabad, Chennai, Noida. JD : The role focuses on ETL development, AWS Cloud technologies (Glue, Athe...Show more

Last updated: 20 days ago • Promoted

P99Soft - Senior Data Engineer - SQL / Python

P99SOFT PRIVATE LIMITED • Hyderabad

About the Role : We are seeking a highly skilled Senior Data Engineer with strong expertise in Snowflake, SQL, and Python to design, build, and optim...Show more

Last updated: 5 days ago • Promoted

Straive - Senior Data Engineer - ETL / Python

SPI TECHNOLOGIES INDIA PRIVATE LIMITED • Hyderabad

Description : About the job : Job Summary : We're looking...Show more

Last updated: 30+ days ago • Promoted

P99Soft - Software Developer - Python / Flask

P99SOFT PRIVATE LIMITED • Hyderabad

Description : About the Role We are seeking a highly skilled professional with strong expertise in Software Development, AI, and Data Science, wh...Show more

Last updated: 30+ days ago • Promoted

Senior Python Developer (Programming)

Jobseekerspage.com • secunderabad, telangana, in

HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more

Last updated: 4 days ago • Promoted