This job offer is not available in your country.

Principal Software Engineer

Tekwissen IndiaBangalore, KA, India

5 days ago

Job type

Quick Apply

Job description

Overview :

TekWissen Group is a workforce management provider operating throughout India and several other countries worldwide. The client below is a leading technology company offering a range of IT solutions to businesses and organizations, enabling them to transform their digital futures

Position : Principal Software Engineer

Location : Hyderabad / Bangalore

Duration : 12 Months

Job Type : Contract

Work Type : Hybrid

Job Description :

Roles and Responsibilities :

We are seeking a skilled and experienced PySpark Developer to join our dynamic team.
The ideal candidate will have a strong background in software development, with a focus on data transformation, processing, and performance optimization using PySpark.
Expertise in SQL and its functions is required.
Developer will be responsible for designing, developing, and maintaining scalable data transformation solutions, as well as developing efficient Spark jobs and managing job scheduling.

Strong expertise in Python programming :

Deep knowledge of Python language features, libraries, and best practices.

Extensive experience with Apache Spark and PySpark :

Writing optimized Spark jobs, transformations, actions, and working with RDDs and DataFrames.

Solid understanding of big data processing concepts :

Distributed computing, fault tolerance, partitioning, and data shuffling.

Experience with ETL pipeline development :

Designing, implementing, and maintaining scalable data pipelines.

Proficient in working with large datasets :

Handling data ingestion, cleansing, and transformation efficiently.

Good understanding of SQL :

Writing complex SQL queries and integrating Spark SQL where needed.

Hands-on experience with FastAPI :

Developing high-performance, scalable RESTful APIs and microservices using FastAPI.

Experience with cloud platforms and services :

Working knowledge of AWS (EMR, S3), Azure, or GCP cloud environments.

Familiarity with Hadoop ecosystem components :

HDFS, Hive, HBase, or similar tools.

Knowledge of data serialization formats :

JSON, Parquet, Avro, ORC.

Strong debugging and troubleshooting skills :

Ability to profile, optimize, and debug Spark and API applications.

Experience with version control systems :

Git or similar tools.

Understanding of software development lifecycle and Agile methodologies :

Participating in code reviews, CI / CD pipelines, and sprint planning.

Excellent problem-solving and communication skills :

Ability to collaborate with data engineers, analysts, and stakeholders

Mandatory Skills :

Python Developer, PySpark, Spark, Fast API, Cloud, SQL, Spark SQL,

Scala, CI / CD pipelines, Hadoop ecosystem

Experience :

Total Exp 8 to 12 Yrs

Rel Exp 7+ Yrs

TekWissen Group is an equal opportunity employer supporting workforce diversity.

Create a job alert for this search

Principal Software Engineer • Bangalore, KA, India