Overview :
TekWissen Group is a workforce management provider operating throughout India and several other countries worldwide. The client below is a leading technology company offering a range of IT solutions to businesses and organizations, enabling them to transform their digital futures
Position : Principal Software Engineer
Location : Hyderabad / Bangalore
Duration : 12 Months
Job Type : Contract
Work Type : Hybrid
Job Description :
Roles and Responsibilities :
- We are seeking a skilled and experienced PySpark Developer to join our dynamic team.
- The ideal candidate will have a strong background in software development, with a focus on data transformation, processing, and performance optimization using PySpark.
- Expertise in SQL and its functions is required.
- Developer will be responsible for designing, developing, and maintaining scalable data transformation solutions, as well as developing efficient Spark jobs and managing job scheduling.
Strong expertise in Python programming :
Deep knowledge of Python language features, libraries, and best practices.Extensive experience with Apache Spark and PySpark :
Writing optimized Spark jobs, transformations, actions, and working with RDDs and DataFrames.Solid understanding of big data processing concepts :
Distributed computing, fault tolerance, partitioning, and data shuffling.Experience with ETL pipeline development :
Designing, implementing, and maintaining scalable data pipelines.Proficient in working with large datasets :
Handling data ingestion, cleansing, and transformation efficiently.Good understanding of SQL :
Writing complex SQL queries and integrating Spark SQL where needed.Hands-on experience with FastAPI :
Developing high-performance, scalable RESTful APIs and microservices using FastAPI.Experience with cloud platforms and services :
Working knowledge of AWS (EMR, S3), Azure, or GCP cloud environments.Familiarity with Hadoop ecosystem components :
HDFS, Hive, HBase, or similar tools.Knowledge of data serialization formats :
JSON, Parquet, Avro, ORC.Strong debugging and troubleshooting skills :
Ability to profile, optimize, and debug Spark and API applications.Experience with version control systems :
Git or similar tools.Understanding of software development lifecycle and Agile methodologies :
Participating in code reviews, CI / CD pipelines, and sprint planning.Excellent problem-solving and communication skills :
Ability to collaborate with data engineers, analysts, and stakeholdersMandatory Skills :
Python Developer, PySpark, Spark, Fast API, Cloud, SQL, Spark SQL,Scala, CI / CD pipelines, Hadoop ecosystemExperience :
Total Exp 8 to 12 YrsRel Exp 7+ YrsTekWissen Group is an equal opportunity employer supporting workforce diversity.