Talent.com
This job offer is not available in your country.
Principal Software Engineer

Principal Software Engineer

Tekwissen IndiaBangalore, KA, India
5 days ago
Job type
  • Quick Apply
Job description

Overview :

TekWissen Group is a workforce management provider operating throughout India and several other countries worldwide. The client below is a leading technology company offering a range of IT solutions to businesses and organizations, enabling them to transform their digital futures

Position : Principal Software Engineer

Location : Hyderabad / Bangalore

Duration : 12 Months

Job Type : Contract

Work Type : Hybrid

Job Description :

Roles and Responsibilities :

  • We are seeking a skilled and experienced PySpark Developer to join our dynamic team.
  • The ideal candidate will have a strong background in software development, with a focus on data transformation, processing, and performance optimization using PySpark.
  • Expertise in SQL and its functions is required.
  • Developer will be responsible for designing, developing, and maintaining scalable data transformation solutions, as well as developing efficient Spark jobs and managing job scheduling.

Strong expertise in Python programming :

  • Deep knowledge of Python language features, libraries, and best practices.
  • Extensive experience with Apache Spark and PySpark :

  • Writing optimized Spark jobs, transformations, actions, and working with RDDs and DataFrames.
  • Solid understanding of big data processing concepts :

  • Distributed computing, fault tolerance, partitioning, and data shuffling.
  • Experience with ETL pipeline development :

  • Designing, implementing, and maintaining scalable data pipelines.
  • Proficient in working with large datasets :

  • Handling data ingestion, cleansing, and transformation efficiently.
  • Good understanding of SQL :

  • Writing complex SQL queries and integrating Spark SQL where needed.
  • Hands-on experience with FastAPI :

  • Developing high-performance, scalable RESTful APIs and microservices using FastAPI.
  • Experience with cloud platforms and services :

  • Working knowledge of AWS (EMR, S3), Azure, or GCP cloud environments.
  • Familiarity with Hadoop ecosystem components :

  • HDFS, Hive, HBase, or similar tools.
  • Knowledge of data serialization formats :

  • JSON, Parquet, Avro, ORC.
  • Strong debugging and troubleshooting skills :

  • Ability to profile, optimize, and debug Spark and API applications.
  • Experience with version control systems :

  • Git or similar tools.
  • Understanding of software development lifecycle and Agile methodologies :

  • Participating in code reviews, CI / CD pipelines, and sprint planning.
  • Excellent problem-solving and communication skills :

  • Ability to collaborate with data engineers, analysts, and stakeholders
  • Mandatory Skills :

  • Python Developer, PySpark, Spark, Fast API, Cloud, SQL, Spark SQL,
  • Scala, CI / CD pipelines, Hadoop ecosystem
  • Experience :

  • Total Exp 8 to 12 Yrs
  • Rel Exp 7+ Yrs
  • TekWissen Group is an equal opportunity employer supporting workforce diversity.

    Create a job alert for this search

    Principal Software Engineer • Bangalore, KA, India