Sr. Software Engineer

Epergne Solutions is looking for Sr. Software Engineer

Payroll : Epergne Solutions

Position : Contract

Relevant and Total years of experience : 8+ years

Detailed job description -

Skill Set : Mandatory Skills

GCP, Cloud Composer, Big query ,Pyspark, Skava

Salary - As per market Standards

Work Location - Hyderabad, Bangalore

Mode : Hybrid ,WFO

Must- Have :

Hands-on development experience on Google Cloud Platform (GCP), on Following Cloud services : Cloud Composer, Big query, Pub sub, Data proc, Data flow, CDAP, Big table, GCS

Hands-on development Experience on Airflow DAG creation.

Hands-on development experience on Data migration Pipeline creation on PubSub with DataProc \ DataFlow.

Hands-on development Experience on Cloud function creation.

Hands-on development experience in shell scripting, PySpark, Scala programming language

Hands-on development experience in Big Query and performance tuning of BQ queries, BQ Data Load Jobs

ETL jobs development using Spark and Python

Python / Java / Scala programming

Debugging / troubleshooting of Spark jobs

Performance tuning experience for Hadoop / Spark jobs

Good understanding on Datawarehouse knowledge and data modelling

Good Telecom domain knowledge

Good to-Have

Data Ingestion & ETL : Sqoop, Flume, Nifi, Stream sets, Logstash

Data processing : Spark

Messaging system : Kafka

Scheduling and workflows : Google cloud composer

Data warehousing knowledge

Knowledge and implementation of Lambda / Kappa architecture

Knowledge on Microservices, Docker, Kubernetes,etc.,

DevOps CI / CD

Looking for 30 days / lesser Notice Period Candidates