Epergne Solutions is looking for Sr. Software Engineer
Payroll : Epergne Solutions
Position : Contract
Relevant and Total years of experience : 8+ years
Detailed job description -
Skill Set : Mandatory Skills
GCP, Cloud Composer, Big query ,Pyspark, Skava
Salary - As per market Standards
Work Location - Hyderabad, Bangalore
Mode : Hybrid ,WFO
Must- Have :
Hands-on development experience on Google Cloud Platform (GCP), on Following Cloud services : Cloud Composer, Big query, Pub sub, Data proc, Data flow, CDAP, Big table, GCS
Hands-on development Experience on Airflow DAG creation.
Hands-on development experience on Data migration Pipeline creation on PubSub with DataProc \ DataFlow.
Hands-on development Experience on Cloud function creation.
Hands-on development experience in shell scripting, PySpark, Scala programming language
Hands-on development experience in Big Query and performance tuning of BQ queries, BQ Data Load Jobs
ETL jobs development using Spark and Python
Python / Java / Scala programming
Debugging / troubleshooting of Spark jobs
Performance tuning experience for Hadoop / Spark jobs
Good understanding on Datawarehouse knowledge and data modelling
Good Telecom domain knowledge
Good to-Have
Data Ingestion & ETL : Sqoop, Flume, Nifi, Stream sets, Logstash
Data processing : Spark
Messaging system : Kafka
Scheduling and workflows : Google cloud composer
Data warehousing knowledge
Knowledge and implementation of Lambda / Kappa architecture
Knowledge on Microservices, Docker, Kubernetes,etc.,
DevOps CI / CD
Looking for 30 days / lesser Notice Period Candidates
Sr Software Engineer • Bengaluru, Karnataka, India