Skill : Data Engineer
Experience : 6 to 10 Yrs
Location : Bengaluru
Job Description :
- Hands-on development experience on Google Cloud Platform, on
Following Cloud services : Cloud Composer, Big query, Pub sub, Data proc, Data flow, CDAP, Big table, GCS
Hands-on development Experience on Airflow DAG creation.Hands-on development experience on Data migration Pipeline creation on PubSub with DataProc \ DataFlow.Hands-on development Experience on Cloud function creation.Hands-on development experience in shell scripting, pySpark, Scala programming languageETL jobs development using Spark and PythonPython / Java / Scala programmingDebugging / troubleshooting of Spark jobsPerformance tuning experience for Hadoop / Spark jobsGood understanding on Datawarehouse knowledge and data modellingHands-on development experience in Big Query and performance tuning of BQ queries, BQ Data Load JobsGood Telecom domain knowledge