Data Engineer - Senior Engineer / Manager
Experience Range : 10 - 18 years
Location : Bengaluru, India
Primary Skills Required :
Position 1(Required Exp Range - 12-18 years) : Java, Scala, Spark, Python, Kafka, Airflow, SQL, Databricks, Snowflake, Hive, AWS, Oracle Exadata, SAP Data Services
Position 2(Required Exp Range - 10-15 years) : Java, Scala, Spark, Python, Kafka, Airflow, SQL, Databricks, Snowflake, Hive, AWS
Required Qualifications
- Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience – preferably with a digital media or digital advertising company
- Experience delivering products in an agile software development environment including sprint work in Jira
- Excellent interpersonal skills with the ability to collaborate and partner across multiple teams and organizations
- Strong SQL experience including writing / optimizing complex queries against distributed data stores such as Aurora, Hadoop, Hive, Oracle, and Snowflake
- Experience with data pipeline and workflow management tools : Apache NiFi or Apache Airflow
- Expert level knowledge in at least one programming language such as Python, R, Scala, Java.
- Demonstrated experience working with business intelligence tools such as MicroStrategy, Tableau, Business Objects, Looker, etc.
Category Technologies
Languages
Scala, Python, SQL
Data Processing
Apache Spark, Flink, Airflow
Platforms & Tools
Databricks, Hive, Presto, Snowflake
Cloud
AWS (S3, EMR, Glue, Lambda)
Demonstrated ability to effectively communicate complex concepts to technical and unacquainted audiencesExperience in working with large datasets (Terabytes or more)Strong presentation and documentation skills including experience working with Confluence, Power Point, and Lucid ChartStrong analytical and critical thinking skillsEnjoy working collaboratively with a talented group of people to tackle challenging business problems so we all succeed (or fail fast) as a teamPreferred Qualifications
Experience with digital advertising systems and ecosystemsExperience using data analytics to triage and troubleshoot advertising workflowsExperience with network topologies, systems architecture overviews, and entity relationship diagrams (ERD)