Pyspark Developer

Job Description

Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams that push the boundaries of what-is- possible and build solutions that energize and inspire. We are headquartered in the Silicon Valley and have our delivery centers across the globe. The below role is for our Chennai.About the role : You will work on teams building a variety of big data analytics solutions including big datalakes. More specifically, you will work on : Scalable data ingestion pipelines to handle real time streams, CDC events, and batch data High-performance data processing for structured and unstructured data, and data harmonizationScheduling, orchestrating, and validating pipelinesException handling and log monitoring for debuggingCollaborate with business consultants, data scientists, engineers, and application developers to develop analyticssolutionsJob RequirementRequired Experience, Skills & Competencies : Hadoop ecosystem - HDFS, Hive, Sqoop , Kafka, ELK Stack etc Spark, Scala , Python and core / advance JavaNOSQL databases e.g. Hbase, Cassandra, MongoDBRelevant AWS or Azure components required to build big data solutionsGood to know : Databricks, SnowflakeAbility to develop and manage scalable Hadoop cluster environmentsGood understanding of data warehousing concepts, distributed systems, data pipelines, ETL3+ years of professional experience with at least 2 years in big data engineeringDesignation will be commensurate with expertise / experience. Compensation packages are among the best in theindustry.