Big data Lead

About Impetus

Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.

Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100 enterprises, headquartered in Los Gatos, California, with development centers in NOIDA, Indore, Gurugram, Bengaluru, Pune, and Hyderabad with over 3000 global team members. We also have offices in Canada and Australia and collaborate with a number of established companies, including American Express, Bank of America, Capital One, Toyota, United Airlines, and Verizon.

Roles & Responsibilities

In-depth understanding of Big data concepts and distributed systems

Proficiency in Python and writing code in PySpark

Should possess good understanding of SQL concepts and must be proficient writing complex SQL queries

Thorough understanding of optimization and performance improvement for Spark based Workloads

Experience with working on atleast one Cloud platform will be a good to have

Conceptual knowledge and fitment for Data Structures & Algorithms

Possessing in-depth knowledge of various Data Processing Patterns (Batch / NRT / RT processing) & capable of providing design & architecture of typical business problems

Knowledge and experience with NoSQL Database (Cassandra / HBase / MongoDB / CouchDB / Neo4j),SQL Database (MySQL / Oracle).

Kafka, Redis, Distributed Message Queues alongwith Distributed Caching

Proficient understanding of Build tools (Maven / Gradle), Code Versioning tools (Git) with Continuous Integration

Strong technical development experience with writing performant code leveraging best coding practices.

Good communication skills and aptitude