Associate Director - Data Engineering

About Brownloop :

Brownloop is a US-based fintech company focused on leveraging data, analytics, and AI solutions to help Private Equity firms make smarter investment decisions. We work with some of the largest and most reputed Private Equity companies in the world. We plan to expand our presence into India by setting up our core data competency and product development center, extending and supporting our current team and customers based in the US.

Job Summary :

We are in search of a proficient Senior Data Engineer with minimum 10 years of experience to join our innovative team. The chosen candidate will lead the conceptualization, design, and deployment of our data solutions tailored to meet our clients' unique business requirements. This role involves significant collaboration with data scientists, architects, and other stakeholders to ensure the integrity and efficiency of data systems.

Apart from having strong technical skills, we are looking to onboard candidates who can drive independent conversations with business teams and manage engagements.

We are offering this position in India, fully remote with limited travel requirements.

Key Responsibilities :

Data Analysis and Organization : Analyse and organize raw data to derive actionable insights.

Data Systems and Pipelines : Build and maintain robust data systems and pipelines to ensure seamless data flow.

Business Needs Assessment : Evaluate business needs and objectives to design appropriate data solutions.

Trend Interpretation : Interpret trends and patterns to support business decision-making.

Complex Data Analysis : Conduct complex data analyses and report on findings to stakeholders.

Data Preparation : Prepare data for prescriptive and predictive modeling.

Algorithm and Prototype Development : Build algorithms and prototypes to enhance data processing capabilities.

Data Integration : Combine raw information from various sources to create comprehensive data sets.

Data Quality Enhancement : Explore and implement ways to improve data quality and reliability.

Data Acquisition Opportunities : Identify opportunities for new data acquisition to enhance analytics capabilities.

Analytical Tool Development : Develop analytical tools and programs to support data-driven decision-making.

Collaboration : Collaborate with data scientists and architects on multiple projects to ensure the success of data initiatives.

Requirements and Skills :

Experience :

Previous experience as a data engineer or in a similar role.

Proven expertise with data models, data mining, and segmentation techniques.

Hands-on experience with SQL database design.

Technical Skills :

Expert Proficiency in Snowflake (must have), Azure Synapse Analytics  and similar technologies

Proficiency in programming languages such as Java, Python and SQL

Proficiency in databases like Oracle, SQL Server, MySQL, PostGresql for structured data

Expert knowledge of Azure Data Factory, Apache Airflow, Blob storage, ADLS, Azure function apps, Azure logic apps, Azure DevOps for CI / CD

Solid understanding of Data warehouse concepts and Dimensional Modelling

Must have experience implementing data quality frameworks / tools, security practices (data encryption, access controls, compliance etc.,)

Should have good understanding of version control using Github

Good knowledge using data visualization tools like PowerBI, Tableau

Good understanding of Machine Learning and AI frameworks

Strong numerical and analytical skills.

Education :

Degree in Computer Science, IT, or a related field; a Master’s degree is a plus.

Data engineering certification is a plus.

Soft Skills :

Excellent problem-solving skills.

Strong communication (oral & written) and collaboration abilities.

Ability to work effectively in a fast-paced, dynamic environment.

Ability to guide and mentor junior team members and manage onshore / offshore resources for successful delivery of the projects

Excellent time management skills