Senior Data Engineer - Fivetran

Job Description

Job Title : Senior Data Engineer – Fivetran Chennai | Hyderabad | Bangalore Who we are Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We offer fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose is to provide certainty to shape a better tomorrow.Our team of + technologists and consultants are based in the US, Canada, the UK, India, Singapore and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. Many of our team leaders rank in Top 10 and 40 Under 40 lists, exemplifying our dedication to innovation and excellence.We are a Great Place to Work-Certified™ (-24), recognized by analyst firms such as Forrester, Gartner, HFS, Everest, ISG and others. We have been ranked among the ‘Best’ and ‘Fastest Growing’ analytics firms lists by Inc., Financial Times, Economic Times and Analytics India Magazine. Curious about the role? What your typical day would look like? As a Senior Data Engineer, you will operate autonomously with minimal supervision, leveraging your exceptional organizational and problem-solving abilities. On a typical day, you might

• Autonomously gathers project requirements through stakeholder discussions for non-complex data platforms, meticulously documenting technical and key business requirements in detail, and securing sign-off.
• Designs the comprehensive technical solution for the project, encompassing ingestion, ETL / ELT, data models, processing, governance, etc., with minimal support from Subject Matter Experts (SMEs).
• Develops clean, elegant, maintainable, and efficient code, ensuring the highest standards of quality and performance.
• Assumes full ownership of end-to-end data pipeline implementation, executing advanced tasks such as performance tuning, optimized coding, technical advisory, code reusability, and providing assistance to team members. Proficient in multiple paradigms including Big Data / MPP / Modern or Traditional DWH – OnPrem / Cloud.
• Provides troubleshooting and guidance to teams on complex data modeling scenarios, adept at independently resolving intricate scenarios like nested / custom hierarchies, and proficient in various modeling techniques such as ER, Dimensional, Data Vault, and Canonical.
• Independently constructs end-to-end data integration services on the project's cloud platform, overseeing and reviewing cloud-based integration tasks performed by the team.
• Conducts rigorous Quality Control checks and adheres to acceptable coding and organizing practices, ensuring reproducibility of results at any given time.
• Demonstrates a strong willingness and openness to learning new practices, platforms, and technologies, staying abreast of the latest advancements in the field.Job Requirement What do we expect?
• Accumulated over 7 years of experience in data warehousing systems, with a minimum of 1 year dedicated to building and implementing full-scale data warehouse solutions on cloud data warehouses.
• Demonstrated expertise with over 4 years of hands-on involvement in designing and developing data integration solutions utilizing ETL tools.
• Proven track record with a minimum of 2 years of practical experience in Fivetran, including configuring and managing connectors for seamless data integration.
• Successfully executed end-to-end projects with multiple transformation layers
• Monitor data ingestion processes meticulously, promptly addressing any data quality issues to uphold data accuracy and consistency.
• Continuously refine Fivetran configurations and data ingestion processes to enhance performance and operational efficiency.
• Maintain comprehensive documentation of Fivetran configurations, integration processes, and troubleshooting protocols to ensure seamless operations.
• Proficiently troubleshoot and resolve technical issues related to Fivetran connectors and data ingestion pipelines.
• Design and construct data pipelines to ingest raw data into Cloud Data Warehouses (e.g., Snowflake, Redshift, BigQuery) using Fivetran, ensuring data cleansing and transformation to meet specified requirements.
• Possess a strong grasp of data modeling, ETL processes, and cloud data warehousing concepts
• Proficiency in SQL enables the crafting of structured and efficient queries for large datasets, ensuring optimal data retrieval and manipulation.
• Experience in migration projects and familiarity with ETL reusable frameworks provide additional value.
• Ability to develop and execute test cases for data profiling and validation.
• Hands-on experience orchestrating Fivetran data pipeline jobs, with additional proficiency in any orchestration tool considered advantageous.
• Skilled in integrating GitHub or other version control tools with Fivetran, streamlining development and ensuring version control.
• Proficient in Shell / PowerShell scripting.
• Enthusiastic about working in an agile methodology and possesses a comprehensive understanding of the DevOps process, ensuring alignment with best practices and methodologies.
• Demonstrated aptitude for guiding and mentoring junior team members, fostering skill development and knowledge sharing within the team. You are important to us, let’s stay connected! Every individual comes with a different set of skills and qualities so even if you don’t tick all the boxes for the role today, we urge you to apply as there might be a suitable / unique role for you tomorrow.We are an equal-opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire. Note : The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry .