Talent.com
Lead Data Warehouse Engineers

Lead Data Warehouse Engineers

ConfidentialChennai, India
21 days ago
Job description

Company Description

Systech Solutions, Inc. is an all-inclusive data and analytics firm specializing in cloud, data engineering, AI, and machine learning solutions. With over 30 years of experience and a global reach, we provide efficient, cost-effective strategies to solve complex business problems at the intersection of data, business, and digital technologies. Our tailored solutions have garnered a customer retention rate of over 90% in the past five years. We excel in various sectors, including finance, retail, manufacturing, healthcare, and insurance, enhancing operations, increasing revenue, and boosting customer satisfaction. Recognized by Inc. Magazine, our skilled team turns challenges into growth opportunities through insightful data and technology practices.

Responsibilities

  • Architecting and maintaining the Operational data stores (ODS), Enterprise Data Warehouse (EDW) and associated data intelligence environments including data lakes, data marts, and metadata repositories
  • Designing and implementing high performance data movement pipelines using multiple ETL tools (Informatica, Azure Data Factory, SQL Packages, etc) with batch and real-time event data streams
  • Developing scalable and re-usable frameworks for ingestion of structured and semi-structured data; and implementing various large-scale settlement and reconciliation frameworks
  • Gathering business and information requirements from various product owners across various functional units
  • Designing and creating data architecture and data flow diagrams and collaborating with peers to translate requirements into logical and physical data models.
  • Conducting design review sessions and communicating design artifacts with stakeholders.
  • Ensures database features and capabilities are incorporated into data model designs to optimize performance, resiliency, and scalability.
  • Delivering and presenting proofs of concept to of key technology components to project stakeholders and internal technology leaders
  • Developing scalable and re-usable frameworks for ingestion of structured and semi-structured data; and implementing various large-scale settlement and reconciliation frameworks
  • Leading and coordinating the design and operationalization of Master Data Management and Data Governance initiatives including custom developed solutions.
  • Working with other members of the project team to support delivery of additional project components associated with cloud data platform.
  • Problem-solving of Data warehouse and ODS application issues and production errors, including high level critical production issues that require immediate attention.
  • Perform other duties as assigned including major new project initiatives.

Qualifications

  • Bachelor's and / or Master's degree in Computer Science, Computer Engineering or related field preferred
  • 8+ years of overall software development experience is required primarily with Data warehouse applications.
  • 3+ years of hands-on development experience in Cloud-based data warehouse platform – primarily AWS Redshift
  • 2+ yrs of development experience with ETL tools (Informatica, Azure Data Factory, etc)
  • 3+ years of development experience with Python scripting experience
  • 3+ years of hands-on development experience with Relational DBs (MS SQL Server, PostgreSQL, Oracle, etc.); experience with complex stored procedures and functions using SQL
  • Strong knowledge and experience in OLAP data modeling & design
  • Demonstrated expertise in performance tuning in various DB environments with large volumes of data.
  • Experience building and scaling distributed, high available systems in cloud env (Azure / AWS)
  • Expertise in understanding complex business needs, analyzing, designing, and developing solutions.
  • Communication and professional skills and the ability to navigate relationships across business units.
  • Pluses :

  • Financial technology domain knowledge
  • Knowledge of NoSQL DBs (MongoDB / Cassandra / Azure Cosmos DB or similar)
  • Microsoft Azure Data Engineer / services related experience (ADF, Databricks, CosmosDB, Azure SQL, etc)
  • Skills Required

    Python Scripting

    Create a job alert for this search

    Lead Data Engineer • Chennai, India

    Related jobs
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    KPI PartnersChennai, IN
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneChennai, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncChennai, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme ServicesChennai, IN
    Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show moreLast updated: 1 day ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy ServicesChennai, IN
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Incchennai, tamil nadu, in
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 23 hours ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC GroupChennai, IN
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Required Technical Skill Set AWS Redshift, Glue, PySpark.Desired Experience Range 4-10 Years.Location of Requirement Chennai / Pune. Desired Competencies (Technical / Behavioral Competency).Must-Have • ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    SigmoidChennai, IN
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & CoChennai, Tamil Nadu, India
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 17 days ago
    • Promoted
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy TechnologiesChennai, IN
    We’re Hiring : LEAD DATA ENGINEER.Notice Period : Immediate to 30 Days.Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse.Develop ETL / ELT work...Show moreLast updated: 1 day ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobileChennai, IN
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalChennai, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdChennai, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
    • Promoted
    AWS Data Engineer - ETL / Data Warehousing

    AWS Data Engineer - ETL / Data Warehousing

    Talent AdvisorChennai
    Description : We are seeking a AWS-Data Engineer with strong experience across the entire Architecting and consulting a...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Resourcetree Global ServicesChennai
    Job Description : We are seeking a highly skilled and motivated Lead Data Engineer to join our Data Integration and Anal...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    JMAN GroupChennai, Tamil Nadu, India
    JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 23 days ago