Talent.com
This job offer is not available in your country.
Principal Data Engineer

Principal Data Engineer

ConfidentialBengaluru / Bangalore
12 days ago
Job description
  • Understand the business case and translate to a holistic a solution involving AWS Cloud Services , PySpark, EMR, Python, Data Ingestion and Cloud DB Redshift / Postgres
  • PL / SQL development for high volume data sets.
  • Experience in preparing data warehouse design artifacts based on given requirements (ETL framework design, data modeling, source-target-mapping), DB query monitoring for tuning and optimization opportunities
  • Proven experience with large, complex database projects in environments producing high-volume data
  • Demonstrated problem solving skills; familiarity with various root cause analysis methods; experience in
  • documenting identified problems and determined resolutions.
  • Makes recommendations regarding enhancements and / or improvements
  • Provides appropriate consulting, interfacing, and standards relating to database management, and monitors transaction activity and utilization.
  • Performance issues analysis and Tuning
  • Data Warehouse design and development, including logical and physical schema design.
  • Other Responsibilities :

    Perform all activities in a safe and responsible manner and support all Environmental, Health, Safety

    Security requirements and programs

    Customer / stakeholder focus. Ability to build strong relationships with Application teams, cross

    functional IT and global / local IT teams

    Required Qualifications :

    • Bachelor or master s degree in information technology, Electrical Engineering or similar relevant fields.
    • Proven experience (3 years minimum) with ETL development, design, performance tuning and optimization
    • Very good knowledge of data warehouse architecture approaches and trends, and high interest to apply and further develop that knowledge, including understanding of
    • Dimensional Modelling and ERD design approaches,
    • Working Experience in Kubernetes and Docker Administration is added advantage
    • Good experience in AWS Services, Big data, PySpark, EMR, Python, Cloud DB RedShift
    • Proven experience with large, complex database projects in environments producing high-volume data,
    • Proficiency in SQL and PL / SQL
    • Experience in preparing data warehouse design artifacts based on given requirements (ETL framework design, data modeling, source-target-mapping),
    • Experience in developing streaming applications e.g. SAP Data Intelligence, Spark Streaming, Flink, Storm, etc.
    • Excellent conceptual abilities pared with very good technical documentation skills, e.g. ability to understand and document complex data flows as part of business / production processes, infrastructure.
    • Familiarity with SDLC concepts and processes
    • Additional Skill :

    • Experience using and developing on AWS services.
    • Experience in semiconductor industry,
    • Knowledge of Semi structured datasets
    • Experience with reporting data solutions and business intelligence tools
    • Experience in collecting, structuring and summarizing requirements in a data warehouse environment,
    • Knowledge of statistical data analysis and data mining,
    • Experience in test management, test case definition and test processes
    • Preferred Qualifications :

    • Bachelor s or master s degree with Minimum 6 Years Exp
    • Mush have experience in AWS Cloud Services, PySpark, EMR, Python, Cloud DB Redshift / Postgres and Data Ingestion
    • Experience in preparing Data Warehouse design (ETL framework design, data modeling, source-target-mapping)
    • Skills Required

      Dimensional Modeling, Sql, IT, Python, Sdlc, Aws

    Create a job alert for this search

    Principal Data Engineer • Bengaluru / Bangalore

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionhosur, tamil nadu, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Senior Principal Data Engineer

    Senior Principal Data Engineer

    MakeMyTripBangalore Urban, Karnataka, India
    Senior Principal Data Engineer.Must have 10+ years of experience.We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Product...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Xebiabangalore, karnataka, in
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + Companyhosur, tamil nadu, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 16 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXhosur, tamil nadu, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 8 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    PriceEasy AIBengaluru, Karnataka, India
    Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Principal Engineer

    Principal Engineer

    CoffeeBeansBangalore Urban, Karnataka, India
    CoffeeBeans Consulting is a tech consulting firm focused on making organizations.We are looking for a Principal Engineer who can design and implement complex solutions that are scalable, future-pro...Show moreLast updated: 19 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritohosur, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 16 hours ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.Cloudhosur, tamil nadu, in
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceshosur, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisehosur, tamil nadu, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Inchosur, tamil nadu, in
    Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemshosur, tamil nadu, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgehosur, tamil nadu, in
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago