Talent.com
Data Engineer
Data EngineerLogFix SCM Solutions Pvt Ltd • Karnataka, India
Data Engineer

Data Engineer

LogFix SCM Solutions Pvt Ltd • Karnataka, India
21 days ago
Job description

Job Title : Fullstack Data Engineer

Experience Required :

  • 8 – 11 years of experience in data engineering / full stack data development .
  • Location : Mumbai / Bangalore

Key Responsibilities :

  • Design, develop, and maintain end-to-end data pipelines on AWS , including data preparation, extraction, transformation, loading, normalization, aggregation, warehousing, data lakes, and governance.
  • Develop and maintain Data Warehouses and Lakehouse architectures .
  • Work with modern data architectures such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh.
  • Design and implement data models and ensure high-quality, scalable data architecture .
  • Ensure cost-effective management of data pipelines and resources.
  • Implement CI / CD processes for data pipelines and infrastructure.
  • Work with Agile methodologies (Scrum / Kanban) for iterative delivery.
  • Scope, estimate, and deliver committed work independently and as part of the agile team.
  • Collaborate with teams to ensure data quality, security, and governance across platforms.
  • Required Skills & Technologies :

  • Programming : Python, PySpark, Bash / Shell Scripting
  • Databases : SQL, NoSQL (MongoDB), Snowflake
  • Data Orchestration & ETL : Airflow, Glue, DBT
  • Streaming / Messaging : Kafka, Kinesis
  • Cloud / Infrastructure : AWS, Terraform
  • Version Control : GitHub
  • Other : APIs, Lakehouse architecture knowledge
  • Create a job alert for this search

    Data Engineer • Karnataka, India

    Related jobs
    Data Engineer

    Data Engineer

    Pretium Enterprise Services, India • Karnataka, India
    Would be an individual contributor responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects are desired.Collaborate within Ag...Show more
    Last updated: 18 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Are Telagadde, Karnataka, India
    Job Summary for AWS Data Engineer : We are seeking an experienced AWS Data Engineer with strong skills in Python and SQL to design, develop, and maintain cloud-based data pipelines and analyti...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer I [T500-21404]

    Data Engineer I [T500-21404]

    ADM • Karnataka, India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Finastra • Karnataka, India
    Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our business units and 8000+ custome...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Karnataka, India, India
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer 2

    Data Engineer 2

    Yubi • Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
    Last updated: 29 days ago • Promoted
    Lead Data Engineer [T500-21385]

    Lead Data Engineer [T500-21385]

    ANSR • Karnataka, India
    ANSR is hiring for one of its clients.Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members levera...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer

    Data Engineer

    VIDA Digital Identity • Karnataka, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
    Last updated: 4 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti Inc • Karnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    The Glove • Karnataka, India
    Associate 5 to 8 yrs / Manager 8 to 12 yrs).We are seeking a talented Data Engineer with strong expertise in.Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building ...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    ACL Digital • Karnataka, India
    GCP – Firestore, Google Cloud Storage, Cloud Build,BigQuery.Nutter Framework – Experience in writing unit test in Nutter Framework.Show more
    Last updated: 29 days ago • Promoted
    Data Engineer

    Data Engineer

    Selector • Karnataka, India
    Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Networth Corp • Karnataka, India
    Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services. End to end development lifecycle of complex large-scale and ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer I [T500-21306]

    Data Engineer I [T500-21306]

    ADM • Karnataka, India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show more
    Last updated: 18 days ago • Promoted
    Data Engineer

    Data Engineer

    Fiery • Karnataka, India
    Digital Front Ends (DFEs) and workflow solutions for the growing industrial and graphic arts print industries.Fiery is leading the transformation from analog to digital imaging with scalable, digit...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Trigent Software - Professional Services • Karnataka, India
    Interested candidates, please share your updated CV to.As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines and data architectures to support...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Inc • Karnataka, India
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    Ubique Systems • Karnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show more
    Last updated: 4 days ago • Promoted