Talent.com
This job offer is not available in your country.
▷ Apply in 3 Minutes! Senior Data Engineer

▷ Apply in 3 Minutes! Senior Data Engineer

SG AnalyticsBengaluru, Karnataka, India
7 hours ago
Job description

The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficiency and speed, strong project management skills, and a core value base for how analytics can proactively improve organizations. You will be part of the Data & Analytics team and will partner closely with a team of data scientists, business analysts & business intelligence leading a cloud-based strategy for our clients.

About the Role

You'll work on our Azure based data pipeline projects with a focus on collecting, parsing, managing, analysing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure data cloud environment is architected to gain real insights faster, with less friction and complexity. Ideal candidate should be a champion of building a distributed and scalable architecture that is metadata driven. You're also a detail-oriented person that believes data quality should never be sacrificed.

Mandatory Skills : Python, SQL, Snowflake, Cloud

Experience - 5 to 7 yrs

Location - Bangalore

Work Mode - Hybrid

Responsibilities :

  • Master the use of technology & modern tools to optimize solutions and continuous process improvements
  • Facilitate team to design, build and test end to end data pipeline including data ingestion (streaming, events and batch), data integration, data curation
  • Help build out and support an Enterprise Data Marketplace
  • Administer the Big data platform on the cloud
  • Implement automation of jobs and testing
  • Optimize the data pipeline to support ML workloads and use cases
  • Support mission critical applications and near real time data needs from the data platform
  • Build and support reusable framework to ingest, integration and provision data
  • Capture and publish metadata and new data to subscribed users
  • Work collaboratively with product managers, data scientists as well as business partners and actively participate in design thinking session
  • Motivate, coach, and serve as a role model and mentor for other development team associates / members that leverage the platform
  • Establish relationship with key business lines, Infosec and infrastructure team
  • Ensure security is integrated into all cloud services.
  • Build, monitor, and manage the cloud infrastructure.
  • Monitor and optimize cloud workloads.
  • Review current and future Azure implementations and suggest ways to improve and standardize the cloud offerings.

Qualifications

  • Bachelor’s degree in Computer Science, Physics, Mathematics, Statistics or other Engineering disciplines
  • Required Skills :

  • 5+ years' experience as Data engineer
  • Experience with big data tools : Spark, Databricks
  • Experience with building relational SQL Data Warehouses
  • Good Hands on experience with data pipeline and workflow management tools : Azure Data Factory, SSIS
  • Experience with object-oriented / object function scripting languages : Python, C#, Scala, VBA, etc.
  • Experience with systems scripting languages : Batch Scripts, Powershell
  • Experience with Git / GitHub and automating builds
  • Strong interpersonal, verbal and written communication skills and ability to present complex technical / analytical concepts to executive audience
  • Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
  • Preferred Skills :

  • Experience building distributed architecture and IoT in a Dev / Ops environment
  • Experience in both Agile and Waterfall methodologies
  • Experience building and optimizing claims data pipelines, architectures / data models and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience with the Agile workflow, Test Driven Development, and continuous improvement / continuous deployment.
  • Strong analytic skills related to working with structured and unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management using Azure Automation, Azure Function Apps, and Azure Data Factory.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of Azure Automation, Azure Data Factory, and highly scalable 'big data' data stores such as Azure Blob Storage, Azure Data Lake
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Excellent planning, prioritization, problem solving skills.
  • Experience with any of the following scripting languages, R, JSON, Parquet, JavaScript, Regex, PowerShell, shell scripting.
  • Experience with Data Bricks, HDInsight, Python.
  • Create a job alert for this search

    Senior Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisBengaluru, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AvathonBengaluru, Karnataka, India
    AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainBengaluru, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    6thStreet.comBengaluru, Karnataka, India
    You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers analytics, AI, and product teams across the business. Understand and analyze client business requirements...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyBangalore Urban, Karnataka, India
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 7 days ago
    • Promoted
    Staff / Senior Data Engineer

    Staff / Senior Data Engineer

    HG Insightshosur, tamil nadu, in
    At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 7 days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticshosur, tamil nadu, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsBengaluru, Karnataka, India
    We are seeking a highly skilled and experienced.The ideal candidate will have deep expertise in.You will be responsible for designing, building, and maintaining scalable data pipelines and infrastr...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIBangalore, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 5 days ago
    • Promoted
    Senior Engineer Data [T500-20496]

    Senior Engineer Data [T500-20496]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.About Albertsons Companies Inc.ACI) : As a leading food and drug retailer in the United States, Albertsons Companies, Inc. Our well-known banners across the Unit...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladebangalore district, karnataka, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labshosur, tamil nadu, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SMC Squared IndiaBengaluru, Karnataka, India
    This position is responsible for the design, development, and deployment of extraction, transformation, and load (ETL) processes and methodologies to satisfy corporate data movements across various...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesBangalore Urban, Karnataka, India
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eagle Eye NetworksBengaluru, Karnataka, India
    Eagle Eye Networks is the global leader in cloud video surveillance, delivering cyber-secure, cloud-based video with artificial intelligence (AI) and analytics to make businesses more efficient and...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SG AnalyticsBengaluru, Karnataka, India
    The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficie...Show moreLast updated: 17 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tekshiras Software Services Private Limitedhosur, tamil nadu, in
    We’re Hiring – Senior Data Engineer (10+ Years Experience).We are looking for a seasoned professional with strong expertise in Data Engineering, Data Analysis, SQL and ML / Gen AI.The ideal candidate...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago