Talent.com
This job offer is not available in your country.
▷ (Immediate Start) Senior Data Engineer

▷ (Immediate Start) Senior Data Engineer

SG AnalyticsIndia
4 hours ago
Job description

The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficiency and speed, strong project management skills, and a core value base for how analytics can proactively improve organizations. You will be part of the Data & Analytics team and will partner closely with a team of data scientists, business analysts & business intelligence leading a cloud-based strategy for our clients.

About the Role

You'll work on our Azure based data pipeline projects with a focus on collecting, parsing, managing, analysing and visualizing large sets of data to turn information into insights using multiple technology platforms. Therefore, this role requires an understanding of how a secure data cloud environment is architected to gain real insights faster, with less friction and complexity. Ideal candidate should be a champion of building a distributed and scalable architecture that is metadata driven. You're also a detail-oriented person that believes data quality should never be sacrificed.

Mandatory Skills : Python, SQL, Snowflake, Cloud

Experience - 5 to 7 yrs

Location - Bangalore

Work Mode - Hybrid

Responsibilities :

  • Master the use of technology & modern tools to optimize solutions and continuous process improvements
  • Facilitate team to design, build and test end to end data pipeline including data ingestion (streaming, events and batch), data integration, data curation
  • Help build out and support an Enterprise Data Marketplace
  • Administer the Big data platform on the cloud
  • Implement automation of jobs and testing
  • Optimize the data pipeline to support ML workloads and use cases
  • Support mission critical applications and near real time data needs from the data platform
  • Build and support reusable framework to ingest, integration and provision data
  • Capture and publish metadata and new data to subscribed users
  • Work collaboratively with product managers, data scientists as well as business partners and actively participate in design thinking session
  • Motivate, coach, and serve as a role model and mentor for other development team associates / members that leverage the platform
  • Establish relationship with key business lines, Infosec and infrastructure team
  • Ensure security is integrated into all cloud services.
  • Build, monitor, and manage the cloud infrastructure.
  • Monitor and optimize cloud workloads.
  • Review current and future Azure implementations and suggest ways to improve and standardize the cloud offerings.

Qualifications

  • Bachelor’s degree in Computer Science, Physics, Mathematics, Statistics or other Engineering disciplines
  • Required Skills :

  • 5+ years' experience as Data engineer
  • Experience with big data tools : Spark, Databricks
  • Experience with building relational SQL Data Warehouses
  • Good Hands on experience with data pipeline and workflow management tools : Azure Data Factory, SSIS
  • Experience with object-oriented / object function scripting languages : Python, C#, Scala, VBA, etc.
  • Experience with systems scripting languages : Batch Scripts, Powershell
  • Experience with Git / GitHub and automating builds
  • Strong interpersonal, verbal and written communication skills and ability to present complex technical / analytical concepts to executive audience
  • Strong business mindset with customer obsession; ability to collaborate with business partners to identify needs and opportunities for improved data management and delivery
  • Preferred Skills :

  • Experience building distributed architecture and IoT in a Dev / Ops environment
  • Experience in both Agile and Waterfall methodologies
  • Experience building and optimizing claims data pipelines, architectures / data models and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience with the Agile workflow, Test Driven Development, and continuous improvement / continuous deployment.
  • Strong analytic skills related to working with structured and unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management using Azure Automation, Azure Function Apps, and Azure Data Factory.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of Azure Automation, Azure Data Factory, and highly scalable 'big data' data stores such as Azure Blob Storage, Azure Data Lake
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Excellent planning, prioritization, problem solving skills.
  • Experience with any of the following scripting languages, R, JSON, Parquet, JavaScript, Regex, PowerShell, shell scripting.
  • Experience with Data Bricks, HDInsight, Python.
  • Create a job alert for this search

    Senior Data Engineer • India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AINagpur, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainIndia, India
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    XebiaNagpur, IN
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaNagpur, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 18 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsNagpur, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeNagpur, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Analyst / Engineer

    Senior Data Analyst / Engineer

    Milestone Technologies, Inc.Nagpur, IN
    This role will ensure data ingested from manufacturing systems into Client's data lake and downstream applications (e.The successful candidate will work directly with. Identify gaps, missing values,...Show moreLast updated: 20 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncNagpur, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXNagpur, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsNagpur, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNagpur, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Lead Data Engineer

    Senior Lead Data Engineer

    TerraFinn TechnologiesNagpur, IN
    TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally. The company focuses on providing expert employees to he...Show moreLast updated: 7 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsNagpur, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 21 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudNagpur, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 18 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisNagpur, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseNagpur, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Az-Tec TalentNagpur, IN
    Remote
    Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekNagpur, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsNagpur, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 8 days ago