Talent.com
No longer accepting applications
Senior Data Solutions Engineer

Senior Data Solutions Engineer

KoantekHyderabad, Republic Of India, IN
5 days ago
Job description

We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry

experience. The ideal candidate will have a proven track record of working on live projects.

He / she will play a key role in developing and maintaining scalable data solutions using

Databricks and related technologies.

Key Responsibilities :

  • Develop, and deploy end-to-end data pipelines and solutions on Databricks,

integrating with various data sources and systems.

  • Collaborate with cross-functional teams to understand data, and deliver effective BI
  • solutions.

  • Implement data ingestion, transformation, and processing workflows using Spark
  • (PySpark / Scala), SQL, and Databricks notebooks.

  • Develop and maintain data models, ETL / ELT processes ensuring high performance,
  • reliability, scalability and data quality.

  • Build and maintain APIs and data services to support analytics, reporting, and
  • application integration.

  • Ensure data quality, integrity, and security across all stages of the data lifecycle.
  • Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.
  • Integrate data from various sources, including APIs, relational and non-relational
  • databases, IoT devices, and external data providers.

  • Ensure adherence to data governance, security, and compliance policies.
  • Required Skills and Experience :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3-6 years of hands-on experience in data engineering, with a strong focus on
  • Databricks and Apache Spark.

  • Strong programming skills in Python / PySpark and / or Scala, with a deep understanding
  • of Apache Spark.

  • Experience with Azure Databricks.
  • Strong SQL skills for data manipulation, analysis, and performance tuning.
  • Strong understanding of data structures and algorithms, with the ability to apply them to
  • optimize code and implement efficient solutions.

  • Strong understanding of data architecture, data modeling, ETL / ELT processes, and
  • data warehousing concepts.

  • Experience building and maintaining ETL / ELT pipelines in production environments.
  • Familiarity with Delta Lake, Unity Catalog, or similar technologies.
  • Experience working with structured and unstructured data, including JSON, Parquet,
  • Avro, and time-series data.

  • Familiarity with CI / CD pipelines and tools like Azure DevOps, version control (Git), and
  • DevOps practices for data engineering.

  • Excellent problem-solving skills, attention to detail, and ability to work independently or
  • as part of a team.

  • Strong communication skills to interact with technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Experience with Delta Lake and Databricks Workflows.
  • Exposure to real-time data processing and streaming technologies (Kafka, Spark
  • Streaming).

  • Exposure to data visualization tool Databricks Genie for data analysis and reporting.
  • Knowledge of data governance, security, and compliance best practices.
  • Must Have Skills : Spark, Migration Experience, ETL

    Create a job alert for this search

    Senior Data Engineer • Hyderabad, Republic Of India, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ValueLabsHyderabad, Telangana, India
    As a Senior Data Engineer, you will be the lead architect and builder of the data backbone for our entire next-generation digital asset platform. Embedded within our "Agentic AI & Automation" squad,...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - AWS & Python

    Senior Data Engineer - AWS & Python

    Egenhyderabad, telangana, in
    Design, develop, and maintain ETL / ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc. Build and manage data lakes and data warehouses using Amazon S3, Re...Show moreLast updated: 1 day ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.ioHyderabad, Telangana, India
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 8 Years - 12 years.We are...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology InsightsHyderabad, IN
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 7 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    FornaxHyderabad, IN
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras AnalyticsHyderabad, Telangana, India
    About Saras Analytics : We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.Our suite of work spans e...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ExperianHyderabad, Telangana, India
    Experian Consumer Services – Careers That Define “What’s the Next Big (Data) Thing” for Consumers?.What could be more exciting – personally and professionally – than being part of a “disruptive” bu...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    MindlanceHyderabad, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cohyderabad, telangana, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaHyderabad, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American InferenceHyderabad, IN
    Please apply directly through for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. We are an AI and Data Consulti...Show moreLast updated: 14 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Hyderabad, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Accordion IndiaHyderabad, Republic Of India, IN
    Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLHyderabad, Telangana, India
    Job Summary : We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines.Key Responsibi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC GroupHyderabad, IN
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    ExperianHyderabad, Republic Of India, IN
    Experian Consumer Services – Careers That Define “What’s the Next Big (Data) Thing” for Consumers?.What could be more exciting – personally and professionally – than being part of a “disruptive” bu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EverestDX IncHyderabad, Telangana, India
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Quadrant Technologieshyderabad, telangana, in
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show moreLast updated: 30+ days ago