Talent.com
Data Engineer
Data EngineerKoantek • pushkar, gujarat, in
No longer accepting applications
Data Engineer

Data Engineer

Koantek • pushkar, gujarat, in
1 day ago
Job description

We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry

experience. The ideal candidate will have a proven track record of working on live projects.

He / she will play a key role in developing and maintaining scalable data solutions using

Databricks and related technologies.

Key Responsibilities :

  • Develop, and deploy end-to-end data pipelines and solutions on Databricks,

integrating with various data sources and systems.

  • Collaborate with cross-functional teams to understand data, and deliver effective BI
  • solutions.

  • Implement data ingestion, transformation, and processing workflows using Spark
  • (PySpark / Scala), SQL, and Databricks notebooks.

  • Develop and maintain data models, ETL / ELT processes ensuring high performance,
  • reliability, scalability and data quality.

  • Build and maintain APIs and data services to support analytics, reporting, and
  • application integration.

  • Ensure data quality, integrity, and security across all stages of the data lifecycle.
  • Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.
  • Integrate data from various sources, including APIs, relational and non-relational
  • databases, IoT devices, and external data providers.

  • Ensure adherence to data governance, security, and compliance policies.
  • Required Skills and Experience :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3-6 years of hands-on experience in data engineering, with a strong focus on
  • Databricks and Apache Spark.

  • Strong programming skills in Python / PySpark and / or Scala, with a deep understanding
  • of Apache Spark.

  • Experience with Azure Databricks.
  • Strong SQL skills for data manipulation, analysis, and performance tuning.
  • Strong understanding of data structures and algorithms, with the ability to apply them to
  • optimize code and implement efficient solutions.

  • Strong understanding of data architecture, data modeling, ETL / ELT processes, and
  • data warehousing concepts.

  • Experience building and maintaining ETL / ELT pipelines in production environments.
  • Familiarity with Delta Lake, Unity Catalog, or similar technologies.
  • Experience working with structured and unstructured data, including JSON, Parquet,
  • Avro, and time-series data.

  • Familiarity with CI / CD pipelines and tools like Azure DevOps, version control (Git), and
  • DevOps practices for data engineering.

  • Excellent problem-solving skills, attention to detail, and ability to work independently or
  • as part of a team.

  • Strong communication skills to interact with technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Experience with Delta Lake and Databricks Workflows.
  • Exposure to real-time data processing and streaming technologies (Kafka, Spark
  • Streaming).

  • Exposure to data visualization tool Databricks Genie for data analysis and reporting.
  • Knowledge of data governance, security, and compliance best practices.
  • Must Have Skills : Spark, Migration Experience, ETL

    Create a job alert for this search

    Data Engineer • pushkar, gujarat, in

    Related jobs
    Data Engineer

    Data Engineer

    Digitalzone • Ajmer, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Insight Global • pushkar, gujarat, in
    The Senior Data Engineer is responsible for building and optimizing ETL / ELT pipelines that process terabytes of data daily across 186 data assets, implementing BigQuery datasets with enterprise-sca...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer with Databricks Expertise

    Data Engineer with Databricks Expertise

    Hello World Tech Consulting • Ajmer, IN
    We are seeking a highly skilled Data Engineer with Databricks certifications and.Databricks Lakehouse platform and its.The ideal candidate will possess a robust understanding of AWS.Design and impl...Show more
    Last updated: 3 days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    Cozzera • pushkar, gujarat, in
    We are looking for an experienced.The ideal candidate will serve as the go-to expert for Databricks platform architecture, Unity Catalog, and emerging Databricks capabilities such as Genie, Vector ...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Engineer with Snowflake

    Data Engineer with Snowflake

    KATBOTZ® • Ajmer, IN
    Urgent Requirement for Snowflake Data Engineer.We are seeking a skilled and experienced Snowflake Data Engineer to join our data team. The ideal candidate will be responsible for designing, building...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Pushkar, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Pushkar, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Ajmer, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Veraxion • Pushkar, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    thinkbridge • ajmer, rajasthan, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • pushkar, gujarat, in
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Pushkar, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Pushkar, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Ajmer, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Sapphire Software Solutions Inc • Ajmer, IN
    A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and...Show more
    Last updated: 2 days ago • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Newpage Solutions • Ajmer, IN
    Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Ingrain Systems Inc • pushkar, India
    Proficient working knowledge of.Experience in Azure Cloud Services –.Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Collabera • Pushkar, Republic Of India, IN
    As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices.Your role involves creatin...Show more
    Last updated: 2 days ago • Promoted