Talent.com
This job offer is not available in your country.
Senior Data Engineer (Databricks)

Senior Data Engineer (Databricks)

Tredence Inc.Chennai, Tamil Nadu, India
25 days ago
Job description

Role : Senior Databricks Engineer / Databricks Technical Lead / Data Architect

Experience : 6-12 years

Location : Bangalore, Chennai, Delhi, Pune, Kolkata

About Tredence :

Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.

We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of realizing the data’s full potential.

Primary Roles and Responsibilities :

  • Developing Modern Data Warehouse solutions using Databricks and Azure Stack
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space
  • Collaborate with DW / BI leads to understand new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussion with client architect and team members
  • Orchestrate the data pipelines in scheduler via Airflow

Skills and Qualifications :

  • Bachelor's and / or master’s degree in computer science or equivalent experience.
  • Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse / ETL projects.
  • Deep understanding of Star and Snowflake dimensional modelling.
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Should have hands-on experience in SQL, Python and Spark (PySpark)
  • Candidate must have experience in AWS / Azure stack
  • Desirable to have ETL with batch and streaming (Kinesis).
  • Experience in building ETL / data warehouse transformation processes
  • Experience with Apache Kafka for use with streaming data / event-based data
  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev / Ops environment with tools such as Terraform, CircleCI, GIT.
  • Proficiency in RDBMS, complex SQL, PL / SQL, Unix Shell Scripting, performance tuning and troubleshoot
  • Databricks Certified Data Engineer Associate / Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
  • Should have experience working in Agile methodology
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail.
  • Mandatory Skills : Python / PySpark / Spark with Azure / Databricks

    Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees. Visit our website for more details : https : / / www.tredence.com /

    NP : Immediate to 15 Days

    Create a job alert for this search

    Senior Data Engineer • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESChennai, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLChennai, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainChennai, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsChennai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 24 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisChennai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentChennai, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AiChennai, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.chennai, tamil nadu, in
    Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake. Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeChennai, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TCS Human Resources Team!!!.Skill : Snowflake Data Engineer.Required Technical Skill Set : Snowflake, dbt, FiveTran, Snowpipe, AWS services : Managed Airflow (MWAA), S3, Lambda.Minimum ...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh TechnologiesChennai, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivechennai, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIChennai, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, Tamil Nadu, India
    We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers...Show moreLast updated: 30+ days ago