Talent.com
This job offer is not available in your country.
Senior Principal Consultant - Data Architect

Senior Principal Consultant - Data Architect

ConfidentialIndia
10 days ago
Job description

Data Architect - Databricks (Azure / AWS)

Role Overview :

We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data.

Required Skills and Experience :

  • 8+ years of experience in data architecture or engineering roles, with at least 3+ years specializing in cloud-based big data solutions.
  • Hands-on expertise with Databricks on Azure or AWS .
  • Deep understanding of Delta Lake , medallion architecture (bronze / silver / gold zones), and data governance tools (e.g., Unity Catalog, Purview).
  • Strong experience migrating large datasets and batch / streaming pipelines from on-prem to Databricks.
  • Expertise with Spark (PySpark / Scala) at scale and optimizing Spark jobs.
  • Familiarity with ingestion from RDBMS (Oracle, SQL Server) and legacy Hadoop ecosystems.
  • Proficiency in orchestration tools (Databricks Workflows, Airflow, Azure Data Factory, AWS Glue Workflows).
  • Strong understanding of cloud-native services for storage, compute, security, and networking.

Preferred Qualifications :

  • Databricks Certified Data Engineer or Architect.
  • Azure / AWS cloud certifications.
  • Experience with real-time / streaming ingestion (Kafka, Event Hubs, Kinesis).
  • Familiarity with data quality frameworks (e.g., Deequ, Great Expectations).
  • Key Responsibilities :

  • Define and design cloud-native data architecture on Databricks using Delta Lake, Unity Catalog, and related services.
  • Develop migration strategies for moving on-premises data workloads (Oracle, Hadoop, Exadata, etc.) to Databricks on Azure / AWS.
  • Architect and oversee data pipelines supporting ingestion, curation, transformation, and analytics in a multi-layered (bronze / silver / gold) model.
  • Lead data modeling, schema design, performance optimization, and data governance best practices.
  • Collaborate with data engineering, platform, and security teams to build production-ready solutions.
  • Create standards for ingestion frameworks, job orchestration (e.g., workflows, Airflow), and data quality validation.
  • Support cost optimization, scalability design, and operational monitoring frameworks.
  • Guide and mentor engineering teams during the build and migration phases.
  • Attributes for Success :

  • Ability to lead architecture discussions with technical and business stakeholders.
  • Passion for modern cloud data architectures and continuous learning.
  • Pragmatic and solution-driven approach to migrations.
  • Diversity and Inclusion : An Oracle career can span industries, roles, Countries, and cultures, allowing you to flourish in new roles and innovate while blending work life in. Oracle has thrived through 40+ years of change by innovating and operating with integrity while delivering for the top companies in almost every industry. To nurture the talent that makes this happen, we are committed to an inclusive culture that celebrates and values diverse insights and perspectives, a workforce that inspires thought leadership and innovation. Oracle offers a highly competitive suite of Employee Benefits designed on the principles of parity, consistency, and affordability. The overall package includes certain core elements such as Medical, Life Insurance, access to Retirement Planning, and much more. We also encourage our employees to engage in the culture of giving back to the communities where we live and do business. At Oracle, we believe that innovation starts with diversity and inclusion and to create the future we need talent from various backgrounds, perspectives, and abilities. We ensure that individuals with disabilities are provided reasonable accommodation to successfully participate in the job application, and interview process, and in potential roles. To perform crucial job functions. That's why we're committed to creating a workforce where all individuals can do their best work. It's when everyone's voice is heard and valued that we're inspired to go beyond what's been done before.

    Skills Required

    Spark, Databricks, Airflow, Azure Data Factory, Pyspark, Aws, Azure, Scala

    Create a job alert for this search

    Senior Data Architect • India