Talent.com
Senior Data Engineer

Senior Data Engineer

Greystaramritsar, punjab, in
14 hours ago
Job description

About the role :

We are looking for a strong Data Architect to join our engineering team, focusing on leveraging Azure SQL, Cosmos DB and DataBricks to meet our growing data demands. As a Data Leader in the Apex organization, you will own, develop, and oversee the data capabilities powering customer-facing applications used by hundredsof thousands of residents. You will play a criticalrole in supporting the data needs of the engineering team as you develop and optimize the backend for customer-facing real estate applications.

What You Will Do :

  • Manage and mentorthe data engineering team, applying your expertise to guide the team through difficult engineering challenges.
  • Hands-on development – Azure SQ, Cosmos DB, DataBricks : developand unit test database code, including but not limited to T-SQL, stored procedures, functions and views.
  • Own the data ingestion &output for our Microsoft CustomerInsights CDP platform
  • Create and maintain databasestructures.
  • Participate in the design of databases, using first, second or third normalized form as needed to support business requirements.
  • Create, deploy,and maintain ADF pipelines, adheringto Greystar’s standards and documented best practices.
  • Monitor databaseperformance, identify bottlenecks and implement improvements to ensure scalable and reliable database operations in a production environment.
  • Perform analysis of complex data and documentfindings.
  • Prepare data for prescriptive and predictive modeling.
  • Combine raw data from different externalsources and build and supportcomplex ingestions
  • Collaborate with application developers / data analysts who will be consuming the data.
  • Play a directrole in the maintenance, technicalsupport, documentation, and administration of databases.
  • Ensure standards are followed by participating in code reviews
  • Be a player-coach and provide hands-onleadership to the team &elevate the team’sefficiency.
  • Provide technical guidance, career development, and mentoring to team members.
  • You are a thoughtleader who will bring up new ideas or methodsand deliver awesome code

Technical Qualifications

  • 10+ years of relevant and progressive data engineering experience, supporting customer-facing products at scale
  • 3+ years of experience in a people leadership / manager role
  • Deep Technicalknowledge and experience in Microsoft Azure architecture, includingAzure PaaS databases, Synapse, ADF pipelines and Synapse stored procedures
  • 4+ Experience with Cosmos DB
  • 3+ Experience working with DataBricks
  • Minimum of 4 years of relevant experience working with Azure Data Factory.
  • Hands-on skills workingwith data pipelinesusing SQL and No-SQL databases
  • Minimum of 3 years of relevant experience working with Azure Data Lakes Gen 2.
  • Experience with Power Platform / Power BI
  • Experience in engineering practicessuch as code refactoring, designpatterns, CI / CD, and highly scalable data applications
  • Experience developing batchETL pipelines; real-time pipelines are a plus
  • Knowledge of advanced data engineering conceptssuch as dimensional modeling, ETL, data governance, data warehousing, structured and unstructured data
  • Understanding / Experience with Python; additional knowledge of parallelprocessing frameworks like MapReduce, Spark, Scala is a plus
  • Technical Pre-screening test and technical interview will be requiredfor all candidates

    Overall Qualifications

  • Expert knowledge of Agile softwaredevelopment process
  • Excellent problem-solving skills and experience
  • Strong communication and collaboration skills
  • "Self-starter" attitudeand the ability to make decisions with minimal guidancefrom others
  • Innovative and passionate about your work and the work of your teammates
  • Ability to comprehend and analyze operational systems and ask appropriate questionsto determine how to improve, migrate or modify the solution to meet business needs
  • Proven trackrecord of developing talent within the organization and fostering high-performance teams.
  • WorkingConditions :

  • Occasional time outsideof core hours depending on priorities and deliverables
  • Some travel(with advance notice)will be requiredfor training, team meetings, or other events.
  • RequiredLicenses or Certifications :

  • Azure & Databricks certifications is a plus
  • Education :

  • Bachelor’s Degreein computer science,information technology, businessmanagement information systems, or equivalent experience. Advanced degree preferred
  • What the Right Candidate will Enjoy!

  • 100% Remote flexibility!
  • Competitive pay, benefits, and overall compensation packages.
  • The chance to be part of a technology team for a thriving organization that prioritizes accountability, respect, and
  • operational excellence!

  • The opportunity to join a thriving, highly visible organization during its technology transformation!
  • Create a job alert for this search

    Senior Data Engineer • amritsar, punjab, in