Talent.com
This job offer is not available in your country.
Sr. Technical Solutions Engineer (Spark)

Sr. Technical Solutions Engineer (Spark)

DatabricksINDIA
30+ days ago
Job description

Job ID : CSQ126R9

As a Senior Spark Technical Solutions Engineer, you will provide a deep dive technical and consulting related solutions for the challenging Spark / ML / AI / Delta / Streaming / Lakehouse reported issues by our customers and resolve any challenges involving the Databricks unified analytics platform with your highly comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realize value and achieve their strategic objectives using our products.

Outcomes

  • Performing initial level analysis and troubleshooting issues in Spark using Spark UI metrics, DAG, Event Logs for various customer reported job slowness issues.
  • Troubleshoot, resolve and suggest deep code-level analysis of Spark to address customer issues related to Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features.
  • Assist the customers in setting up reproducible spark problems with solutions in the areas of Spark SQL, Delta, Memory Management, Performance tuning, Streaming, Data Science, Data Integration areas in Spark.
  • Contribute in the development of tools / automation initiatives.
  • Participate in the Designated Solutions Engineer program and drive one or two of strategic customers day to day Spark and Cloud issues.
  • Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers.
  • Provide front line support on the third party integrations with Databricks environment.
  • Plan and coordinate with Account Executives, Customer Success Engineers and Resident Solution Architects for coordinating the customer issues and best practices guidelines.
  • Participate in screen sharing meetings, answering slack channel conversations with our internal stakeholders and customers, helping in driving the major spark issues at an individual contributor level.
  • Review the Engineering JIRA tickets and proactively intimate the support leadership team for following up on the action items.
  • Manage the assigned spark cases on a daily basis and adhere to committed SLA's.
  • Build an internal wiki, knowledge base with technical documentation, manuals for the support team and for the customers. Participate in the creation and maintenance of company documentation and knowledge base articles.
  • Achieving above and beyond expectations of the support organization KPIs.
  • Coordinate with Engineering and Backline Support teams to provide assistance in identifying, reporting product defects.
  • Be a true proponent of customer advocacy.
  • Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc.
  • Strengthen your AWS / Azure and Databricks platform expertise through continuous learning and internal training programs.

Competencies

  • 4 years of experience in designing, building, testing, and maintaining Python / Java / Scala based applications in typical project delivery and consulting environments.
  • 2 years of hands-on experience in developing any two or more of the Big Data, Hadoop, Spark, Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Spark experience is mandatory.
  • Hands-on experience in the performance tuning / troubleshooting of Hive and Spark based applications at production scale.
  • Proven and real time experience in JVM and Memory Management techniques such as Garbage collections, Heap / Thread Dump Analysis is preferred.
  • Working knowledge in Data Lakes and preferably on the SCD types use cases at production scale.
  • Working and hands-on experience with any SQL-based databases, Data Warehousing / ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred.
  • Linux / Unix administration skills is a plus.
  • Hands-on experience with AWS or Azure or GCP is preferred.
  • Excellent written and oral communication skills.
  • Demonstrated analytical and problem-solving skills, particularly those that apply to a Distributed Big Data Computing environment.
  • About Databricks

    Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50 PERCENT of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter , LinkedIn , and Facebook .

    Benefits

    At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https : / / www.mybenefitsnow.com / databricks .

    Our Commitment to Diversity and Inclusion

    At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

    Compliance

    If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

    Locations : Bengaluru, India

    Create a job alert for this search

    Sr Technical Engineer • INDIA

    Related jobs
    • Promoted
    Spark Engineer

    Spark Engineer

    Tudip TechnologiesPune
    About Company : Tudip Technologies Pvt.Ltd is a CMMI Level 5 extreme technology company.Careers at Tudip Technologies are not just jobs, but a promi...Show moreLast updated: 30+ days ago
    Sr. Software Engineer

    Sr. Software Engineer

    Epergne SolutionsBengaluru, Karnataka, India
    Quick Apply
    Epergne Solutions is looking for.Relevant and Total years of experience : 8+ years.GCP, Cloud Composer, Big query ,Pyspark, Skava. Hands-on development experience on Google Cloud Platform (GCP), on...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Spark / Scala

    Data Engineer - Spark / Scala

    NPG ConsultantsGurgaon
    Seeking a skilled Data Engineer to drive integration and analytics for digital marketing and web platforms.This role involves working with clickstream data, building customer intelligence, and opti...Show moreLast updated: 30+ days ago
    Sr Data Engineer (Bigdata, Spark + Java / Go)

    Sr Data Engineer (Bigdata, Spark + Java / Go)

    VisaBangalore, Karnataka, India
    Visas Data and AI Platform team is at the forefront of transforming the payment industry by harnessing the power of big data artificial intelligence and cutting-edge open-source technologies.Our mi...Show moreLast updated: 30+ days ago
    Sr. Technical Engineer

    Sr. Technical Engineer

    airlinq technology private limitedINDIA
    This position reports into the Associate Director Delivery at Airlinq and would be responsible for deployment of Airlinq products and services at client site remotely / onsite as per the published s...Show moreLast updated: 30+ days ago
    Sr Solutions Engineer

    Sr Solutions Engineer

    Air ProductsINDIA
    At Air Products, our purpose is to bring people together to reimagine whats possible, collaborate and innovate solutions to the worlds most significant energy and environmental sustainability chall...Show moreLast updated: 30+ days ago
    Sr. Technical Engineer

    Sr. Technical Engineer

    POWER BRIDGE SYSTEMS PRIVATE LIMITEDHyderabad, Telangana, India
    Technical Engineer to become part of our team in the IT Services industry.The ideal candidate will possess at least 2 years of experience in system troubleshooting installation and configuration ne...Show moreLast updated: 30+ days ago
    Technical Sales Engineer – GenAI Solutions

    Technical Sales Engineer – GenAI Solutions

    CcubeIndore, Madhya Pradesh, IN
    Quick Apply
    Job Title : Technical Sales Engineer – GenAI Solutions Location : Indore (Hybrid) Employment Type : Full-Time Company : Ccube – Full-Stack Partner for Apps, Data, and AI About Us Ccube is a...Show moreLast updated: 6 days ago
    Sr Technology Engineer (Big Data + DevOps)

    Sr Technology Engineer (Big Data + DevOps)

    ValueLabsIndia
    Role : Sr Technology Engineer (Big Data + DevOps) Experience : 7+ Years Location : Bangalore-BCT Shift : 10 : 00 AM to 7 : 00 PM. Key Responsibilities : DevOps and CI / CD : Design, implement, and manage CI / C...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer - Scala / Spark

    Data Engineer - Scala / Spark

    Vensure Employer Solutions (PrismHR)Noida
    Position Summary : Do you have a passion for building data architectures that enable smooth and seamless product experiences? Are you an a...Show moreLast updated: 4 days ago
    Sr. Technical Support Engineer (ContactCenter)

    Sr. Technical Support Engineer (ContactCenter)

    Intertec Softwares Pvt LtdMumbai, Maharashtra, India
    RESPONSIBILITIES (INCLUDES ALL TASKS) : .Working with our customers on providing professional services and technical support. .Designing and implementing next-generation VoIP-based call center platfor...Show moreLast updated: 25 days ago
    Sr. Spark Engineer

    Sr. Spark Engineer

    Anicalls (Pty) LtdHyderabad, India
    Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.Proficiency working with large data stores. Test Driven Development (TDD) or Pair Programming.Deep unders...Show moreLast updated: 30+ days ago
    Sr. Technical Solutions Engineer - Grade I

    Sr. Technical Solutions Engineer - Grade I

    CollabNet VersionOneChennai
    A 9-time leader in the Gartner Magic Quadrant for Enterprise Agile Planning.Our platform empowers over 50% of the Fortune 100 and market leaders across industries like financial services, retail, t...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer - Spark

    Data Engineer - Spark

    Coders Brain Technology Private LimitedPan India
    Job Title : Data Engineer (Java + Spark) Experience Level : Location : Pan India <...Show moreLast updated: 28 days ago
    Technical Solutions Engineer

    Technical Solutions Engineer

    BarracudaBangalore , Koramangala
    Job ID 26-160Come join our passionate team! Barracuda is a leading cybersecurity company providing complete protection against complex threats. Our platform protects email, data, applications, and n...Show moreLast updated: 12 days ago
    Sr Technical Support Engineer, Cloud

    Sr Technical Support Engineer, Cloud

    Palo Alto NetworksBengaluru, Karnataka, India
    Prisma Cloud Compute Edition delivers a cloud workload protection platform (CWPP) for modern enterprises providing holistic protection across hosts containers and serverless deployments in any...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer - Spark / Hadoop

    Data Engineer - Spark / Hadoop

    SkyBridge HR SolutionsMumbai
    Job Description : Primarily looking for a Data Engineer (AWS) with expertise in processing data pipelines using Data br...Show moreLast updated: 30+ days ago
    Technical Solutions Engineer

    Technical Solutions Engineer

    Arista NetworksIndia
    Arista Networks pioneered software-driven, cognitive cloud networking for large-scale datacenter and campus environments. Arista's award-winning platforms, ranging in Ethernet speeds from 10 to 400 ...Show moreLast updated: 30+ days ago