Talent.com
This job offer is not available in your country.
Principal Data Engineer

Principal Data Engineer

autodesk india pvt ltdINDIA
30+ days ago
Job description

Job Requisition ID

25WD87929

Position Overview

Autodesk is looking for diverse engineering candidates to join Product Access and Compliance team, a collection of systems and teams focused on detecting and exposing non-compliant users of Autodesk software. This is a key strategic initiative for the company. As a Principal Data Engineer, you will be responsible for developing best practices and making architectural decisions to rapidly improve critical data processing & analytics pipelines. You will tackle hard problems to improve the platforms reliability, resiliency, and scalability.

We are looking for someone who thrives on autonomy and has experience driving long-term projects to completion. You are detail and quality oriented, and excited about the prospects of having a big impact with data at Autodesk. Our tech stack includes Airflow, Hive, EMR, PySpark, Presto, Jenkins, Snowflake, Datadog and various AWS services. You'll report to Sr. Manager, Software Development and this is a hybrid position in Bengaluru.

Responsibilities

  • Modernizing and expanding a critical set of existing systems
  • Understand business requirements and architect systems that will scale and extend to accommodate those needs
  • Break down complex problems, document technical solutions and sequence work to make fast, iterative improvements
  • Build and scale data infrastructure that powers batch and real-time data processing of billions of records
  • Develop CI / CD ETL pipelines using Jenkins for deployment and automation testing
  • Take ownership of ETL pipelines, own data quality for your areas, and ensure SLAs are met
  • Interface with data engineers, data scientists, product managers and all data stakeholders to understand their needs and promote best practices
  • Lead the design and implementation of complex data processing systems, ensuring they meet business requirements and performance standards
  • Manage and coordinate the efforts of a team of data engineers, ensuring alignment with project goals and timelines
  • Provide technical guidance and mentorship to junior engineers, fostering a culture of continuous learning and improvement

Minimum Qualifications

  • Bachelors degree with 9 years of relevant industry experience in big data systems, data processing and SQL data warehouses
  • At least 5 years of experience on working with large Hadoop projects and building scalable applications using PySpark by leveraging Spark DataFrame and Spark SQL api
  • At least 2 years of experience in optimizing Spark applications, spark memory management, and e2e spark process optimization
  • Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL
  • Fundamental knowledge of distributed data processing systems, storage mechanisms, and compression techniques.
  • Experience building code-driven infrastructure on public cloud platforms, preferably AWS
  • Understanding of SQL, dimensional modeling, and analytical data warehouses, like Snowflake, Redshift
  • Knowledge of Data Modeling techniques and high volume ETL / ELT design
  • Familiar with workflow management tools, like Airflow and Oozie
  • Experience with CI and code management tools like Git, Jenkins
  • Familiar with BI tools, like Power BI, Looker, Qlikview
  • LI-CL1

    Learn More About Autodesk

    Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

    We take great pride in our culture here at Autodesk our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

    When youre an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

    Salary transparency

    Salary is one part of Autodesks competitive compensation package. Offers are based on the candidates experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

    Diversity & Belonging

    We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here : Diversity and Belonging

    Are you an existing contractor or consultant with Autodesk?

    Please search for open jobs and apply internally (not on this external site).

    Locations

  • Bengaluru, IND
  • Create a job alert for this search

    Principal Engineer • INDIA

    Related jobs
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    KYFEXTiruppur, IN
    KYFEX is a leading AI consulting firm, dedicated to harnessing the power of artificial intelligence to revolutionize business operations across the globe. Our expertise in Large Language Models (LLM...Show moreLast updated: 2 days ago
    Principal Data Engineer

    Principal Data Engineer

    AMGENINDIA
    Join Amgens Mission of Serving Patients.At Amgen, if you feel like youre part of something bigger, its because you are.Our shared missionto serve patients living with serious illnessesdrives all th...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    AutodeskBengaluru, IND
    Autodesk is looking for diverse engineering candidates to join Product Access and Compliance team, a collection of systems and teams focused on detecting and exposing non-compliant users of Autodes...Show moreLast updated: 18 days ago
    Principal Data Engineer

    Principal Data Engineer

    Monotype DACHNoida
    Named "One of the Most Innovative Companies in Design" by Fast Company, Monotype brings brands to life through type and technology that consumers engage with every day. The company's rich legacy inc...Show moreLast updated: 2 days ago
    Principal Data Engineer

    Principal Data Engineer

    Brightly Software India Private LimitedNoida, Uttar Pradesh, India
    Build a brighter future while learning and growing with a Siemens company at the intersection of technology, community and sustainability. Our global team of innovators is always looking to create m...Show moreLast updated: 13 days ago
    Staff / Principal Data Engineer

    Staff / Principal Data Engineer

    Credit Saison IndiaIndia
    Established in 2019, CS India is one of the country’s fastest growing Non-Bank Financial Company (NBFC) lenders, with verticals in wholesale, direct lending and tech-enabled partnerships with Non-B...Show moreLast updated: 17 days ago
    Principal Data Engineer

    Principal Data Engineer

    451 Discovery Comm. IndiaEast Wing,Block A,Office Level & ,Hyderabad
    When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic ...Show moreLast updated: 13 days ago
    Principal Data Engineer

    Principal Data Engineer

    BOSTON SCIENTIFICINDIA
    Diversity - Innovation - Caring - Global Collaboration - Winning Spirit - High Performance.At Boston Scientific, well give you the opportunity to harness all thats within you by working in teams of...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    TakedaIND, Bengaluru
    At Takeda, we are leading digital evolution and global transformation.By building innovative solutions and future-ready capabilities, we are meeting the need of patients, our people, and the planet...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    McCormick & CompanyGurugram, Haryana, India
    The Principal Data Engineer will lead the data engineering team, help formulate the organizational data strategy, and work with the cloud analytics platform owners and business stakeholders to ensu...Show moreLast updated: 11 days ago
    Principal Data Engineer

    Principal Data Engineer

    Wiser SolutionsVadodara, Gujarat, India
    When looking to buy a product whether it is in a brick and mortar store or online it can be hard enough to find one that not only has the characteristics you are looking for but is also at a price ...Show moreLast updated: 30+ days ago
    • New!
    Principal data engineer

    Principal data engineer

    BP EnergyPune, MH, India
    Technology .IT&S Group .Strategic technology leaders across both the Mobility and Convenience Technology organization, the Data Office & regional...Show moreLast updated: 5 hours ago
    Principal Data Engineer

    Principal Data Engineer

    MEDTRONICINDIA
    At Medtronic you can begin a life-long career of exploration and innovation, while helping champion healthcare access and equity for all. Youll lead with purpose, breaking down barriers to innovatio...Show moreLast updated: 30+ days ago
    Principal Data Engineer

    Principal Data Engineer

    TechfullyIndia
    Principal Data Engineer _ Hyderabad (Onsite).Principal Data Engineer Work Location.Strong expertise in SQL, Python or Scala, and modern ETL / ELT frameworks. Deep knowledge of data warehousing solutio...Show moreLast updated: 2 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Stealth StartupPune, Maharashtra, India
    Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query...Show moreLast updated: 2 days ago
    Principal Data Engineer

    Principal Data Engineer

    MakeMyTripBengaluru, Karnataka, India
    Must have 8+ years of experience.We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer exp...Show moreLast updated: 14 days ago
    Principal Data Engineer

    Principal Data Engineer

    ScaleneWorksBengaluru, Karnataka, India
    Quick Apply
    Being aware of departmental guidance on best practices, processes, templates, clauses and playbooks.Show moreLast updated: 30+ days ago
    Principal Snowflake Data Engineer

    Principal Snowflake Data Engineer

    Health CatalystIndia
    About Company : The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space.We ...Show moreLast updated: 2 days ago