Databricks As Code:Effectively Automate a Secure Lakehouse Using Terraform for Resource Provisioning

Description

At Rivian, we have automated more than 95% of our Databricks resource provisioning workflows using an in-house Terraform module, affording us a lean admin team to manage over 750 users. In this session, we will cover the following elements of our approach and how others can benefit from improved team efficiency. - User and service principal management - Our permission model on Unity Catalog for data governance - Workspace and secrets resource management - Managing internal package dependencies using init scripts - Facilitating dashboards, SQL queries and their associated permissions - Scaling source of truth Petabyte scale Delta Lake table ingestion jobs and workflows Talk by: Jason Shiverick and Vadivel Selvaraj Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc Facebook: https://www.facebook.com/databricksinc

Description from YouTube. Full content on the video page.