Planning and Executing a Snowflake Data Warehouse Migration to Databricks
Description
Organizations are going through a critical phase of data infrastructure modernization, laying the foundation for the future, and adapting to support growing data and AI needs. Organizations that embraced cloud data warehouses (CDW) such as Snowflake have ended up trying to use a data warehousing tool for ETL pipelines and data science. This created unnecessary complexity and resulted in poor performance since data warehouses are optimized for SQL-based analytics only. Realizing the limitation and pain with cloud data warehouses, organizations are turning to a lakehouse-first architecture. Though a cloud platform to cloud platform migration should be relatively easy, the breadth of the Databricks platform provides flexibility and hence requires careful planning and execution. In this session, we present the migration methodology, technical approaches, automation tools, product/feature mapping, a technical demo and best practices using real-world case studies for migrating data, ELT pipelines and warehouses from Snowflake to Databricks. Talk by: Satish Garla and Ramachandran Venkat Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: h…
Description from YouTube. Full content on the video page.
More from Databricks
NewsHow Jio Platforms move insights into production with Databricks | Data + AI Executive Series: Fast 5
Jio Platforms relies on Databricks Lakehouse to unify data and AI governance and achieve end to end lineage across its businesses including telecom, retail, media, and finance. The company uses Databricks Genie and Lakehouse to accelerate insights to production and allow business users to define their own KPIs and metrics.
TutorialsMigrate Databricks classic workloads to serverless with Genie Migrate | Databricks Demo
Genie Migrate is a Databricks tool designed to help users migrate workloads, including notebooks and jobs, from classic clusters to serverless. The tool automatically analyzes code and cluster infrastructure, identifies compatibility issues, and provides suggestions or applies fixes to facilitate the transition to serverless environments.
ReleasesMulti-Statement Transactions in Unity Catalog: Atomic Writes on Delta and Iceberg
Multi statement transactions in Unity Catalog allow atomic writes across multiple Delta or Iceberg tables, ensuring that updates either succeed completely or are aborted together. This capability eliminates the need for complex reconciliation logic, separate governance models, or data copying between systems.
ReleasesAutomate Data Warehouse Migration with AI - Genie Migrate for Lakehouse Intro
Genie Migrate for Lakehouse is an AI-powered migration solution that automates the movement of data and code from legacy data warehouses to the Databricks Lakehouse. It converts SQL from seven major data warehouses into open ANSI SQL and PySpark, reducing delivery timelines and ensuring high conversion accuracy.
TutorialsHow To Schedule Data Refresh in Excel | Databricks Add-in Demo
The Databricks Excel add-in allows users to connect Databricks workspaces to Excel spreadsheets, enabling data imports. Users can create scheduled refreshes to automatically update their spreadsheets with the latest data from their lakehouse.
