Description
Many organizations are standardizing on the lakehouse, however, this new architecture poses challenges with an underlying query execution engine for accessing structured and unstructured data. The execution engine needs to provide the performance of a data warehouse and the scalability of data lakes. To ensure optimum performance, the Databricks Lakehouse Platform offers Photon. This next-gen vectorized query execution engine outperforms existing data warehouses in SQL workloads and implements a more general execution framework for efficient processing of data with support of the Apache Spark™ API. With Photon, analytical queries are seeing a 3 to 5x speed increase, with a 40% reduction in compute hours for ETL workloads. In this session, we will dive into Photon, describe its integration with the Databricks Platform and Apache Spark™ runtimes, talk through customer use cases, and show how your SQL and DataFrame workloads can benefit from the performance of Photon. Connect with us: Website: https://databricks.com Facebook: https://www.facebook.com/databricksinc Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/data... Instagram: https://www.instagr…
Description from YouTube. Full content on the video page.
Topics
More from Databricks
NewsHow HSS Offloads Provider Administrative Burden with the Databricks Data + AI Platform
NewsHow NOL Universe Scales Global Travel Operations for 1,000+ Users With Databricks
NewsHow adidas Uses Databricks to Build Better Products
Adidas uses Databricks' lakehouse platform to centralize all its data—from product to football-related insights—enabling faster analytics across the organization. The company's Genie analytics tool helps analysts spend less time processing data and more time on strategic questions, ultimately supporting better product development.
NewsDatabricks for Good x MapAid: Creating a Searchable Database for Groundwater Discovery
MapAid is using Databricks to build an AI groundwater mapping system called Well Mapper that processes water documents to identify accurate well-drilling locations in Ethiopia, improving on the current 30% success rate. The system analyzes 400 well logs in half a second instead of four weeks, with potential to double Ethiopia's food supply through improved irrigation.