Auto Loader
Recent items mentioning Auto Loader across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.
Recent community discussions highlight common challenges with Databricks Auto Loader, particularly around data quality and error handling. Users are seeking solutions for duplicate tracking 1, addressing PARQUET_COLUMN_DATA_TYPE_MISMATCH errors 2, and establishing best practices for logging UNKNOWN_FIELD_EXCEPTION 3.
Generated daily from the 3 most recent items mentioning Auto Loader. Click any [N] to jump to the source.
Auto Loader duplicate tracking
Autoloader [FAILED_READ_FILE.PARQUET_COLUMN_DATA_TYPE_MISMATCH]
Best practice to log Autoloader UNKNOWN_FIELD_EXCEPTION
Auto Loader on UC Volumes stopped resolving wildcards
NewsDatabricks News: Catalog and External locations in DABS, Schema Evolution, File Events, Queries Tags
Databricks Runtime 18.1 introduces schema evolution for inserts, managed file events for Autoloader, and a simplified `TABLE` syntax for querying. The video also demonstrates new features like the AI Gateway for LLM governance, query tags for tracking, and the GA release of the supervisor agent.
NewsDatabricks Breaking News: Week 50: 8 December 2025 to 14 December 2025 #databricks news
Databricks now supports native reading and writing of Excel files in PySpark, SQL, and Autoloader, including features like sheet listing and range targeting. Additionally, Databricks Runtime 18 is available in beta, introducing improvements for streaming queries and new system columns for job tables, alongside a new Legase experience with project and branching capabilities for transactional databases.
NewsFrom Days to Seconds — Reducing Query Times on Large Geospatial Datasets by 99%
NewsLakeflow Connect: Smarter, Simpler File Ingestion With the Next Generation of Auto Loader
Tutorials126. Databricks | Pyspark | Downloading Files from Databricks DBFS Location
News125. Databricks | Pyspark| Delta Live Table: Data Quality Check - Expect
Tutorials124. Databricks | Pyspark| Delta Live Table: Datasets - Tables and Views
Tutorials
