delta table

A great video: Making Apache Spark™ Better with Delta Lake

The databricks delta table is the default option when creating a table.

When create a new table from parquet file, it is by default a delta table. Use 'describe table extended table_name' to check the provider.

Databricks use the Delta format provided by Azure to stream data incrementally. The Structured Streaming is actually the Auto Loader provided by Azure as well.

https://databricks.com/notebooks/iiot/iiot-end-to-end-part-1.html

If your source files are in Parquet format, you can use the CONVERT TO DELTA statement to convert files in place to create an unmanaged table:

CONVERT TO DELTA parquet.`/tmp/delta/people-10m`