This talk is a gentle introduction to the latest and greatest of Delta Lake. You will learn what Delta Lake is and what challenges it aims to solve. You will hear about how Delta Lake builds upon the features of the recent Apache Spark 3 and why it can complement your data processing workloads.
During this talk Jacek is going to touch upon the slogan from the main page of Delta Lake: "Delta Lake is an open source storage layer that brings ACID transactions to Apache Spark™ and big data workloads." You will also learn about time travel and data versioning using Spark tables in Spark SQL and Spark Structured Streaming.