What’s new in DBR 16.2?

Runtime 16.2 is generally available and brings several enhancements. I will look for some of them and keep this article updated until I have checked them all.

Access for free via a friend’s link

SQL PIPE

For me, the most significant update is one related to SQL Pipe. I deep dive into it in another medium document, which I encourage you to read:

https://databrickster.medium.com/sql-pipe-gives-headaches-but-comes-with-benefits-9b1d2d43673b

New functions for auto-generated columns

With the new auto-generated function, you can define columns that automatically calculate time differences and make time-based adjustments. For example, in a sample table, two timestamps — start_time and end_time — are recorded, and an auto-generated column calculates the difference in minutes between them. Another column automatically adjusts the end_time by adding 10 minutes.

I created a Delta table to show this in action. An entry with a start_time of 8:00 AM and an end_time of 10:30 AM resulted in an auto-calculated time_difference_minutes of 150 minutes and an adjusted_end_time of 10:40 AM.

CREATE OR REPLACE TABLE delta_time_difference_example (
    id BIGINT GENERATED ALWAYS AS IDENTITY,
    start_time TIMESTAMP…