Databricks is now more user-friendly (your new cloud drive)Access for free via a friend’s link1d ago1d ago
TransformWithState is here to clean duplicatestransformWithState is a powerful way to manage custom state in streaming jobs. It was implemented in runtime 16.2 for structured streaming.2d ago2d ago
Notebooks as filesStarting with Databricks Runtime 16.2, notebooks are treated like regular files and the workspace is a regular folder.5d ago5d ago
Federating REST API sourcesSince version 16.2 of DBR, we have another way of connecting to REST API sources. We can define a connection to the HTTP sourFeb 251Feb 251
What’s new in DBR 16.2?Runtime 16.2 is generally available and brings several enhancements. I will look for some of them and keep this article updated until I…Feb 231Feb 231
What’s new in Lakehouse Federation?Every month, we see more updates to Lakehouse Federation; here is a quick overview of the latest changesFeb 19Feb 19
Use All Spark Workers’ CPUs to Read from a REST APIRecently, we explored how to create our own data sources. Now, we’ll examine how to use all worker CPUs to read from a REST API.Feb 9Feb 9
SQL Pipe gives headaches but comes with benefitsDatabricks Runtime 16.2 introduced a new SQL pipeline syntax that reverse the traditional SQL query structure.Feb 6Feb 6
DeepSeek Will Not Succeed, There Will Be Other WinnersDeepseek may be a promising AI platform, but it faces serious obstacles to success.Jan 28Jan 28