Search posts, tags, users, and pages
Sandeep Pawar
Building Data Analytics and Data Science solutions using Microsoft Fabric | Principal PM, Microsoft Fabric CAT
As you may know, the Lakehouse (Delta Lake) and SQL endpoint are two different engines, and there are differences in the features each engine supports. You can review them here. A common issue I've encountered is writing a Delta table to the Lakehous...
unblgamesg
Nice approach. Comparing the Delta schema against the SQL Endpoint schema early can save a lot of debugging later, especially with unsupported types like arrays and TIMESTAMP_NTZ. Thanks for sharing the utility. town of salem
Josh DeVries
I see a lot of the errors below. How can this be resolved?
DeltaProtocolError: The table's minimum reader version is 2 but deltalake only supports version 1 or 3 with these reader features: {'timestampNtz'}
take a look at my blog : fabric.guru/working-with-delta-tables-in-fabric-p…
It's a rust engine error : github.com/delta-io/delta-rs/issues/2631
If nothing works, use pyspark.
unblgamesg
Nice approach. Comparing the Delta schema against the SQL Endpoint schema early can save a lot of debugging later, especially with unsupported types like arrays and TIMESTAMP_NTZ. Thanks for sharing the utility. town of salem