Stephen David-Williamsstephendavidwilliams.com·Mar 12, 2023Incremental ingestion with Databricks’ Autoloader via File notificationsWhat is Autoloader? Autoloader (aka Auto Loader) is a mechanism in Databricks that ingests data from a data lake. The power of autoloader is that there is no need to set a trigger for ingesting new data in the data lake - it automatically pulls new f...1 like·1.2K readsDatabricksAdd a thoughtful commentNo comments yetBe the first to start the conversation.