OpenAutoLoader
Databricks Auto Loader, but open-source and Spark-free.
What is OpenAutoLoader?
OpenAutoLoader is a high-performance, incremental ingestion engine built on Polars. It tracks processed files, handles schema drift with Rescue Mode, and sinks data to Delta Lake with full ACID guarantees. No Spark, no JVM, just fast Python.
Screenshots
?
No comments yet. Be the first!
Real conversations about OpenAutoLoader on X
Post on X