What is OLake Fusion?
OLake Fusion is an innovative self-hosted application aimed at effectively managing Apache Iceberg tables within data lakehouses. This application streamlines the scheduled table compaction process, allowing for the merging of smaller data files and the transformation of delete files to improve table organization as data is continuously added, altered, or removed. Users can customize maintenance schedules for each table, selecting from compaction options categorized as Lite, Medium, or Full, and can also evaluate table health, file metrics, and track maintenance logs through a user-friendly web interface. Furthermore, Fusion boasts seamless integration with various Iceberg catalogs, including AWS Glue, Hive Metastore, JDBC, and REST-based systems like Nessie, Polaris, Unity Catalog, and Lakekeeper, enabling it to manage tables originally created outside the OLake framework. Deployment is versatile, offering options for Docker or Kubernetes, making it adaptable for either cloud infrastructure or on-premises environments. This tool proves especially advantageous for data engineers and platform teams overseeing analytical lakehouses that leverage Apache Iceberg, facilitating efficient data management practices. With its combination of flexibility and robustness, OLake Fusion stands out as a crucial resource for contemporary data management strategies, ultimately driving better performance and organization of data workflows.
Pricing
Integrations
Screenshots and Video
OLake web application Run History page for an Orders_Table_Veridian table, showing run statuses and a Run Metrics side panel.