What is lakeFS?

lakeFS enables you to manage your data lake in a manner akin to source code management, promoting parallel experimentation pipelines alongside continuous integration and deployment for your data workflows. This innovative platform enhances the efficiency of engineers, data scientists, and analysts who are at the forefront of data-driven innovation. As an open-source tool, lakeFS significantly boosts the robustness and organization of data lakes built on object storage systems. With lakeFS, users can carry out dependable, atomic, and version-controlled actions on their data lakes, ranging from complex ETL workflows to sophisticated data science and analytics initiatives. It supports leading cloud storage providers such as AWS S3, Azure Blob Storage, and Google Cloud Storage (GCS), ensuring versatile compatibility. Moreover, lakeFS integrates smoothly with numerous contemporary data frameworks like Spark, Hive, AWS Athena, and Presto, facilitated by its API that aligns with S3. The platform's Git-like framework for branching and committing allows it to scale efficiently, accommodating vast amounts of data while utilizing the storage potential of S3, GCS, or Azure Blob. Additionally, lakeFS enhances team collaboration by enabling multiple users to simultaneously access and manipulate the same dataset without risk of conflict, thereby positioning itself as an essential resource for organizations that prioritize data-driven decision-making. This collaborative feature not only increases productivity but also fosters a culture of innovation within teams.

Integrations

Offers API?:
Yes, lakeFS provides an API

Screenshots and Video

lakeFS Screenshot 1

Company Facts

Company Name:
Treeverse
Date Founded:
2020
Company Location:
Israel
Company Website:
lakefs.io

Product Details

Deployment
SaaS
Training Options
Documentation Hub
Webinars
Support
Web-Based Support

Product Details

Target Company Sizes
Individual
1-10
11-50
51-200
201-500
501-1000
1001-5000
5001-10000
10001+
Target Organization Types
Mid Size Business
Small Business
Enterprise
Freelance
Nonprofit
Government
Startup
Supported Languages
English

lakeFS Categories and Features

Data Management Software

Customer Data
Data Analysis
Data Capture
Data Integration
Data Migration
Data Quality Control
Data Security
Information Governance
Master Data Management
Match & Merge