Understanding lakeFS

Architecture and Internals

The Architecture page includes a logical overview of lakeFS and its components.

For deep-dive content about lakeFS see:

• Internal database structure
• Merges in lakeFS
• Versioning Internals

lakeFS Use Cases

lakeFS has many uses in the data world, including

• CI/CD for Data Lakes
• ETL Testing Environment
• Reproducibility
• Rollback

One of the important things that lakeFS provides is full support for Data Lifecycle Management through all stages:

• In Test
• During Deployment
• In Production

lakeFS Concepts and Model

lakeFS adopts many of the terms and concepts from git. This page goes into details on the similarities and differences, and provides a good background to the concepts used in lakeFS.

Performance

Check out the Performance best practices guide for useful hints and tips on ensuring high performance from lakeFS.

FAQ and Glossary

The FAQ covers many common questions around lakeFS, and the glossary provides a useful reference for the terms used in lakeFS.