lakeFS Enterprise Features¶
What is lakeFS Enterprise?¶
lakeFS Enterprise is a commercially-supported version of lakeFS, offering additional features and functionalities that meet the needs of organizations from a production-grade system.
Why did we build lakeFS Enterprise?¶
lakeFS Enterprise was built for organizations that require the support, security standards and features required of a production-grade system.
What is the value of using lakeFS Enterprise?¶
- Support: the lakeFS team is committed to supporting you under an SLA for both issues and product enhancements.
- Security: Full support for a suite of security features and additional lakeFS functionality.
- Advanced Functionality for AI, ML and Data engineering use cases. See Features below.
What security features does lakeFS Enterprise provide?¶
With lakeFS Enterprise you’ll receive access to the security package containing the following features:
- A rich Role-Based Access Control permission system that allows for fine-grained control by associating permissions with users and groups, granting them specific actions on specific resources. This ensures data security and compliance within an organization.
- To easily manage users and groups, lakeFS Enterprise provides SSO integration (including support for SAML, OIDC, ADFS, Okta, and Azure AD), supporting existing credentials from a trusted provider, eliminating separate logins.
- lakeFS Enterprise supports SCIM for automatically provisioning and de-provisioning users and group memberships, allowing organizations to maintain a single source of truth for their user database.
- STS Auth offers temporary, secure logins using an Identity Provider, simplifying user access and enhancing security.
- Authentication with AWS IAM Roles allows authentication using AWS IAM roles instead of lakeFS credentials, removing the need to maintain static credentials for lakeFS Enterprise users running on AWS.
- Auditing provides a detailed action log of events happening within lakeFS, including who performed which action, on which resource - and when.
What additional functionality does lakeFS Enterprise provide?¶
- lakeFS Mount - allows users to virtually mount a remote lakeFS repository onto a local directory. Once mounted, users can access the data as if it resides on their local filesystem, using any tool, library, or framework that reads from a local filesystem.
- lakeFS Metadata Search - Allows a granular search API to filter and query versioned objects based on attached metadata. This is especially useful for machine learning environments to filter by labels and file attributes
- Iceberg REST Catalog - Provides full support for managing Iceberg tables alongside other data formats in the same lakeFS repository. Built using open standards and works with any Iceberg client.
- lakeFS for Snowflake - Provides full integration into the Snowflake ecosystem, including full support for Iceberg managed tables.
- Transactional Mirroring - allows replicating lakeFS repositories into consistent read-only copies in remote locations.
- Multiple Storage Backends - allows managing data stored across multiple storage locations: on-prem, hybrid, or multi-cloud.
| Feature | OSS | Enterprise |
|---|---|---|
| Format-agnostic data version control | ✅ | ✅ |
| Cloud-agnostic | ✅ | ✅ |
| Zero Clone copy for isolated environment | ✅ | ✅ |
| Atomic Data Promotion (via merges) | ✅ | ✅ |
| Data stays in one place | ✅ | ✅ |
| Configurable Garbage Collection | ✅ | ✅ |
| Data CI/CD using lakeFS hooks | ✅ | ✅ |
| Integrates with your data stack | ✅ | ✅ |
| Role Based Access Control (RBAC) | ✅ | |
| Single Sign On (SSO) | ✅ | |
| SCIM Support | ✅ | |
| IAM Roles | ✅ (AWS) | |
| Mount Capability | ✅ | |
| Iceberg REST Catalog | ✅ | |
| Audit Logs | ✅ | |
| Transactional Mirroring (cross-region) | ✅ | |
| Support SLA | ✅ |
Tip
You can learn more about the lakeFS Enterprise architecture, or follow the examples in the Quickstart guide.