Link Search Menu Expand Document

Commands (CLI) Reference

Table of contents

  1. Installing the lakectl command locally
    1. Configuring credentials and API endpoint
    2. lakectl
      1. Synopsis
      2. Options
    3. lakectl abuse
      1. Options
    4. lakectl abuse create-branches
      1. Options
    5. lakectl abuse help
      1. Synopsis
      2. Options
    6. lakectl abuse random-read
      1. Options
    7. lakectl abuse random-write
      1. Options
    8. lakectl actions
      1. Options
    9. lakectl actions help
      1. Synopsis
      2. Options
    10. lakectl actions runs
      1. Options
    11. lakectl actions runs describe
      1. Synopsis
      2. Examples
      3. Options
    12. lakectl actions runs help
      1. Synopsis
      2. Options
    13. lakectl actions runs list
      1. Synopsis
      2. Examples
      3. Options
    14. lakectl actions validate
      1. Synopsis
      2. Examples
      3. Options
    15. lakectl auth
      1. Synopsis
      2. Options
    16. lakectl auth groups
      1. Options
    17. lakectl auth groups create
      1. Options
    18. lakectl auth groups delete
      1. Options
    19. lakectl auth groups help
      1. Synopsis
      2. Options
    20. lakectl auth groups list
      1. Options
    21. lakectl auth groups members
      1. Options
    22. lakectl auth groups members add
      1. Options
    23. lakectl auth groups members help
      1. Synopsis
      2. Options
    24. lakectl auth groups members list
      1. Options
    25. lakectl auth groups members remove
      1. Options
    26. lakectl auth groups policies
      1. Options
    27. lakectl auth groups policies attach
      1. Options
    28. lakectl auth groups policies detach
      1. Options
    29. lakectl auth groups policies help
      1. Synopsis
      2. Options
    30. lakectl auth groups policies list
      1. Options
    31. lakectl auth help
      1. Synopsis
      2. Options
    32. lakectl auth policies
      1. Options
    33. lakectl auth policies create
      1. Options
    34. lakectl auth policies delete
      1. Options
    35. lakectl auth policies help
      1. Synopsis
      2. Options
    36. lakectl auth policies list
      1. Options
    37. lakectl auth policies show
      1. Options
    38. lakectl auth users
      1. Options
    39. lakectl auth users create
      1. Options
    40. lakectl auth users credentials
      1. Options
    41. lakectl auth users credentials create
      1. Options
    42. lakectl auth users credentials delete
      1. Options
    43. lakectl auth users credentials help
      1. Synopsis
      2. Options
    44. lakectl auth users credentials list
      1. Options
    45. lakectl auth users delete
      1. Options
    46. lakectl auth users groups
      1. Options
    47. lakectl auth users groups help
      1. Synopsis
      2. Options
    48. lakectl auth users groups list
      1. Options
    49. lakectl auth users help
      1. Synopsis
      2. Options
    50. lakectl auth users list
      1. Options
    51. lakectl auth users policies
      1. Options
    52. lakectl auth users policies attach
      1. Options
    53. lakectl auth users policies detach
      1. Options
    54. lakectl auth users policies help
      1. Synopsis
      2. Options
    55. lakectl auth users policies list
      1. Options
    56. lakectl branch
      1. Synopsis
      2. Options
    57. lakectl branch create
      1. Options
    58. lakectl branch delete
      1. Options
    59. lakectl branch help
      1. Synopsis
      2. Options
    60. lakectl branch list
      1. Examples
      2. Options
    61. lakectl branch reset
      1. Synopsis
      2. Options
    62. lakectl branch revert
      1. Options
    63. lakectl branch show
      1. Options
    64. lakectl cat-hook-output
      1. Examples
      2. Options
    65. lakectl cat-sst
      1. Options
    66. lakectl commit
      1. Options
    67. lakectl completion
      1. Synopsis
      2. Options
    68. lakectl config
      1. Options
    69. lakectl diff
      1. Synopsis
      2. Options
    70. lakectl docs
      1. Options
    71. lakectl fs
      1. Options
    72. lakectl fs cat
      1. Options
    73. lakectl fs help
      1. Synopsis
      2. Options
    74. lakectl fs ls
      1. Options
    75. lakectl fs rm
      1. Options
    76. lakectl fs stage
      1. Options
    77. lakectl fs stat
      1. Options
    78. lakectl fs upload
      1. Options
    79. lakectl help
      1. Synopsis
      2. Options
    80. lakectl ingest
      1. Options
    81. lakectl log
      1. Options
    82. lakectl merge
      1. Synopsis
      2. Options
    83. lakectl metastore
      1. Options
    84. lakectl metastore copy
      1. Synopsis
      2. Options
    85. lakectl metastore copy-all
      1. Synopsis
      2. Options
    86. lakectl metastore create-symlink
      1. Synopsis
      2. Options
    87. lakectl metastore diff
      1. Options
    88. lakectl metastore help
      1. Synopsis
      2. Options
    89. lakectl refs-dump
      1. Options
    90. lakectl refs-restore
      1. Synopsis
      2. Examples
      3. Options
    91. lakectl repo
      1. Options
    92. lakectl repo create
      1. Options
    93. lakectl repo create-bare
      1. Options
    94. lakectl repo delete
      1. Options
    95. lakectl repo help
      1. Synopsis
      2. Options
    96. lakectl repo list
      1. Options
    97. lakectl show
      1. Options
    98. lakectl tag
      1. Synopsis
      2. Options
    99. lakectl tag create
      1. Options
    100. lakectl tag delete
      1. Options
    101. lakectl tag help
      1. Synopsis
      2. Options
    102. lakectl tag list
      1. Examples
      2. Options
    103. lakectl tag show
      1. Options

Installing the lakectl command locally

lakectl is distributed as a single binary, with no external dependencies - and is available for MacOS, Windows and Linux.

Download lakectl

Configuring credentials and API endpoint

Once you’ve installed the lakectl command, run:

lakectl config
# output:
# Config file /home/janedoe/.lakectl.yaml will be used
# Access key ID: AKIAIOSFODNN7EXAMPLE
# Secret access key: ****************************************
# Server endpoint URL: http://localhost:8000/api/v1

This will setup a $HOME/.lakectl.yaml file with the credentials and API endpoint you’ve supplied. When setting up a new installation and creating initial credentials (see Quick start), the UI will provide a link to download a preconfigured configuration file for you.

lakectl

A cli tool to explore manage and work with lakeFS

Synopsis

lakeFS is data lake management solution, allowing Git-like semantics over common object stores

lakectl is a CLI tool allowing exploration and manipulation of a lakeFS environment

Options

      --base-uri string     base URI used for lakeFS address parse
  -c, --config string       config file (default is $HOME/.lakectl.yaml)
  -h, --help                help for lakectl
      --log-format string   set logging output format
      --log-level string    set logging level (default "none")
      --log-output string   set logging output file
      --no-color            don't use fancy output colors (default when not attached to an interactive terminal)

lakectl abuse

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

abuse a running lakeFS instance. See sub commands for more info.

Options

  -h, --help   help for abuse

lakectl abuse create-branches

Create a lot of branches very quickly.

lakectl abuse create-branches <source ref uri> [flags]

Options

      --amount int             amount of things to do (default 1000000)
      --branch-prefix string   prefix to create branches under (default "abuse-")
      --clean-only             only clean up past runs
  -h, --help                   help for create-branches
      --parallelism int        amount of things to do in parallel (default 100)

lakectl abuse help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type abuse help [path to command] for full details.

lakectl abuse help [command] [flags]

Options

  -h, --help   help for help

lakectl abuse random-read

Read keys from a file and generate random reads from the source ref for those keys.

lakectl abuse random-read <source ref uri> [flags]

Options

      --amount int         amount of reads to do (default 1000000)
      --from-file string   read keys from this file ("-" for stdin)
  -h, --help               help for random-read
      --parallelism int    amount of reads to do in parallel (default 100)

lakectl abuse random-write

Generate random writes to the source branch

lakectl abuse random-write <source branch uri> [flags]

Options

      --amount int        amount of writes to do (default 1000000)
  -h, --help              help for random-write
      --parallelism int   amount of writes to do in parallel (default 100)
      --prefix string     prefix to create paths under (default "abuse/")

lakectl actions

Manage Actions commands

Options

  -h, --help   help for actions

lakectl actions help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type actions help [path to command] for full details.

lakectl actions help [command] [flags]

Options

  -h, --help   help for help

lakectl actions runs

Explore runs information

Options

  -h, --help   help for runs

lakectl actions runs describe

Describe run results

Synopsis

Show information about the run and all the hooks that were executed as part of the run

lakectl actions runs describe [flags]

Examples

lakectl actions runs describe lakefs://<repository> <run_id>

Options

      --after string   show results after this value (used for pagination)
      --amount int     number of results to return. By default, all results are returned.
  -h, --help           help for describe

lakectl actions runs help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type runs help [path to command] for full details.

lakectl actions runs help [command] [flags]

Options

  -h, --help   help for help

lakectl actions runs list

List runs

Synopsis

List all runs on a repository optional filter by branch or commit

lakectl actions runs list [flags]

Examples

lakectl actions runs list lakefs://<repository> [--branch <branch>] [--commit <commit_id>]

Options

      --after string    show results after this value (used for pagination)
      --amount int      number of results to return (default 100)
      --branch string   show results for specific branch
      --commit string   show results for specific commit ID
  -h, --help            help for list

lakectl actions validate

Validate action file

Synopsis

Tries to parse the input action file as lakeFS action file

lakectl actions validate [flags]

Examples

lakectl actions validate <path>

Options

  -h, --help   help for validate

lakectl auth

manage authentication and authorization

Synopsis

manage authentication and authorization including users, groups and policies

Options

  -h, --help   help for auth

lakectl auth groups

manage groups

Options

  -h, --help   help for groups

lakectl auth groups create

create a group

lakectl auth groups create [flags]

Options

  -h, --help        help for create
      --id string   group identifier

lakectl auth groups delete

delete a group

lakectl auth groups delete [flags]

Options

  -h, --help        help for delete
      --id string   group identifier

lakectl auth groups help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type groups help [path to command] for full details.

lakectl auth groups help [command] [flags]

Options

  -h, --help   help for help

lakectl auth groups list

list groups

lakectl auth groups list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list

lakectl auth groups members

manage group user memberships

Options

  -h, --help   help for members

lakectl auth groups members add

add a user to a group

lakectl auth groups members add [flags]

Options

  -h, --help          help for add
      --id string     group identifier
      --user string   user identifier to add to the group

lakectl auth groups members help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type members help [path to command] for full details.

lakectl auth groups members help [command] [flags]

Options

  -h, --help   help for help

lakectl auth groups members list

list users in a group

lakectl auth groups members list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list
      --id string      group identifier

lakectl auth groups members remove

remove a user from a group

lakectl auth groups members remove [flags]

Options

  -h, --help          help for remove
      --id string     group identifier
      --user string   user identifier to add to the group

lakectl auth groups policies

manage group policies

Options

  -h, --help   help for policies

lakectl auth groups policies attach

attach a policy to a group

lakectl auth groups policies attach [flags]

Options

  -h, --help            help for attach
      --id string       user identifier
      --policy string   policy identifier

lakectl auth groups policies detach

detach a policy from a group

lakectl auth groups policies detach [flags]

Options

  -h, --help            help for detach
      --id string       user identifier
      --policy string   policy identifier

lakectl auth groups policies help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type policies help [path to command] for full details.

lakectl auth groups policies help [command] [flags]

Options

  -h, --help   help for help

lakectl auth groups policies list

list policies for the given group

lakectl auth groups policies list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list
      --id string      group identifier

lakectl auth help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type auth help [path to command] for full details.

lakectl auth help [command] [flags]

Options

  -h, --help   help for help

lakectl auth policies

manage policies

Options

  -h, --help   help for policies

lakectl auth policies create

create a policy

lakectl auth policies create [flags]

Options

  -h, --help                        help for create
      --id string                   policy identifier
      --statement-document string   JSON statement document path (or "-" for stdin)

lakectl auth policies delete

delete a policy

lakectl auth policies delete [flags]

Options

  -h, --help        help for delete
      --id string   policy identifier

lakectl auth policies help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type policies help [path to command] for full details.

lakectl auth policies help [command] [flags]

Options

  -h, --help   help for help

lakectl auth policies list

list policies

lakectl auth policies list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list

lakectl auth policies show

show a policy

lakectl auth policies show [flags]

Options

  -h, --help        help for show
      --id string   policy identifier

lakectl auth users

manage users

Options

  -h, --help   help for users

lakectl auth users create

create a user

lakectl auth users create [flags]

Options

  -h, --help        help for create
      --id string   user identifier

lakectl auth users credentials

manage user credentials

Options

  -h, --help   help for credentials

lakectl auth users credentials create

create user credentials

lakectl auth users credentials create [flags]

Options

  -h, --help        help for create
      --id string   user identifier (default: current user)

lakectl auth users credentials delete

delete user credentials

lakectl auth users credentials delete [flags]

Options

      --access-key-id string   access key ID to delete
  -h, --help                   help for delete
      --id string              user identifier (default: current user)

lakectl auth users credentials help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type credentials help [path to command] for full details.

lakectl auth users credentials help [command] [flags]

Options

  -h, --help   help for help

lakectl auth users credentials list

list user credentials

lakectl auth users credentials list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list
      --id string      user identifier (default: current user)

lakectl auth users delete

delete a user

lakectl auth users delete [flags]

Options

  -h, --help        help for delete
      --id string   user identifier

lakectl auth users groups

manage user groups

Options

  -h, --help   help for groups

lakectl auth users groups help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type groups help [path to command] for full details.

lakectl auth users groups help [command] [flags]

Options

  -h, --help   help for help

lakectl auth users groups list

list groups for the given user

lakectl auth users groups list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list
      --id string      user identifier

lakectl auth users help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type users help [path to command] for full details.

lakectl auth users help [command] [flags]

Options

  -h, --help   help for help

lakectl auth users list

list users

lakectl auth users list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
  -h, --help           help for list

lakectl auth users policies

manage user policies

Options

  -h, --help   help for policies

lakectl auth users policies attach

attach a policy to a user

lakectl auth users policies attach [flags]

Options

  -h, --help            help for attach
      --id string       user identifier
      --policy string   policy identifier

lakectl auth users policies detach

detach a policy from a user

lakectl auth users policies detach [flags]

Options

  -h, --help            help for detach
      --id string       user identifier
      --policy string   policy identifier

lakectl auth users policies help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type policies help [path to command] for full details.

lakectl auth users policies help [command] [flags]

Options

  -h, --help   help for help

lakectl auth users policies list

list policies for the given user

lakectl auth users policies list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     how many results to return (default 100)
      --effective      list all distinct policies attached to the user, even through group memberships
  -h, --help           help for list
      --id string      user identifier

lakectl branch

create and manage branches within a repository

Synopsis

Create delete and list branches within a lakeFS repository

Options

  -h, --help   help for branch

lakectl branch create

create a new branch in a repository

lakectl branch create <ref uri> [flags]

Options

  -h, --help            help for create
  -s, --source string   source branch uri

lakectl branch delete

delete a branch in a repository, along with its uncommitted changes (CAREFUL)

lakectl branch delete <branch uri> [flags]

Options

  -h, --help   help for delete
  -y, --yes    Automatically say yes to all confirmations

lakectl branch help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type branch help [path to command] for full details.

lakectl branch help [command] [flags]

Options

  -h, --help   help for help

lakectl branch list

list branches in a repository

lakectl branch list <repository uri> [flags]

Examples

lakectl branch list lakefs://<repository>

Options

      --after string   show results after this value (used for pagination)
      --amount int     number of results to return (default 100)
  -h, --help           help for list

lakectl branch reset

reset changes to specified commit, or reset uncommitted changes - all changes, or by path

Synopsis

reset changes. There are four different ways to reset changes:

  1. reset all uncommitted changes - reset lakefs://myrepo/main
  2. reset uncommitted changes under specific path - reset lakefs://myrepo/main –prefix path
  3. reset uncommitted changes for specific object - reset lakefs://myrepo/main –object path
lakectl branch reset <branch uri> [flags]

Options

  -h, --help            help for reset
      --object string   path to object to be reset
      --prefix string   prefix of the objects to be reset
  -y, --yes             Automatically say yes to all confirmations

lakectl branch revert

given a commit, record a new commit to reverse the effect of this commit

lakectl branch revert <branch uri> <commit ref to revert> [flags]

Options

  -h, --help                help for revert
  -m, --parent-number int   the parent number (starting from 1) of the mainline. The revert will reverse the change relative to the specified parent.
  -y, --yes                 Automatically say yes to all confirmations

lakectl branch show

show branch latest commit reference

lakectl branch show <branch uri> [flags]

Options

  -h, --help   help for show

lakectl cat-hook-output

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

Cat actions hook output

lakectl cat-hook-output [flags]

Examples

lakectl cat-hook-output lakefs://<repository> <run_id> <run_hook_id>

Options

  -h, --help   help for cat-hook-output

lakectl cat-sst

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

Explore lakeFS .sst files

lakectl cat-sst <sst-file> [flags]

Options

      --amount int    how many records to return, or -1 for all records (default -1)
  -f, --file string   path to an sstable file, or "-" for stdin
  -h, --help          help for cat-sst

lakectl commit

commit changes on a given branch

lakectl commit <branch uri> [flags]

Options

  -h, --help             help for commit
  -m, --message string   commit message
      --meta strings     key value pair in the form of key=value

lakectl completion

Generate completion script

Synopsis

To load completions:

Bash:

$ source <(lakectl completion bash)

To load completions for each session, execute once: Linux:

$ lakectl completion bash > /etc/bash_completion.d/lakectl

MacOS:

$ lakectl completion bash > /usr/local/etc/bash_completion.d/lakectl

Zsh:

If shell completion is not already enabled in your environment you will need to enable it. You can execute the following once:

$ echo "autoload -U compinit; compinit" >> ~/.zshrc

To load completions for each session, execute once:

$ lakectl completion zsh > "${fpath[1]}/_lakectl"

You will need to start a new shell for this setup to take effect.

Fish:

$ lakectl completion fish | source

To load completions for each session, execute once:

$ lakectl completion fish > ~/.config/fish/completions/lakectl.fish
lakectl completion <bash|zsh|fish>

Options

  -h, --help   help for completion

lakectl config

create/update local lakeFS configuration

lakectl config [flags]

Options

  -h, --help   help for config

lakectl diff

diff between commits/hashes

Synopsis

see the list of paths added/changed/removed in a branch or between two references (could be either commit hash or branch name)

lakectl diff <ref uri> [other ref uri] [flags]

Options

  -h, --help   help for diff

lakectl docs

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

lakectl docs [outfile] [flags]

Options

  -h, --help   help for docs

lakectl fs

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

view and manipulate objects

Options

  -h, --help   help for fs

lakectl fs cat

dump content of object to stdout

lakectl fs cat <path uri> [flags]

Options

  -d, --direct   read directly from backing store (faster but requires more credentials)
  -h, --help     help for cat

lakectl fs help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type fs help [path to command] for full details.

lakectl fs help [command] [flags]

Options

  -h, --help   help for help

lakectl fs ls

list entries under a given tree

lakectl fs ls <path uri> [flags]

Options

  -h, --help        help for ls
      --recursive   list all objects under the specified prefix

lakectl fs rm

delete object

lakectl fs rm <path uri> [flags]

Options

  -h, --help   help for rm

lakectl fs stage

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

stages a reference to an existing object, to be managed in lakeFS

lakectl fs stage <path uri> [flags]

Options

      --checksum string   Object MD5 checksum as a hexadecimal string
  -h, --help              help for stage
      --location string   fully qualified storage location (i.e. "s3://bucket/path/to/object")
      --meta strings      key value pairs in the form of key=value
      --mtime int         Object modified time (Unix Epoch in seconds). Defaults to current time
      --size int          Object size in bytes

lakectl fs stat

view object metadata

lakectl fs stat <path uri> [flags]

Options

  -h, --help   help for stat

lakectl fs upload

upload a local file to the specified URI

lakectl fs upload <path uri> [flags]

Options

  -d, --direct          write directly to backing store (faster but requires more credentials)
  -h, --help            help for upload
  -r, --recursive       recursively copy all files under local source
  -s, --source string   local file to upload, or "-" for stdin

lakectl help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type lakectl help [path to command] for full details.

lakectl help [command] [flags]

Options

  -h, --help   help for help

lakectl ingest

Ingest objects from an external source into a lakeFS branch (without actually copying them)

lakectl ingest --from <object store URI> --to <lakeFS path URI> [--dry-run] [flags]

Options

  -C, --concurrency int   max concurrent API calls to make to the lakeFS server (default 64)
      --dry-run           only print the paths to be ingested
      --from string       prefix to read from (e.g. "s3://bucket/sub/path/")
  -h, --help              help for ingest
      --to string         lakeFS path to load objects into (e.g. "lakefs://repo/branch/sub/path/")
  -v, --verbose           print stats for each individual object staged

lakectl log

show log of commits for the given branch

lakectl log <branch uri> [flags]

Options

      --after string         show results after this value (used for pagination)
      --amount int           number of results to return. By default, all results are returned.
  -h, --help                 help for log
      --show-meta-range-id   also show meta range ID

lakectl merge

merge

Synopsis

merge & commit changes from source branch into destination branch

lakectl merge <source ref> <destination ref> [flags]

Options

  -h, --help   help for merge

lakectl metastore

manage metastore commands

Options

  -h, --help   help for metastore

lakectl metastore copy

copy or merge table

Synopsis

copy or merge table. the destination table will point to the selected branch

lakectl metastore copy [flags]

Options

      --catalog-id string         Glue catalog ID
      --from-client-type string   metastore type [hive, glue]
      --from-schema string        source schema name
      --from-table string         source table name
  -h, --help                      help for copy
      --metastore-uri string      Hive metastore URI
  -p, --partition strings         partition to copy
      --serde string              serde to set copy to  [default is  to-table]
      --to-branch string          lakeFS branch name
      --to-client-type string     metastore type [hive, glue]
      --to-schema string          destination schema name [default is from-branch]
      --to-table string           destination table name [default is  from-table] 

lakectl metastore copy-all

copy from one metastore to another

Synopsis

copy or merge requested tables between hive metastores. the destination tables will point to the selected branch

lakectl metastore copy-all [flags]

Options

      --branch string              lakeFS branch name
      --continue-on-error string   prevent copy-all from failing when a single table fails
      --from-address string        source metastore address
      --from-client-type string    metastore type [hive, glue]
  -h, --help                       help for copy-all
      --schema-filter string       filter for schemas to copy in metastore pattern (default ".*")
      --table-filter string        filter for tables to copy in metastore pattern (default ".*")
      --to-address string          destination metastore address
      --to-client-type string      metastore type [hive, glue]

create symlink table and data

Synopsis

create table with symlinks, and create the symlinks in s3 in order to access from external services that could only access s3 directly (e.g athena)

lakectl metastore create-symlink [flags]

Options

      --branch string        lakeFS branch name
      --catalog-id string    Glue catalog ID
      --from-schema string   source schema name
      --from-table string    source table name
  -h, --help                 help for create-symlink
      --path string          path to table on lakeFS
      --repo string          lakeFS repository name
      --to-schema string     destination schema name
      --to-table string      destination table name

lakectl metastore diff

show column and partition differences between two tables

lakectl metastore diff [flags]

Options

      --catalog-id string         Glue catalog ID
      --from-address string       source metastore address
      --from-client-type string   metastore type [hive, glue]
      --from-schema string        source schema name
      --from-table string         source table name
  -h, --help                      help for diff
      --metastore-uri string      Hive metastore URI
      --to-address string         destination metastore address
      --to-client-type string     metastore type [hive, glue]
      --to-schema string          destination schema name 
      --to-table string           destination table name [default is from-table]

lakectl metastore help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type metastore help [path to command] for full details.

lakectl metastore help [command] [flags]

Options

  -h, --help   help for help

lakectl refs-dump

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

dumps refs (branches, commits, tags) to the underlying object store

lakectl refs-dump <repository uri> [flags]

Options

  -h, --help   help for refs-dump

lakectl refs-restore

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

restores refs (branches, commits, tags) from the underlying object store to a bare repository

Synopsis

restores refs (branches, commits, tags) from the underlying object store to a bare repository.

This command is expected to run on a bare repository (i.e. one created with ‘lakectl repo create-bare’). Since a bare repo is expected, in case of transient failure, delete the repository and recreate it as bare and retry.

lakectl refs-restore <repository uri> [flags]

Examples

aws s3 cp s3://bucket/_lakefs/refs_manifest.json - | lakectl refs-load lakefs://my-bare-repository --manifest -

Options

  -h, --help                 help for refs-restore
      --manifest refs-dump   path to a refs manifest json file (as generated by refs-dump). Alternatively, use "-" to read from stdin

lakectl repo

manage and explore repos

Options

  -h, --help   help for repo

lakectl repo create

create a new repository

lakectl repo create <repository uri> <storage namespace> [flags]

Options

  -d, --default-branch string   the default branch of this repository (default "main")
  -h, --help                    help for create

lakectl repo create-bare

note: This command is a lakeFS plumbing command. Don’t use it unless you’re really sure you know what you’re doing.

create a new repository with no initial branch or commit

lakectl repo create-bare <repository uri> <storage namespace> [flags]

Options

  -d, --default-branch string   the default branch name of this repository (will not be created) (default "main")
  -h, --help                    help for create-bare

lakectl repo delete

delete existing repository

lakectl repo delete <repository uri> [flags]

Options

  -h, --help   help for delete
  -y, --yes    Automatically say yes to all confirmations

lakectl repo help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type repo help [path to command] for full details.

lakectl repo help [command] [flags]

Options

  -h, --help   help for help

lakectl repo list

list repositories

lakectl repo list [flags]

Options

      --after string   show results after this value (used for pagination)
      --amount int     number of results to return (default 100)
  -h, --help           help for list

lakectl show

See detailed information about an entity by ID (commit, user, etc)

lakectl show <repository uri> [flags]

Options

      --commit string        commit ID to show
  -h, --help                 help for show
      --show-meta-range-id   when showing commits, also show meta range ID

lakectl tag

create and manage tags within a repository

Synopsis

Create delete and list tags within a lakeFS repository

Options

  -h, --help   help for tag

lakectl tag create

create a new tag in a repository

lakectl tag create <tag uri> <commit ref> [flags]

Options

  -f, --force   override the tag if it exists
  -h, --help    help for create

lakectl tag delete

delete a tag from a repository

lakectl tag delete <tag uri> [flags]

Options

  -h, --help   help for delete

lakectl tag help

Help about any command

Synopsis

Help provides help for any command in the application. Simply type tag help [path to command] for full details.

lakectl tag help [command] [flags]

Options

  -h, --help   help for help

lakectl tag list

list tags in a repository

lakectl tag list <repository uri> [flags]

Examples

lakectl tag list lakefs://<repository>

Options

      --after string   show results after this value (used for pagination)
      --amount int     number of results to return (default 100)
  -h, --help           help for list

lakectl tag show

show tag’s commit reference

lakectl tag show <tag uri> [flags]

Options

  -h, --help   help for show