Skip to content

feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script #4273

Open
mengw15 wants to merge 11 commits intoapache:mainfrom
mengw15:Lakekeeper-bootstrap-script
Open

feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script #4273
mengw15 wants to merge 11 commits intoapache:mainfrom
mengw15:Lakekeeper-bootstrap-script

Conversation

@mengw15
Copy link
Copy Markdown
Contributor

@mengw15 mengw15 commented Mar 9, 2026

What changes were proposed in this PR?

This is PR 2 of a decomposed series from #4242, adding the Lakekeeper bootstrap script for local development setup.

New files:

  • bin/bootstrap-lakekeeper.sh (~525 lines): idempotent script that automates Lakekeeper setup:
    1. Starts Lakekeeper if not already running
    2. Bootstraps the Lakekeeper server (creates default project)
    3. Creates MinIO bucket if needed
    4. Creates the warehouse with S3 storage configuration
  • bin/parse-storage-config.py: HOCON config parser utility used by the bootstrap script to read values from
    storage.conf

Post-merge setup for developers:

  1. Create the Lakekeeper database:
    psql -f sql/texera_lakekeeper.sql
  2. Download the Lakekeeper binary from the Lakekeeper releases page
  3. Edit bin/bootstrap-lakekeeper.sh user configuration section:
  • LAKEKEEPER_BINARY_PATH — path to the downloaded binary
  • LAKEKEEPER__PG_DATABASE_URL_READ/WRITE — PostgreSQL connection URL
    (postgres://user:password@host:5432/texera_lakekeeper)
  1. Run the script:
    ./bin/bootstrap-lakekeeper.sh

Any related issues, documentation, discussions?

Part of #4126. Depends on #4272 (catalog migration).

How was this PR tested?

Manually tested

Was this PR authored or co-authored using generative AI tooling?

Co-authored with Claude Code

@mengw15 mengw15 changed the title feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - bootstrap script Mar 9, 2026
@github-actions github-actions bot added the ddl-change Changes to the TexeraDB DDL label Mar 30, 2026
@mengw15 mengw15 self-assigned this Apr 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build ddl-change Changes to the TexeraDB DDL python

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant