Concurrent bootstrapping demo (conventional vs concurrent, side by side) - #8
Open
ryzhyk wants to merge 1 commit into
Open
Concurrent bootstrapping demo (conventional vs concurrent, side by side)#8ryzhyk wants to merge 1 commit into
ryzhyk wants to merge 1 commit into
Conversation
…tstrap demo A self-contained demo of Feldera concurrent bootstrapping. Two identical pipelines (bootstrap-conventional, bootstrap-concurrent) are backfilled with a datagen clickstream and checkpointed, then given the same new analytical views and restarted with concurrent_bootstrap=false vs true. A live datagen stream flows into both throughout, and a Feldera-brand web dashboard makes the contrast obvious: the conventional side freezes (stop-the-world) while the concurrent side keeps ingesting and its existing views stay live, until the new views atomically switch in. - run.py: SDK driver (setup / serve / bootstrap / reset / status / teardown); datagen backfill + checkpoint, then fires both bootstrap modes. Never calls the REST API directly. - dashboard_server.py: SDK-backed poller + static server for the dashboard. - dashboard/index.html: self-contained light Feldera-brand dashboard -- fixed equal columns, live chart panels (orders/revenue/clicks), phase coach-mark callouts, completion banner. - record.py: reproduce the run as a video, headless (Playwright). - README: prerequisites (enterprise Feldera + reliable uv runner), run it, drive a single pipeline by hand (SDK and curl), tune --size, record. - Registered as /run_bootstrap_demo (CLAUDE.md, .claude/commands, agentic runbook).
ryzhyk
force-pushed
the
concurrent-bootstrapping-demo
branch
from
July 30, 2026 23:55
a10f682 to
9e5c3f6
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Concurrent Bootstrapping demo
A self-contained demo of Feldera concurrent bootstrapping, shown side by side against
conventional (stop-the-world) bootstrapping.
Two identical pipelines (
bootstrap-conventional,bootstrap-concurrent) are backfilled with adatagen clickstream and checkpointed, then given the same new analytical views and restarted with
concurrent_bootstrap=falsevstrue. A live datagen stream flows into both throughout, and a lightFeldera-brand dashboard makes the contrast obvious:
finish building, then resumes at once.
in the background, then atomically switch in.
What's in it
run.py— SDK driver:setup(datagen backfill + checkpoint) ·serve·bootstrap·reset·status·teardown. All Feldera interaction goes through the Python SDK.dashboard_server.py— SDK-backed poller + static server for the dashboard.dashboard/index.html— self-contained light Feldera-brand dashboard: fixed equal columns, livechart panels (orders / revenue / clicks), phase coach-mark callouts, "all views are live" banner.
record.py— reproduce the run as a video, headless (Playwright); wide or narrow-column.README.md— prerequisites (enterprise Feldera + a reliable uv runner), run it, drive a singlepipeline by hand (SDK and curl), tuning, recording.
/run_bootstrap_demo(CLAUDE.md,.claude/commands, agentic runbook).Run it
See
concurrent-bootstrapping/README.md: start an enterprise Feldera on:8080, thensetup→serve→bootstrap→ watch →reset.🤖 Generated with Claude Code