Skip to content

Feedback UI improvements#76

Open
timokau wants to merge 14 commits intostagingfrom
feedback-ui-improvements
Open

Feedback UI improvements#76
timokau wants to merge 14 commits intostagingfrom
feedback-ui-improvements

Conversation

@timokau
Copy link
Collaborator

@timokau timokau commented Nov 22, 2025

Various improvements to the labeling UI. Main changes are event logging (mostly for keeping track of stats during labeling) and multi-rater support.

Overview:

  • We now log rating events which enables stats display
  • We support multiple raters with distinct rater ids
  • Auto-skip already-annotated comparisons; resume sessions at first unannotated item on page reload. Save on Next, even if no trait was marked relevant
  • Small UX changes:
    • Interactive index input for jumping to specific comparisons
    • Scroll-to-top when switching between comparisons
    • Configurable host/port for distributed annotation setups

@timokau timokau force-pushed the feedback-ui-improvements branch from a9adf6e to 437ddda Compare November 22, 2025 19:25
@timokau timokau force-pushed the feedback-ui-improvements branch from 437ddda to 76dc7fe Compare November 22, 2025 19:26
@timokau timokau force-pushed the feedback-ui-improvements branch from 76dc7fe to 73896ac Compare November 22, 2025 19:28
@timokau
Copy link
Collaborator Author

timokau commented Nov 22, 2025

CI failure was unrelated, I have pinned Gradio for now to fix it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant