Vivaria is METR's tool for running evaluations and conducting agent elicitation research.

Better 'AskUserQuestion' - A lightweight MCP server/OpenCode plugin/Agent Skills + CLI tool that allows your LLMs ask questions to you. Be the human in the human-in-the-loop!

[AISTATS2021] Official implementation of "Sample Elicitation"

Running UK AISI's Inspect in the Cloud

MCP as a Judge is a behavioral MCP that strengthens AI coding assistants by requiring explicit LLM evaluations

Security Expert Elicitation of Risks

A modern CLI tool for generating production-ready Model Context Protocol (MCP) servers

Methods for mathematically aggregating expert judgements

elicitr is an R package, used to aggregate elicitation data. The package is in active development and implements functions based on two formal elicitation methods. You provide the data, and elicitr transforms them into easily readable graphics.

UMLet ISTAR-palette for goal oriented requirements engineering (GORE)

This is a minimal Model Context Protocol (MCP) server that showcases how to build MCP tools with elicitation capabilities

TasteRay skills for psychological profiling through natural conversation

Shiny app visualiser of four point elicitation data

tPRiors: Bayesian prevalence estimation

MCP server for conversational meal planning with OAuth 2.1 auth, multi-step elicitation, LLM sampling, and background tasks. Built with FastMCP, deployed to GKE.