Skip to content

Comments

[arteval-bench] Add EET (OSDI'24) artifact#137

Open
bastoica wants to merge 15 commits intosys-intelligence:mainfrom
bastoica:feat_eet
Open

[arteval-bench] Add EET (OSDI'24) artifact#137
bastoica wants to merge 15 commits intosys-intelligence:mainfrom
bastoica:feat_eet

Conversation

@bastoica
Copy link
Collaborator

Description

This PR adds EET (OSDI'24) to ArtEvalBench.

Changes

  • Added EET (OSDI'25)
  • Updated benchmark JSONL schema

Testing

Tested manually by downloading, installing, and running EET, along with their corresponding agent oracles.

Checklist

  • Tests pass locally
  • Code follows project style guidelines

@bastoica bastoica self-assigned this Feb 23, 2026
@bastoica bastoica added the enhancement New feature or request label Feb 23, 2026
@bastoica bastoica linked an issue Feb 23, 2026 that may be closed by this pull request
@bastoica bastoica requested review from Couen and xuafeng February 23, 2026 05:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[arteval-bench] Add EET (OSDI'24) artifact

1 participant