Skip to content

Add AIDetector.review submission#88

Merged
liamdugan merged 2 commits intoliamdugan:mainfrom
northwreck:AIDetector.review
Feb 25, 2026
Merged

Add AIDetector.review submission#88
liamdugan merged 2 commits intoliamdugan:mainfrom
northwreck:AIDetector.review

Conversation

@northwreck
Copy link
Contributor

@northwreck northwreck commented Feb 22, 2026

Submission: AIDetector.review

A neural network classifier that analyzes text patterns to return the probability that a given passage was AI-generated versus human-written.

DeBERTa-v3-base fine-tuned classifier for AI text detection.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@github-actions
Copy link

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

AIDetector.review

Release date: 2026-02-21

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 88.15 and a TPR of 81.08% at FPR=5% and 66.51% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 93.66 and a TPR of 90.60% at FPR=5% and 78.23% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan
Copy link
Owner

@northwreck Congrats on the strong performance. Let me know if you'd like me to merge your submission!

@northwreck
Copy link
Contributor Author

northwreck commented Feb 25, 2026 via email

@liamdugan liamdugan merged commit 4e8b0b5 into liamdugan:main Feb 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants