Secure Learning Lab

university

https://aisecure.github.io/

uiuc_aisecure

ai-secure

Activity Feed Request to join this org

AI & ML interests

Trustworthy Machine Learning

Recent Activity

yuzhounie updated a dataset 5 days ago

AI-Secure/decodingtrust-windows-qcow2

clefourrier authored a paper 23 days ago

Strategic Navigation or Stochastic Search? How Agents and Humans Reason Over Document Collections

yuzhounie authored a paper 4 months ago

VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection

View all activity

yuzhounie

updated a dataset 5 days ago

AI-Secure/decodingtrust-windows-qcow2

Updated 5 days ago • 29

clefourrier

authored a paper 23 days ago

Strategic Navigation or Stochastic Search? How Agents and Humans Reason Over Document Collections

Paper • 2603.12180 • Published 24 days ago • 64

yuzhounie

authored a paper 4 months ago

VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection

Paper • 2512.07533 • Published Dec 8, 2025 • 4

yuzhounie

authored 4 papers 6 months ago

SecCodePLT: A Unified Platform for Evaluating the Security of Code GenAI

Paper • 2410.11096 • Published Oct 14, 2024 • 13

Humanity's Last Exam

Paper • 2501.14249 • Published Jan 24, 2025 • 77

OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation

Paper • 2505.23885 • Published May 29, 2025 • 1

AgentVigil: Generic Black-Box Red-teaming for Indirect Prompt Injection against LLM Agents

Paper • 2505.05849 • Published May 9, 2025

javyduck

updated a dataset 11 months ago

Virtue-AI-HUB/PolyGuard

Viewer • Updated May 23, 2025 • 137k • 295 • 8

clefourrier

posted an update 11 months ago

Post

2490

Always surprised that so few people actually read the FineTasks blog, on
✨how to select training evals with the highest signal✨

If you're serious about training models without wasting compute on shitty runs, you absolutely should read it!!

An high signal eval actually tells you precisely, during training, how wel & what your model is learning, allowing you to discard the bad runs/bad samplings/...!

The blog covers in depth prompt choice, metrics, dataset, across languages/capabilities, and my fave section is "which properties should evals have"👌
(to know on your use case how to select the best evals for you)

Blog: HuggingFaceFW/blogpost-fine-tasks