Browsing:

comet-ml

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

huggingface

Add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations with vLLM/lighteval. Works with the model-index metadata format.

oimiragieo

agent-evaluation is a LLM-as-judge evaluation framework that assesses AI-generated content quality using a weighted composite score and structured verdict with evidence citations.

mshraditya

Evaluation is a process for assessing agent systems, requiring approaches that account for dynamic decision-making and non-deterministic behavior.

langwatch

The platform for LLM evaluations and AI agent testing

affaan-m

deep-research is a skill that utilizes firecrawl and exa MCPs to synthesize findings from multiple sources, delivering comprehensive reports with source attribution.

METR

Running UK AISI's Inspect in the Cloud

huggingface

huggingface-community-evals is a skill for running local evaluations of Hugging Face models using inspect-ai and lighteval.

skysheng7

api-rules is a Python-based skill for evaluating different Large Language Models (LLMs) using the OpenAI API and supporting libraries.

miyataSUPER

Multi-LLM comparison and evaluation framework for coaching scenarios

wiggitywhitney

Research and evaluation framework for AI-powered telemetry instrumentation agents

Sibyl-Research-Team

sibyl-supervisor is a fully autonomous AI research system with self-evolution capabilities, designed to automate AI coding tasks on Claude Code.