← project index

ai

Benchmarks and compares language models across providers.

PythonExperimentExperimentalMITRepository ↗

Overview

A Python toolkit for benchmarking and comparing large language models across OpenAI, Anthropic, Google, and NVIDIA. It runs shared tasks against each model and reports latency, success rate, and task difficulty.

Installation

git clone https://github.com/coccinella-labs/ai