Ai2

non-profit

Verified

https://allenai.org/

AI & ML interests

Building breatkthrough AI to solve the world's biggest problems.

Recent Activity

brianhenn updated a dataset about 8 hours ago

allenai/aimip-phase1-submissions

faezeb updated a dataset 2 days ago

allenai/fairstress

gabrieltsengai2 updated a dataset 3 days ago

allenai/olmoearth_pretrain_dataset

View all activity

Papers

Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation

Learning to Solve Hard Problems in RL for LLMs by Never Giving Up

View all Papers

Articles

Can we trust LLMs to judge whether a research idea is novel?

LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

OlmoEarth v1.3: State-of-the-art embeddings for the whole planet

FairStress: A deeper evaluation of fairness in LLM decision-making

HiRO-ACEv2: Simulating extreme weather at 3 km resolution for a fraction of the cost

Impactful scheduling for GPU clusters

Open-sourcing AstaBrief, the fast report-generation model in Asta

Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

BenchMIRT: What are LLM benchmarks actually measuring?

Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis

TutorMoments: Do AI tutors know when to help and when to hold back?

The OlmoEarth Platform: Geospatial inference at planetary scale

What building Shippy taught us about building agents

DiScoFormer: One transformer for density and score, across distributions

Which tokens does a hybrid model predict better?

MolmoMotion: Language-guided 3D motion forecasting

olmo-eval: An evaluation workbench for the model development loop

OlmoEarth v1.1: A more efficient family of Earth observation models

EMO: Pretraining mixture of experts for emergent modularity

View all articles

allenai 's Spaces 21

AstaBench Leaderboard

Explore AstaBench benchmark leaderboards

Molmo-Point Demo

MolmoPoint - Image & Video Pointing & Tracking

MolmoPoint-GUI Demo

MolmoPoint - GUI Image Pointing

Reward Bench Leaderboard

Explore RewardBench model rankings and datasets

HREF Leaderboard

Browse and search HREF leaderboard data

Zebra Logic Bench

Display model leaderboard and explore Zebra puzzle samples

SUPER Leaderboard

Display a static leaderboard from a JSON file

ZeroEval Leaderboard

Explore ZeroEval embedding benchmark online

BaseChat by URIAL (Chat with base, untuned LLMs)

Chat with Base and Aligned LLMs via customizable prompts

AI2 WildBench Leaderboard (V2)

Display LLM performance leaderboards with customizable views

URIAL Bench (Eval Base LLMs on MT-Bench)

Show a static leaderboard of LLM benchmark scores

HiRO-ACEv2

3 km climate downscaling with ACE2S + HiROv2

MolmoMotion

Forecast 3D point trajectories from video and language

VFig Image2SVG Demo

VFig converts any diagram image into editable SVG code.

Dataset Stats

Fetch and view stats for MolmoAct2 datasets

Lerobot Visualizer V3

Visualize LeRobot datasets with interactive charts

AI2 - WildDet3D

Scaling Promptable 3D Detection in the Wild

OLMoASR

Open Models and Data for Training Robust Speech Recognition

README

gradio-theme

Display and interact with a customizable Gradio theme demo

AI2 WildBench Leaderboard (V1 legacy)