TAU-R1
Collection
Dataset and Model for TAU-R1 β’ 3 items β’ Updated
How to use yl4300/TAU-R1-Classifier with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM
processor = AutoProcessor.from_pretrained("yl4300/TAU-R1-Classifier")
model = AutoModelForMultimodalLM.from_pretrained("yl4300/TAU-R1-Classifier", device_map="auto")This repository contains the model presented in TAU-R1: Visual Language Model for Traffic Anomaly Understanding.
TAU-R1 is a two-layer vision-language framework for Traffic Anomaly Understanding (TAU). The first layer is a lightweight anomaly classifier that performs coarse anomaly categorisation, while the second layer is a larger anomaly reasoner that generates detailed event summaries. It is trained with a two-stage strategy consisting of decomposed-QA-enhanced supervised fine-tuning followed by TAU-GRPO, a GRPO-based post-training method with TAU-specific reward functions.