AI & ML interests

None defined yet.

Recent Activity

JTF2000  updated a Space 6 days ago
TSC-FM/benchmark
JTF2000  updated a Space 6 days ago
TSC-FM/README
JTF2000  published a Space about 2 months ago
TSC-FM/benchmark
View all activity

Organization Card
TSC-FM logo

TSC-FM: Time Series Classification Benchmark and Leaderboard

Time Series Classification Benchmark for Foundation Models

TSC-FM compares foundation models for time series classification across 198 unique datasets: 128 univariate and 70 multivariate. Researchers can use the benchmark to compare pretrained models under Standard and few-shot (Low-shot) settings, inspect the effect of classifier configurations, and read the evaluation protocol behind the rankings.

This Hugging Face organization provides a research overview and a live leaderboard preview. Complete results, model documentation, capability analysis, and model registration are available on the official TSC-FM website.

Start here

Compare time series foundation models on classification tasks

The benchmark evaluates how pretrained models assign class labels to time series. It focuses on classification, rather than ranking forecasting performance. The unit of comparison is a complete model configuration, including its prediction approach and classifier head where applicable.

Research question Resource
How do models compare on univariate and multivariate time series classification? Classification leaderboard, with accuracy, average rank, and dataset coverage
How are few-shot time series classification results evaluated? Evaluation protocol, covering 5-shot and 10-shot label budgets
How do in-context learning and frozen representations differ? Model catalog, with prediction approaches and classifier configurations
What tasks does the benchmark cover? Dataset profile, with aggregate composition and reporting scope
How does performance vary with task attributes? Capability map, with its fixed comparison core and metric definitions

Model documentation and research resources

The catalog includes ChorusTIC, Mantis, MantisV2, MOMENT, NuTime, TabICL, TabICLv2, TIC-FM, TimEE, TiCT, and UniShape. Each method page links to available papers, code, and checkpoints and describes its published evaluation coverage. Catalog membership does not imply complete results for every setting.

In-context configurations use labeled support examples at prediction time without target-specific parameter updates. Frozen-probe configurations keep the pretrained backbone fixed and fit a classifier on its representations. TabICL and TabICLv2 are tabular foundation models applied to vectorized time series.

Evaluation scope and interpretation

Standard uses the full official training split. Few-shot results use five or ten labels per class on the eligible dataset pool for each budget. Those pools differ, so their aggregate means do not isolate the effect of adding labels. Standard and Low-shot are label-budget settings; in-context learning and frozen probes describe prediction approaches, not separate label budgets.

Compare configurations within the same setting and dataset scope, and check accuracy together with average rank and coverage. Dataset-level accuracies receive equal weight. Rankings describe the published task pools and do not establish a universally best model or statistical significance from an aggregate score difference alone. Current scores and versions remain on the official site rather than being copied into this organization card.

Paper and citation

Surveying and Benchmarking Foundation Models for Time Series Classification introduces the benchmark and the accompanying survey. It is a preprint, not a peer-reviewed publication. The paper's analyzed snapshot and the website's current results should be distinguished when citing numerical findings.

中文介绍:时间序列分类基础模型评测

TSC-FM 是面向时间序列分类基础模型的评测基准与排行榜,覆盖单变量和多变量任务,提供标准训练集、少样本分类(5-shot / 10-shot)、上下文学习与冻结特征分类器等设置的结果和解释。研究者可通过排行榜比较成绩,通过评测协议了解比较范围,并在模型目录查看论文、代码和权重来源。不同少样本预算的任务池并不完全相同,使用结果时应同时核对设置与覆盖范围。

Release and maintenance

TSC-FM is jointly released by DMIR Lab and Huawei Noah’s Ark Lab.

Maintained by Juntao Fang. For benchmark questions, contact fangjuntao1@mails.gdut.edu.cn.

models 0

None public yet

datasets 0

None public yet