ReAlign: Refining prototypes and aligning queries for few-shot action recognition
DOI:
CSTR:
Author:
Affiliation:

Zhejiang University of Technology

Clc Number:

Fund Project:

National Key Research and Development Program of China(2023YFC3604200-project2023YFC3604204)

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Few-shot action recognition classifies human actions in videos from very few labelled samples. Temporal redundancy and background ambiguity misalign visual features with action semantics, so plain video-text similarity is insufficient. We propose ReAlign, which injects semantics and aligns features adaptively. A cross-modal prototype refinement (CMPR) module uses fine-grained text as a prior to focus support prototypes on action-relevant patterns while suppressing background noise. A text-adaptive query alignment (TAQA) strategy then calibrates query representations against the holistic textual space, reconstructing features by semantic affinity to maximize category discriminability. On five public benchmarks ReAlign outperforms state-of-the-art methods in both 1-shot and 5-shot settings.

    Reference
    Related
    Cited by
Get Citation
Related Videos

Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:September 10,2026
  • Revised:September 22,2026
  • Adopted:September 23,2026
  • Online:
  • Published:
Article QR Code