Reviso: Not All Visual Evidence Deserves Equal Attention in Video Captioning

Paper | Code

Overview of Reviso: CFP observation planning, tool-assisted captioning, supervised fine-tuning, and GRPO.

Reviso is an agentic video captioning model that learns what matters in each video and actively gathers evidence to describe it. From a global preview, it builds a hierarchical Contextโ€“Focusโ€“Points (CFP) observation plan, then uses temporal revisiting, image cropping, and OCR to inspect important details. Across multiple rounds, it updates its understanding and plan before generating the final caption.

This release contains the Checkpoint: full model weights in FP32, stored in nine safetensors shards (approximately 37.64 GB), together with the tokenizer and processor.(Base model :Qwen 3.5 9B)

Installation

Use Python 3.12. The PyTorch command below uses CUDA 12.6; select another compatible build from the PyTorch installation instructions if needed.

pip install torch==2.10.0 torchvision==0.25.0 --index-url https://download.pytorch.org/whl/cu126
pip install "transformers==5.10.4" "accelerate>=1.9,<2" safetensors pillow huggingface_hub

Instructions

Load the complete checkpoint directory with Transformers:

import torch
from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration

model_path = "./Reviso"  # Use "." when running inside this checkpoint directory.

processor = AutoProcessor.from_pretrained(model_path)
model = Qwen3_5ForConditionalGeneration.from_pretrained(
    model_path,
    dtype=torch.bfloat16,
    device_map="auto",
).eval()

The example loads the FP32 weights in BF16 on compatible hardware. project repository.

Downloads last month
29
Safetensors
Model size
9B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for TengfeiLiuCoder/Reviso

Finetuned
Qwen/Qwen3.5-9B
Finetuned
(1,267)
this model

Paper for TengfeiLiuCoder/Reviso