OpenBot
Platform
VLAOpenReadiness 76/100Useful

Robometer-4B

lerobot

Robometer is a zero-shot general-purpose robotic reward model built on a fine-tuned Qwen3-VL backbone with progress, preference, and success heads.

Source notes

Robometer is a zero-shot general-purpose robotic reward model built on a fine-tuned Qwen3-VL backbone with progress, preference, and success heads. Given a video and a task description it outputs a per-frame progress signal in [0, 1] and a per-frame success probability — suitable for offline reward labelling and for low-frequency reward signals during RL fine-tuning of robot policies.

Code
Unverified
Weights
Available
Checkpoint
Available
License
apache-2.0
WeightsModel index A–Z

Decision summary

Best for

lerobot

Main blocker

Hardware, latency, dependencies, and checkpoint loading are not pipeline-tested.

Next check

Run a checkpoint loading smoke test before marking the model pipeline-tested.

Release history

Source-backed release timing for this canonical model record.

Important releases

  1. Checkpoint published

    Release timing is recorded from the official source creation date.

    Official source

Selection readiness

Evidence dimensions for deciding whether this model is ready to inspect, compare, or adopt. Scores describe catalog evidence, not task performance.

Published evaluation

How scores work

76/100

Useful

5/6 dimensions scored · 63% confidence

Access and governance75conf. 85
Artifact availability90conf. 90
Training and loading reproducibility70conf. 65
Training data requirements76conf. 70
Evaluation evidenceNot scoredconf. 10
Deployment readiness70conf. 55
Engineering checks (OBRS) behind this record
Engineering checksBronze

Needs Audit

4/12checks passed

OBRS metadata and reported test evidence. A breakdown behind Selection readiness, not a separate score or an independent OpenBot certification.

Standardization & Loaders15 / 25 pt
Physical & Action Quality2 / 25 pt
Semantic & Annotation15 / 20 pt
Real-World Validation0 / 15 pt
License & Compliance10 / 15 pt
Missing evidence and readiness gaps
  • A passing real-hardware test report is required.
  • A passing ingestion/pipeline test report is required.
  • A passing privacy and provenance review is required.

Why these scores

The strongest decision reasons behind Selection readiness.

Top 3 adoption signals

Artifact availability

Useful

Checkpoint files were verified in the official repository metadata.

90 · confidence 90

Training and loading reproducibility

Useful

Configuration files are present; runtime loading is not tested.

70 · confidence 65

Evaluation evidence

Unknown

No structured evaluation evidence has been verified.

— · confidence 10

Data requirements

Declared loop-data needs, missing evidence, and the next checks that matter.

3 required categories

Observation / ego video

video

required

Language intent / task phase

language · vision-language

required

Feedback / correction / failure

success/failure

required

Sim-real / embodiment metadata

Descriptive model record

useful

Critical gaps

Core categories are represented. Interface alignment and data quality still require verification.

Linked datasets

Signal-level links only. Verify runtime interfaces before use.

Browse datasets

No related catalog datasets are linked to this model yet.

More evidenceShow

Additional decision dimensions

Access and governanceUseful

Access and license are declared by the source.

75 · c85
Training data requirementsUseful

Required signal categories are structured; exact tensor and action interfaces still need verification.

76 · c70
Deployment readinessUseful

Hardware, latency, dependencies, and checkpoint loading are not pipeline-tested.

70 · c55

Artifact facts

availability
metadata_verified
open
repository metadata
repository.files
metadata_verified
.gitattributes · README.md · config.json · model.safetensors
repository file tree
dataset.signals
official_claim
language · vision-language
README/card declaration
model.weight_files
metadata_verified
repository: lerobot/Robometer-4B · count: 1 · sample files: model.safetensors
Hugging Face model metadata siblings
model.checkpoint_files
metadata_verified
repository: lerobot/Robometer-4B · count: 1 · sample files: model.safetensors
Hugging Face model metadata checkpoint files
model.config_files
metadata_verified
repository: lerobot/Robometer-4B · count: 1 · sample files: config.json
Hugging Face model metadata siblings
model.required_signals
official_claim
language · vision-language
Official model documentation and curated signal mapping
license.weights
metadata_verified
apache-2.0
Hugging Face model card license metadata
license
metadata_verified
apache-2.0
Hugging Face model card license metadata
release_timing
metadata_verified
2026-05-21T12:39:08.000Z
Existing published Catalog release-date evidence
dataset.scale
metadata_verified
label: repository size · value: 8.89GB
repository blob sizes