ScenarioBench v1.0 Results
This directory contains the sanitized ScenarioBench benchmark data referenced by the CosmoEdge v1.0 README and release notes.
Summary
| ID | Scenario | Hardware profile | Target FPS | Max stable channels | Result | Chinese report |
|---|---|---|---|---|---|---|
| vlm-55009-npu | VLM Review NPU Benchmark (55009) | npu-yy-16t01-preview | 0.1 | 8 | PASS | zh-CN |
| helmet-7463-npu | No Safety Helmet NPU Benchmark (7463) | npu-yy-16t01-preview | 3 | 16 | PASS | zh-CN |
| pedestrian-45626-npu | Pedestrian Detection NPU Benchmark (45626) | npu-yy-16t01-preview | 5 | 16 | PASS | zh-CN |
| pedestrian-helmet-mixed-npu | Pedestrian + No Safety Helmet Mixed NPU Benchmark (45626 + 7463) | npu-yy-16t01-preview | 3 | 16 | PASS | zh-CN |
| helmet-7463-x86 | No Safety Helmet x86 Baseline Benchmark (7463) | x86-cpu-baseline | 3 | 7 | LIMITED | zh-CN |
Files
manifest.jsonprovides a bilingual index for README tables and release automation.environment.mddescribes the anonymized hardware profiles, model inputs, and publication policy.- Each scenario directory contains
summary.json, Englishreport.html, and original Chinesereport.zh-CN.html.
Raw metrics.json files are intentionally kept out of the repository. Publish them with the v1.0 release assets when full sampling traces are required.
For the current formally gated three-platform VLM validation, see the v1.1 benchmark. The former single-device page remains a superseded historical observation only.
