Ego-view Accident Video Classification
This is our accident video classification benchmark. In the benchmarking stage, six state-of-the-art methods are evaluated from different video frame sampling methods, frame mixup strategy, input frame length, and the adaptation for long-tailed accident distribution; we calculate the top1, top5, top10, Precision, Recall, and F1_score values.
Leaderboard
| ID | Method | Year | Code | Size | Mixup | Top1 | Top5 | Top10 | Precision | Recall | F1-Score | Env. |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 3D ResNets-50 | 2018 | Link | 8x112 | no-mixup | 19.23% | 46.33% | 61.15% | 0.18% | 0.19% | 0.13% | RTX 3090 |
| 2 | 3D ResNets-50 | 2018 | Link | 8x112 | mixup0.8 | 27.73% | 61.50% | 75.79% | 0.24% | 0.28% | 0.20% | RTX 3090 |
| 3 | 3D ResNets-50 | 2018 | Link | 16x112 | no-mixup | 19.34% | 45.99% | 59.08% | 0.17% | 0.19% | 0.13% | RTX 3090 |
| 4 | 3D ResNets-50 | 2018 | Link | 16x112 | mixup0.8 | 29.04% | 58.59% | 71.88% | 0.28% | 0.29% | 0.20% | RTX 3090 |
| 5 | Timesformer | 2021 | Link | 8x224 | no-mixup | 35.87% | 70.41% | 80.31% | 0.34% | 0.36% | 0.31% | RTX 3090 |
| 6 | Timesformer | 2021 | Link | 8x224 | mixup0.8 | 34.74% | 68.45% | 79.41% | 0.35% | 0.35% | 0.28% | RTX 3090 |
| 7 | Timesformer | 2021 | Link | 16x224 | no-mixup | 35.55% | 70.59% | 81.22% | 0.35% | 0.36% | 0.30% | RTX 3090 |
| 8 | Timesformer | 2021 | Link | 16x224 | mixup0.8 | 34.27% | 68.02% | 79.82% | 0.37% | 0.34% | 0.28% | RTX 3090 |
| 9 | TokenShift Transformer | 2021 | Link | 8x224 | no-mixup | 33.10% | 67.58% | 79.58% | 0.32% | 0.35% | 0.28% | RTX 3090 |
| 10 | TokenShift Transformer | 2021 | Link | 8x224 | mixup0.8 | 33.97% | 66.02% | 77.68% | 0.30% | 0.34% | 0.27% | RTX 3090 |
| 11 | TokenShift Transformer | 2021 | Link | 16x224 | no-mixup | 33.88% | 71.79% | 82.33% | 0.33% | 0.34% | 0.30% | RTX 3090 |
| 12 | TokenShift Transformer | 2021 | Link | 16x224 | mixup0.8 | 34.63% | 68.18% | 79.87% | 0.32% | 0.35% | 0.28% | RTX 3090 |
| 13 | ActionCLIP | 2021 | Link | 8x224 | no-mixup | 38.92% | 71.14% | 81.90% | 0.41% | 0.39% | 0.38% | RTX 3090 |
| 14 | ActionCLIP | 2021 | Link | 16x224 | no-mixup | 38.78% | 74.17% | 85.68% | 0.39% | 0.39% | 0.38% | RTX 3090 |
| 15 | Efficient Prompt | 2022 | Link | 8x224 | no-mixup | 32.08% | 69.54% | 83.04% | 0.30% | 0.32% | 0.30% | RTX 3090 |
| 16 | Efficient Prompt | 2022 | Link | 8x224 | mixup0.8 | 27.90% | 65.16% | 82.21% | 0.20% | 0.28% | 0.20% | RTX 3090 |
| 17 | Efficient Prompt | 2022 | Link | 16x224 | no-mixup | 29.14% | 67.93% | 81.19% | 0.25% | 0.29% | 0.27% | RTX 3090 |
| 18 | Efficient Prompt | 2022 | Link | 16x224 | mixup0.8 | 31.14% | 66.35% | 79.57% | 0.29% | 0.31% | 0.08% | RTX 3090 |
| 19 | X-CLIP | 2022 | Link | 8x224 | no-mixup | 39.17% | 73.84% | 83.69% | 0.39% | 0.39% | 0.36% | RTX 3090 |
| 20 | X-CLIP | 2022 | Link | 8x224 | mixup0.8 | 41.39% | 76.61% | 89.53% | 0.41% | 0.41% | 0.37% | RTX 3090 |
| 21 | X-CLIP | 2022 | Link | 16x224 | no-mixup | 37.53% | 75.28% | 87.60% | 0.36% | 0.38% | 0.21% | RTX 3090 |
| 22 | X-CLIP | 2022 | Link | 16x224 | mixup0.8 | 37.15% | 73.55% | 85.17% | 0.39% | 0.37% | 0.32% | RTX 3090 |
Submit Your Results
You can submit your metric values via the provided form. Furthermore, we would highly appreciate your contribution with clear links to relevant articles and code for more in-depth analysis.
Click here to submit your results:
Submit