notesum.ai
Published at December 4Expanding Event Modality Applications through a Robust CLIP-Based Encoder
cs.CV
Released Date: December 4, 2024
Authors: Sungheon Jeong1, Hanning Chen, Sanggeon Yun, Suhyeon Cho, Wenjun Huang, Xiangjian Liu, Mohsen Imani
Aff.: 1University of California, Irvine

| N-ImageNet | N-Caltech101 | N-MNIST | |||||||
|---|---|---|---|---|---|---|---|---|---|
| EventCLIP | EventBind | Ours | EventCLIP | EventBind | Ours | EventCLIP | EventBind | Ours | |
| 0-shot | 22.74 | 11.52 | 37.9 | 58.82 | 61.8 | 66.34 | 48.72 | 56.81 | 46.95 |
| 1-shot | 25.39 | 17.6 | 44.3 | 75.82 | 74.96 | 79.43 | 74.62 | 74.64 | 69.43 |
| 2-shot | 29.44 | 21.7 | 45.91 | 78.86 | 79.78 | 81.91 | 82.78 | 82.89 | 83.33 |
| 5-shot | 35.43 | 28.1 | 50.4 | 83.57 | 84.49 | 85.01 | 93.78 | 94.44 | 94.23 |