notesum.ai

Published at November 12

MANTIS: A Mixed-Signal Near-Sensor Convolutional Imager SoC Using Charge-Domain 4b-Weighted 5-to-84-TOPS/W MAC Operations for Feature Extraction and Region-of-Interest Detection

cs.AR

B.7.0

Released Date: November 12, 2024

Authors: Martin Lefebvre¹, David Bol²

Aff.: ¹Graduate Student Member, IEEE; ²Senior Member, IEEE

Arxiv: http://arxiv.org/abs/2411.07946v1

Image downsampling (DS) 1 2 4 Filter stride (S) 2 4 8 16 2 4 8 16 2 4 8 16 Frame rate^$\star$ [fps] 18.2 79.7 79.7 79.7 79.7 79.7 79.7 79.7 79.7 79.7 79.7 79.7 Throughput^$\dagger$ [MOPS] 121 137.3 36.7 10.5 408.3 110.4 32.0 10.5 211.7 65.3 23.5 10.5 Feature map RMSE^$\diamond$ [

\%

] 3.01 3.25 4.00 4.69 3.40 3.98 6.30 8.68 4.88 11.34 9.19 8.45 Power^{$\triangleright$} (accelerator) [

\mu

W] 66.84 76.20 22.36 8.40 58.74 17.40 6.60 4.03 10.07 4.42 3.29 2.70 EE^{$\triangleleft$} (accelerator) [TOPS/W] 7.24 7.31 6.57 4.98 27.80 25.38 19.40 10.37 84.09 59.17 28.61 15.48 Energy/OP^{$\triangleleft$} (accelerator) [fJ/op] 138.1 138.7 152.1 200.9 36.0 39.4 51.6 96.4 11.9 16.9 35.0 64.6 Power^$\ddagger$ (SoC) [

\mu

W] 338.5 384.7 297.4 268.9 357.0 288.0 264.7 256.3 271.9 258.3 253.3 250.9 EE^{$\triangleleft$} (SoC) [TOPS/W] 1.43 1.43 0.49 0.16 4.57 1.53 0.48 0.16 3.11 1.01 0.37 0.17 Energy/OP^{$\triangleleft$} (SoC) [pJ/op] 0.70 0.70 2.02 6.43 0.22 0.65 2.07 6.13 0.32 0.99 2.69 6.00 Processing energy (SoC) [pJ/(pix

\cdot

frame

\cdot

filt)] 284.1 73.6 56.9 51.5 68.3 55.1 50.7 49.0 52.0 49.4 48.5 48.0