Benchmark
1. Benchmark methods
(1) CPU usage
CPU usage is calculated by summing the total CPU usage across all cores for the PID after launching App sense-stream, and then dividing by the number of cores. The result is expressed as a percentage in the range of 0–100%. CPU usage is sampled once per second for 1 minute, and the final value is the arithmetic mean of these samples.
Unit: %
(2) Memory usage
Memory usage is calculated by summing the PSS and swap memory of the PID after launching App sense-stream. Memory usage is sampled once per second for 1 minute, and the final value is the arithmetic mean of these samples.
Unit: KB
(3) Inference time
Inference time refers to the time it takes to process a single window after launching App sense-stream. The number of measurements depends on the model: v2.15.8 model processes one window every 0.5 seconds, while v2.20.0 model does so every 1 second. Inference time is measured over 1 minute, and the final value is the arithmetic mean of these measurements.
Unit: ms
(4) Inference benchmark across devices
All benchmarks were conducted using the methods described above. The following table provides a consolidated overview of hardware specifications and benchmark results for the Cochl.Sense Edge SDK on each supported platform. Metrics include CPU configuration, memory, and average inference time based on the 2-second model.
| Device | CPU | Memory | CPU usage (%) | Memory usage (KB) | Inference time (ms) |
|---|---|---|---|---|---|
| Raspberry Pi 3 | 4 Core 1.2GHz Cortex-A53 | 1 GB | 8.800 | 55192.641 | 337.000 |
| Raspberry Pi 4 | 4 Core 1.8GHz Cortex-A72 | 4 GB | 3.914 | 55064.200 | 146.141 |
| NVIDIA Orin Nano | 6 Core 1.5GHz ARMv8 | 8 GB | 1.257 | 54493.583 | 71.266 |
| Jetson Orin Nano | 4 Core 1.5GHz ARMv8 | 4 GB | 4.117 | 54292.891 | 154.475 |
| x86_64 - Ubuntu 22 | 6 Core 4.7GHz Intel i7-8700K | 64 GB | 0.190 | 56240.400 | 22.666 |
| x86_64 - Ubuntu 18 | 6 Core 4.6GHz Intel i7-8700 | 32 GB | 0.382 | 55349.891 | 44.391 |
2. Raspberry Pi 3 Model B Rev 1.2
- CPU info: 4 Core 1.2GHz Cortex-A53, CoreMark score: 5597.39
- RAM size: 1 GB
- OS version: Debian GNU/Linux 11 (bullseye) (Debian Version: 11)
- Kernel version: 6.1.21-v8+
- System architecture: aarch64
- Storage (Device model): SC32G
- Ethernet interface info:
- Interface: eth0
- Speed: 100Mb/s
- Driver: smsc95xx
CPU usage
Memory usage
Avg. inference time
3. Raspberry Pi 4 Model B Rev 1.4
- CPU info: 4 Core 1.8GHz Cortex-A72, CoreMark score: 15371.61
- RAM size: 4 GB
- OS version: Debian GNU/Linux 11 (bullseye) (Debian Version: 11)
- Kernel version: 6.1.21-v8+
- System architecture: aarch64
- Storage (Device model): SC32G
- Ethernet interface info:
- Interface: eth0
- Speed: 1000Mb/s
- Driver: bcmgenet
CPU usage
Memory usage
Avg. inference time
4. NVIDIA Orin Nano Developer Kit
- CPU info: 6 Core 1.5GHz ARMv8 Processor rev 1 (v8l), CoreMark score: 23618.33
- RAM size: 8 GB
- OS version: Ubuntu 20.04.5 LTS (Debian Version: 20.04)
- Kernel version: 5.10.104-tegra
- System architecture: aarch64
- Storage (Device model): FORESEE XP1000F256G
- Ethernet interface info:
- Interface: eth0
- Speed: 1000Mb/s
- Driver: r8169
CPU usage
Memory usage
Avg. inference time
5. NVIDIA Jetson Orin Nano Developer Kit
- CPU info: 4 Core 1.5GHz ARMv8 Processor rev 1 (v8l), CoreMark score: 10287.01
- RAM size: 4 GB
- OS version: Ubuntu 18.04.6 LTS (Debian Version: 18.04)
- Kernel version: 4.9.201-tegra
- System architecture: aarch64
- Storage (Device model): SS32G
- Ethernet interface info:
- Interface: eth0
- Speed: 1000Mb/s
- Driver: r8168
CPU usage
Memory usage
Avg. inference time
6. Linux-6.8.0-47-generic-x86_64-with-glibc2.35
- CPU info: 6 Core 4.7GHz Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz, CoreMark score: 52548.61
- RAM size: 64 GB
- OS version: Ubuntu 22.04.5 LTS (Debian Version: 22.04)
- Kernel version: 6.8.0-47-generic
- System architecture: x86_64
- Storage (Device model): Samsung SSD 980 PRO 1TB
- Ethernet interface info:
- Interface: enp0s31f6
- Speed: 1000Mb/s
- Driver: e1000e
CPU usage
Memory usage
Avg. inference time
7. Linux-5.4.0-150-generic-x86_64-with-glibc2.27
- CPU info: 6 Core 4.6GHz Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz, CoreMark score: 35207.14
- RAM size: 32 GB
- OS version: Ubuntu 18.04.6 LTS (Debian Version: 18.04)
- Kernel version: 5.4.0-150-generic
- System architecture: x86_64
- Storage (Device model): Samsung SSD 860
- Ethernet interface info:
- Interface: enp2s0
- Speed: 1000Mb/s
- Driver: r8169
CPU usage
Memory usage
Avg. inference time
