### Wenet ASR cpu runtime benchmark

AliCould Instance: ecs.c7.16xlarge	64 vCPU	128 GiB	2.7 GHz/3.5 GHz	32 Gbps, Intel Xeon(Ice Lake) Platinum 8369B

Offline ASR

Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512) 
|Model   | Aishell1 Test WER (%)  |  10 Hours Decoding Time (secs) |
|---|---|-------------------------------------|
|Aishell1_small_offline_fp32_ctc_prefix   | 4.62  |74.56 |
|Aishell1_small_offline_int8_ctc_prefix   | 4.79  |59.08 |
|Aishell1_small_offline_fp32_ctc_wfst   | 4.38  | 90.91|
|Aishell1_small_offline_int8_ctc_wfst   | 4.50  | 69.57 |
|WenetSpeech_large_offline_fp32_ctc_prefix   | 4.61  |181.77 |
|WenetSpeech_large_offline_int8_ctc_prefix   | 4.71  |125.57|

Streaming ASR

Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512) 
|Model   | Aishell1 Test WER (%)  |  10 Hours Decoding Time (secs) |
|---|---|-------------------------------------|
|Aishell1_small_u2pp_fp32_ctc_prefix   | | 102.21 |
|Aishell1_small_u2pp_fp32_ctc_wfst   | | 106.67 |
|WenetSpeech_large_u2pp_fp32_ctc_prefix   | | 276.32 |
{}
region:us
TAGS
#region-us 

### Wenet ASR cpu runtime benchmark


AliCould Instance: ecs.c7.16xlarge 64 vCPU 128 GiB 2.7 GHz/3.5 GHz 32 Gbps, Intel Xeon(Ice Lake) Platinum 8369B


Offline ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.62, 10 Hours Decoding Time (secs): 74.56
Model: Aishell1\_small\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.79, 10 Hours Decoding Time (secs): 59.08
Model: Aishell1\_small\_offline\_fp32\_ctc\_wfst, Aishell1 Test WER (%): 4.38, 10 Hours Decoding Time (secs): 90.91
Model: Aishell1\_small\_offline\_int8\_ctc\_wfst, Aishell1 Test WER (%): 4.50, 10 Hours Decoding Time (secs): 69.57
Model: WenetSpeech\_large\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.61, 10 Hours Decoding Time (secs): 181.77
Model: WenetSpeech\_large\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.71, 10 Hours Decoding Time (secs): 125.57


Streaming ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 102.21
Model: Aishell1\_small\_u2pp\_fp32\_ctc\_wfst, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 106.67
Model: WenetSpeech\_large\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 276.32



### Wenet ASR cpu runtime benchmark


AliCould Instance: ecs.c7.16xlarge 64 vCPU 128 GiB 2.7 GHz/3.5 GHz 32 Gbps, Intel Xeon(Ice Lake) Platinum 8369B


Offline ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.62, 10 Hours Decoding Time (secs): 74.56
Model: Aishell1\_small\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.79, 10 Hours Decoding Time (secs): 59.08
Model: Aishell1\_small\_offline\_fp32\_ctc\_wfst, Aishell1 Test WER (%): 4.38, 10 Hours Decoding Time (secs): 90.91
Model: Aishell1\_small\_offline\_int8\_ctc\_wfst, Aishell1 Test WER (%): 4.50, 10 Hours Decoding Time (secs): 69.57
Model: WenetSpeech\_large\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.61, 10 Hours Decoding Time (secs): 181.77
Model: WenetSpeech\_large\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.71, 10 Hours Decoding Time (secs): 125.57


Streaming ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 102.21
Model: Aishell1\_small\_u2pp\_fp32\_ctc\_wfst, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 106.67
Model: WenetSpeech\_large\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 276.32
TAGS
#region-us 
 ### Wenet ASR cpu runtime benchmark


AliCould Instance: ecs.c7.16xlarge 64 vCPU 128 GiB 2.7 GHz/3.5 GHz 32 Gbps, Intel Xeon(Ice Lake) Platinum 8369B


Offline ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.62, 10 Hours Decoding Time (secs): 74.56
Model: Aishell1\_small\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.79, 10 Hours Decoding Time (secs): 59.08
Model: Aishell1\_small\_offline\_fp32\_ctc\_wfst, Aishell1 Test WER (%): 4.38, 10 Hours Decoding Time (secs): 90.91
Model: Aishell1\_small\_offline\_int8\_ctc\_wfst, Aishell1 Test WER (%): 4.50, 10 Hours Decoding Time (secs): 69.57
Model: WenetSpeech\_large\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.61, 10 Hours Decoding Time (secs): 181.77
Model: WenetSpeech\_large\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.71, 10 Hours Decoding Time (secs): 125.57


Streaming ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 102.21
Model: Aishell1\_small\_u2pp\_fp32\_ctc\_wfst, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 106.67
Model: WenetSpeech\_large\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 276.32
TAGS
#region-us 
### Wenet ASR cpu runtime benchmark


AliCould Instance: ecs.c7.16xlarge 64 vCPU 128 GiB 2.7 GHz/3.5 GHz 32 Gbps, Intel Xeon(Ice Lake) Platinum 8369B


Offline ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.62, 10 Hours Decoding Time (secs): 74.56
Model: Aishell1\_small\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.79, 10 Hours Decoding Time (secs): 59.08
Model: Aishell1\_small\_offline\_fp32\_ctc\_wfst, Aishell1 Test WER (%): 4.38, 10 Hours Decoding Time (secs): 90.91
Model: Aishell1\_small\_offline\_int8\_ctc\_wfst, Aishell1 Test WER (%): 4.50, 10 Hours Decoding Time (secs): 69.57
Model: WenetSpeech\_large\_offline\_fp32\_ctc\_prefix, Aishell1 Test WER (%): 4.61, 10 Hours Decoding Time (secs): 181.77
Model: WenetSpeech\_large\_offline\_int8\_ctc\_prefix, Aishell1 Test WER (%): 4.71, 10 Hours Decoding Time (secs): 125.57


Streaming ASR


Num Concurrent Tasks: 256 (Best among 16, 32, 64, 128, 256, 512)


Model: Aishell1\_small\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 102.21
Model: Aishell1\_small\_u2pp\_fp32\_ctc\_wfst, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 106.67
Model: WenetSpeech\_large\_u2pp\_fp32\_ctc\_prefix, Aishell1 Test WER (%): , 10 Hours Decoding Time (secs): 276.32