Programming Language and compiler
Benchmarks

Wasm VS Pony benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 1898ms 17ms 24.9MB 1873ms 7ms wasmedgec 0.9.1
wasm 5.rs 1936ms 34ms 22.0MB 1907ms 13ms wasmer/llvm 2.2.1
wasm 3.rs 2021ms 18ms 38.4MB 1977ms 30ms wasmer/llvm 2.2.1
wasm 4.rs 2088ms 133ms 22.1MB 2067ms 7ms wasmer/llvm 2.2.1
wasm 4.rs 2092ms 26ms 25.0MB 2073ms 0ms wasmedgec 0.9.1
wasm 3.rs 2156ms 149ms 40.9MB 2127ms 17ms wasmedgec 0.9.1
pony 1.pony 2309ms 36ms 2224.5MB 1600ms 893ms ponyc 0.50.0
wasm 5.rs 2608ms 151ms 57.6MB 2600ms 17ms node 16.15.0
wasm 3.rs 2647ms 167ms 73.5MB 2627ms 30ms node 16.15.0
wasm 4.rs 2785ms 64ms 57.4MB 2780ms 13ms node 16.15.0
wasm 5.rs 2799ms 19ms 26.1MB 2777ms 7ms wasmtime 0.37.0
wasm 3.rs 2904ms 27ms 42.0MB 2873ms 10ms wasmtime 0.37.0
wasm 4.rs 2950ms 7.6ms 26.0MB 2930ms 3ms wasmtime 0.37.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 180ms 3.8ms 214.6MB 143ms 50ms ponyc 0.50.0
wasm 5.rs 188ms 5.7ms 10.9MB 177ms 0ms wasmedgec 0.9.1
wasm 3.rs 193ms 13ms 10.2MB 167ms 3ms wasmer/llvm 2.2.1
wasm 4.rs 194ms 11ms 8.3MB 173ms 0ms wasmer/llvm 2.2.1
wasm 4.rs 203ms 1.7ms 11.0MB 183ms 0ms wasmedgec 0.9.1
wasm 5.rs 215ms 14ms 8.2MB 193ms 0ms wasmer/llvm 2.2.1
wasm 3.rs 218ms 7.1ms 12.9MB 197ms 3ms wasmedgec 0.9.1
wasm 5.rs 255ms 17ms 12.1MB 240ms 0ms wasmtime 0.37.0
wasm 3.rs 278ms 22ms 14.2MB 250ms 3ms wasmtime 0.37.0
wasm 4.rs 280ms 0.6ms 12.1MB 263ms 0ms wasmtime 0.37.0
wasm 5.rs 300ms 21ms 43.2MB 300ms 10ms node 16.15.0
wasm 4.rs 331ms 4.6ms 43.6MB 343ms 3ms node 16.15.0
wasm 3.rs 355ms 50ms 45.7MB 337ms 10ms node 16.15.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1151ms 3.4ms 8.2MB 1143ms 0ms wasmer/llvm 2.2.1
wasm 3.rs 1391ms 99ms 47.1MB 1430ms 7ms node 16.15.0
wasm 3.rs 1617ms 11ms 12.0MB 1607ms 0ms wasmtime 0.37.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 81ms 13ms 6.9MB 67ms 0ms wasmer/llvm 2.2.1
wasm 3.rs 103ms 7.1ms 10.7MB 90ms 0ms wasmtime 0.37.0
wasm 3.rs 213ms 2.3ms 47.4MB 253ms 13ms node 16.15.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 433ms 0.4ms 7.8MB 420ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 437ms 1.5ms 11.3MB 420ms 0ms wasmedgec 0.9.1
wasm 1.rs 582ms 0.9ms 11.4MB 567ms 0ms wasmtime 0.37.0
wasm 1.rs 636ms 38ms 46.9MB 677ms 7ms node 16.15.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 115ms 20ms 7.1MB 93ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 130ms 9.2ms 10.7MB 117ms 0ms wasmedgec 0.9.1
wasm 1.rs 156ms 1.4ms 10.7MB 143ms 0ms wasmtime 0.37.0
wasm 1.rs 258ms 2.6ms 47.2MB 297ms 10ms node 16.15.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 4919ms 0.8ms 8.8MB 4903ms 0ms wasmedgec 0.9.1
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms node 16.15.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmer/llvm 2.2.1
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmtime 0.37.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 419ms 1.0ms 8.9MB 407ms 0ms wasmedgec 0.9.1
wasm 1.rs 436ms 10ms 5.8MB 417ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 473ms 2.1ms 8.9MB 460ms 0ms wasmtime 0.37.0
wasm 1.rs 514ms 84ms 41.9MB 520ms 3ms node 16.15.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 272ms 0.6ms 10.1MB 253ms 0ms wasmtime 0.37.0
wasm 1.rs 285ms 0.2ms 8.8MB 270ms 0ms wasmedgec 0.9.1
wasm 1.rs 297ms 2.4ms 6.5MB 287ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 408ms 2.6ms 41.9MB 420ms 10ms node 16.15.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 34ms 0.9ms 9.1MB 20ms 0ms wasmtime 0.37.0
wasm 1.rs 40ms 0.7ms 8.7MB 30ms 0ms wasmedgec 0.9.1
wasm 1.rs 41ms 12ms 6.3MB 27ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 118ms 1.8ms 41.8MB 127ms 10ms node 16.15.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 5.3ms 0.5ms 8.4MB 0ms 0ms ponyc 0.50.0
wasm 1.rs 5.8ms 1.2ms 9.0MB 0ms 0ms wasmtime 0.37.0
wasm 1.rs 7.6ms 9.4ms 5.9MB 0ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 10ms 0.6ms 8.5MB 0ms 0ms wasmedgec 0.9.1
wasm 1.rs 76ms 1.6ms 41.6MB 82ms 12ms node 16.15.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 123ms 2.1ms 6.3MB 107ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 129ms 9.2ms 10.9MB 117ms 0ms wasmtime 0.37.0
wasm 1.rs 141ms 0.5ms 9.2MB 130ms 0ms wasmedgec 0.9.1
wasm 1.rs 222ms 4.3ms 45.8MB 237ms 7ms node 16.15.0
pony 1.pony timeout 0.0ms 0.0MB 0ms 0ms ponyc 0.50.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 356ms 1.5ms 6.2MB 340ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 386ms 27ms 10.2MB 373ms 0ms wasmtime 0.37.0
wasm 1.rs 394ms 4.9ms 11.2MB 380ms 0ms wasmedgec 0.9.1
wasm 1.rs 489ms 7.3ms 42.4MB 500ms 10ms node 16.15.0
pony 1.pony timeout 0.0ms 0.0MB 0ms 0ms ponyc 0.50.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 68ms 5.3ms 9.1MB 57ms 0ms wasmtime 0.37.0
wasm 1.rs 69ms 13ms 5.7MB 53ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 77ms 2.6ms 9.2MB 70ms 0ms wasmedgec 0.9.1
wasm 1.rs 152ms 3.7ms 42.6MB 167ms 3ms node 16.15.0
pony 1.pony 2644ms 2.1ms 37.0MB 2693ms 0ms ponyc 0.50.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 983ms 63ms 46.0MB 983ms 10ms node 16.15.0
wasm 8.rs 1032ms 56ms 12.0MB 1017ms 0ms wasmedgec 0.9.1
wasm 8.rs 1148ms 29ms 9.4MB 1133ms 0ms wasmer/llvm 2.2.1
wasm 8.rs 1382ms 0.1ms 13.0MB 1370ms 0ms wasmtime 0.37.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 58ms 1.2ms 11.2MB 47ms 0ms wasmedgec 0.9.1
wasm 8.rs 62ms 14ms 6.6MB 47ms 0ms wasmer/llvm 2.2.1
wasm 8.rs 66ms 0.4ms 10.8MB 60ms 0ms wasmtime 0.37.0
wasm 8.rs 123ms 3.0ms 43.0MB 133ms 7ms node 16.15.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1014ms 67ms 30.1MB 977ms 20ms wasmer/llvm 2.2.1
wasm 1.rs 1086ms 70ms 32.9MB 1063ms 7ms wasmedgec 0.9.1
wasm 1.rs 1390ms 16ms 66.1MB 1380ms 23ms node 16.15.0
wasm 1.rs 1431ms 13ms 34.1MB 1403ms 10ms wasmtime 0.37.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 220ms 29ms 12.2MB 193ms 7ms wasmer/llvm 2.2.1
wasm 1.rs 225ms 0.4ms 16.9MB 210ms 0ms wasmedgec 0.9.1
wasm 1.rs 307ms 1.7ms 16.0MB 290ms 0ms wasmtime 0.37.0
wasm 1.rs 356ms 5.1ms 47.8MB 353ms 10ms node 16.15.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 521ms 12ms 2.5MB 537ms 0ms ponyc 0.50.0
wasm 1.rs 545ms 0.1ms 4.9MB 533ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 558ms 19ms 9.3MB 547ms 0ms wasmtime 0.37.0
wasm 1.rs 609ms 0.4ms 9.2MB 597ms 0ms wasmedgec 0.9.1
wasm 1.rs 644ms 12ms 46.4MB 657ms 10ms node 16.15.0
wasm 2.rs 729ms 68ms 9.6MB 713ms 0ms wasmedgec 0.9.1
wasm 2.rs 780ms 43ms 5.1MB 773ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 824ms 30ms 11.0MB 810ms 0ms wasmtime 0.37.0
wasm 2.rs 891ms 2.3ms 46.4MB 907ms 7ms node 16.15.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 57ms 1.7ms 6.6MB 47ms 0ms ponyc 0.50.0
wasm 1.rs 61ms 11ms 5.9MB 50ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 65ms 1.4ms 9.2MB 53ms 0ms wasmtime 0.37.0
wasm 1.rs 74ms 1.8ms 9.2MB 60ms 0ms wasmedgec 0.9.1
wasm 2.rs 90ms 16ms 5.8MB 67ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 92ms 1.5ms 9.6MB 77ms 0ms wasmedgec 0.9.1
wasm 2.rs 93ms 1.5ms 10.9MB 80ms 0ms wasmtime 0.37.0
wasm 1.rs 157ms 4.8ms 46.4MB 170ms 10ms node 16.15.0
wasm 2.rs 180ms 4.3ms 46.4MB 200ms 7ms node 16.15.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 560ms 34ms 13.8MB 543ms 0ms wasmedgec 0.9.1
wasm 2.rs 560ms 32ms 10.8MB 543ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 784ms 1.6ms 46.7MB 787ms 3ms node 16.15.0
wasm 2.rs 829ms 51ms 15.1MB 813ms 0ms wasmtime 0.37.0
wasm 1.rs 1262ms 50ms 47.9MB 1233ms 10ms wasmedgec 0.9.1
wasm 1.rs 1402ms 9.7ms 45.2MB 1360ms 30ms wasmer/llvm 2.2.1
wasm 1.rs 1434ms 41ms 81.3MB 1437ms 13ms node 16.15.0
wasm 1.rs 1558ms 11ms 49.3MB 1533ms 10ms wasmtime 0.37.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 130ms 7.9ms 10.0MB 117ms 0ms wasmedgec 0.9.1
wasm 2.rs 149ms 11ms 7.4MB 127ms 3ms wasmer/llvm 2.2.1
wasm 1.rs 155ms 1.6ms 18.7MB 140ms 0ms wasmedgec 0.9.1
wasm 1.rs 162ms 17ms 15.9MB 133ms 7ms wasmer/llvm 2.2.1
wasm 2.rs 197ms 13ms 11.4MB 183ms 0ms wasmtime 0.37.0
wasm 1.rs 217ms 3.3ms 19.9MB 200ms 3ms wasmtime 0.37.0
wasm 2.rs 244ms 1.7ms 42.4MB 247ms 7ms node 16.15.0
wasm 1.rs 248ms 5.2ms 51.7MB 247ms 17ms node 16.15.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2831ms 209ms 7.0MB 2820ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 3027ms 2.2ms 10.9MB 3010ms 3ms wasmedgec 0.9.1
wasm 2.rs 3488ms 245ms 10.7MB 3477ms 0ms wasmtime 0.37.0
wasm 2.rs 3816ms 4.7ms 46.2MB 3850ms 13ms node 16.15.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 702ms 55ms 6.4MB 683ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 727ms 3.7ms 10.6MB 713ms 0ms wasmedgec 0.9.1
wasm 2.rs 862ms 2.4ms 11.3MB 843ms 0ms wasmtime 0.37.0
wasm 2.rs 990ms 5.2ms 46.3MB 1027ms 13ms node 16.15.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 364ms 40ms 9.8MB 350ms 0ms wasmedgec 0.9.1
wasm 0.rs 394ms 22ms 4.9MB 380ms 0ms wasmer/llvm 2.2.1
wasm 0.rs 449ms 23ms 45.2MB 463ms 10ms node 16.15.0
wasm 0.rs 453ms 0.5ms 10.3MB 440ms 0ms wasmtime 0.37.0
wasm 1.rs 3885ms 281ms 10.3MB 3877ms 0ms wasmedgec 0.9.1
wasm 1.rs 4057ms 287ms 5.0MB 4043ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 4685ms 30ms 51.0MB 4727ms 10ms node 16.15.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmtime 0.37.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 97ms 1.9ms 9.8MB 83ms 0ms wasmedgec 0.9.1
wasm 0.rs 109ms 4.9ms 5.7MB 93ms 0ms wasmer/llvm 2.2.1
wasm 0.rs 121ms 0.7ms 9.5MB 110ms 0ms wasmtime 0.37.0
wasm 0.rs 184ms 6.4ms 45.3MB 203ms 7ms node 16.15.0
wasm 1.rs 943ms 3.5ms 10.4MB 923ms 0ms wasmedgec 0.9.1
wasm 1.rs 991ms 68ms 5.7MB 970ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 1267ms 3.5ms 9.8MB 1250ms 0ms wasmtime 0.37.0
wasm 1.rs 1271ms 7.8ms 50.6MB 1303ms 20ms node 16.15.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3044ms 0.9ms 11.7MB 3027ms 0ms wasmedgec 0.9.1
wasm 7.rs 3226ms 4.2ms 6.2MB 3217ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 3406ms 239ms 10.3MB 3393ms 0ms wasmtime 0.37.0
wasm 7.rs 3414ms 251ms 9.7MB 3400ms 0ms wasmedgec 0.9.1
wasm 2.rs 3680ms 8.8ms 6.3MB 3670ms 0ms wasmer/llvm 2.2.1
wasm 7.rs 3832ms 272ms 46.6MB 3850ms 7ms node 16.15.0
wasm 7.rs 4251ms 297ms 10.3MB 4233ms 0ms wasmtime 0.37.0
wasm 2.rs 4272ms 294ms 46.4MB 4290ms 13ms node 16.15.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 772ms 0.5ms 9.6MB 760ms 0ms wasmedgec 0.9.1
wasm 7.rs 825ms 3.5ms 9.6MB 810ms 0ms wasmedgec 0.9.1
wasm 7.rs 884ms 61ms 6.2MB 870ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 895ms 0.4ms 10.3MB 880ms 0ms wasmtime 0.37.0
wasm 2.rs 926ms 0.7ms 6.3MB 910ms 0ms wasmer/llvm 2.2.1
wasm 7.rs 1076ms 70ms 46.4MB 1090ms 3ms node 16.15.0
wasm 7.rs 1114ms 0.8ms 10.3MB 1103ms 0ms wasmtime 0.37.0
wasm 2.rs 1187ms 1.0ms 46.3MB 1210ms 3ms node 16.15.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 214ms 16ms 11.5MB 200ms 0ms wasmedgec 0.9.1
wasm 7.rs 226ms 18ms 11.5MB 210ms 0ms wasmedgec 0.9.1
wasm 2.rs 231ms 1.1ms 9.2MB 217ms 0ms wasmtime 0.37.0
wasm 7.rs 238ms 10ms 5.8MB 220ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 243ms 14ms 5.9MB 223ms 0ms wasmer/llvm 2.2.1
wasm 7.rs 286ms 1.2ms 9.8MB 273ms 0ms wasmtime 0.37.0
wasm 7.rs 323ms 2.1ms 50.3MB 333ms 13ms node 16.15.0
wasm 2.rs 375ms 1.8ms 46.3MB 397ms 7ms node 16.15.0