C++ VS Wasm benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 679ms 11ms 1.0MB 1237ms 3ms g++ 12.1.0
cpp 1-im.cpp 688ms 11ms 3.6MB 1337ms 0ms clang++ 11.0.0
wasm 1.rs 4919ms 0.8ms 8.8MB 4903ms 0ms wasmedgec 0.9.1
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms node 16.15.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmer/llvm 2.2.1
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmtime 0.37.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 67ms 5.0ms 3.6MB 110ms 0ms clang++ 11.0.0
cpp 1-im.cpp 69ms 1.8ms 1.0MB 100ms 0ms g++ 12.1.0
wasm 1.rs 419ms 1.0ms 8.9MB 407ms 0ms wasmedgec 0.9.1
wasm 1.rs 436ms 10ms 5.8MB 417ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 473ms 2.1ms 8.9MB 460ms 0ms wasmtime 0.37.0
wasm 1.rs 514ms 84ms 41.9MB 520ms 3ms node 16.15.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.8ms 0.7ms 1.0MB 0ms 0ms g++ 12.1.0
cpp 1.cpp 2.8ms 0.8ms 1.0MB 0ms 0ms clang++ 11.0.0
wasm 1.rs 5.8ms 1.2ms 9.0MB 0ms 0ms wasmtime 0.37.0
wasm 1.rs 7.6ms 9.4ms 5.9MB 0ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 10ms 0.6ms 8.5MB 0ms 0ms wasmedgec 0.9.1
wasm 1.rs 76ms 1.6ms 41.6MB 82ms 12ms node 16.15.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 167ms 0.4ms 0.9MB 160ms 0ms g++ 12.1.0
cpp 0-i.cpp 212ms 0.4ms 1.1MB 200ms 0ms clang++ 11.0.0
cpp 1.cpp 307ms 5.8ms 0.9MB 293ms 0ms g++ 12.1.0
cpp 1.cpp 392ms 6.8ms 1.1MB 383ms 0ms clang++ 11.0.0
wasm 1.rs 545ms 0.1ms 4.9MB 533ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 558ms 19ms 9.3MB 547ms 0ms wasmtime 0.37.0
wasm 1.rs 609ms 0.4ms 9.2MB 597ms 0ms wasmedgec 0.9.1
wasm 1.rs 644ms 12ms 46.4MB 657ms 10ms node 16.15.0
wasm 2.rs 729ms 68ms 9.6MB 713ms 0ms wasmedgec 0.9.1
wasm 2.rs 780ms 43ms 5.1MB 773ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 824ms 30ms 11.0MB 810ms 0ms wasmtime 0.37.0
wasm 2.rs 891ms 2.3ms 46.4MB 907ms 7ms node 16.15.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 21ms 1.0ms 0.9MB 10ms 0ms g++ 12.1.0
cpp 0-i.cpp 24ms 1.9ms 1.1MB 13ms 0ms clang++ 11.0.0
cpp 1.cpp 33ms 0.1ms 0.9MB 20ms 0ms g++ 12.1.0
cpp 1.cpp 42ms 0.3ms 1.1MB 30ms 0ms clang++ 11.0.0
wasm 1.rs 61ms 11ms 5.9MB 50ms 0ms wasmer/llvm 2.2.1
wasm 1.rs 65ms 1.4ms 9.2MB 53ms 0ms wasmtime 0.37.0
wasm 1.rs 74ms 1.8ms 9.2MB 60ms 0ms wasmedgec 0.9.1
wasm 2.rs 90ms 16ms 5.8MB 67ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 92ms 1.5ms 9.6MB 77ms 0ms wasmedgec 0.9.1
wasm 2.rs 93ms 1.5ms 10.9MB 80ms 0ms wasmtime 0.37.0
wasm 1.rs 157ms 4.8ms 46.4MB 170ms 10ms node 16.15.0
wasm 2.rs 180ms 4.3ms 46.4MB 200ms 7ms node 16.15.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 369ms 18ms 7.4MB 357ms 0ms clang++ 11.0.0
wasm 2.rs 560ms 34ms 13.8MB 543ms 0ms wasmedgec 0.9.1
wasm 2.rs 560ms 32ms 10.8MB 543ms 0ms wasmer/llvm 2.2.1
cpp 1.cpp 578ms 2.4ms 7.7MB 567ms 0ms g++ 12.1.0
wasm 2.rs 784ms 1.6ms 46.7MB 787ms 3ms node 16.15.0
wasm 2.rs 829ms 51ms 15.1MB 813ms 0ms wasmtime 0.37.0
wasm 1.rs 1262ms 50ms 47.9MB 1233ms 10ms wasmedgec 0.9.1
wasm 1.rs 1402ms 9.7ms 45.2MB 1360ms 30ms wasmer/llvm 2.2.1
wasm 1.rs 1434ms 41ms 81.3MB 1437ms 13ms node 16.15.0
wasm 1.rs 1558ms 11ms 49.3MB 1533ms 10ms wasmtime 0.37.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 78ms 5.3ms 3.7MB 67ms 0ms clang++ 11.0.0
wasm 2.rs 130ms 7.9ms 10.0MB 117ms 0ms wasmedgec 0.9.1
cpp 1.cpp 138ms 9.6ms 4.0MB 130ms 0ms g++ 12.1.0
wasm 2.rs 149ms 11ms 7.4MB 127ms 3ms wasmer/llvm 2.2.1
wasm 1.rs 155ms 1.6ms 18.7MB 140ms 0ms wasmedgec 0.9.1
wasm 1.rs 162ms 17ms 15.9MB 133ms 7ms wasmer/llvm 2.2.1
wasm 2.rs 197ms 13ms 11.4MB 183ms 0ms wasmtime 0.37.0
wasm 1.rs 217ms 3.3ms 19.9MB 200ms 3ms wasmtime 0.37.0
wasm 2.rs 244ms 1.7ms 42.4MB 247ms 7ms node 16.15.0
wasm 1.rs 248ms 5.2ms 51.7MB 247ms 17ms node 16.15.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 7-m.cpp 885ms 14ms 3.2MB 1717ms 0ms clang++ 11.0.0
cpp 8-m.cpp 885ms 14ms 3.2MB 1723ms 0ms clang++ 11.0.0
cpp 7-m.cpp 886ms 13ms 1.0MB 1707ms 0ms g++ 12.1.0
cpp 8-m.cpp 905ms 2.6ms 0.9MB 1763ms 0ms g++ 12.1.0
cpp 6-im.cpp 1804ms 22ms 3.2MB 3530ms 10ms clang++ 11.0.0
cpp 6-im.cpp 1808ms 11ms 0.9MB 3423ms 7ms g++ 12.1.0
wasm 2.rs 3044ms 0.9ms 11.7MB 3027ms 0ms wasmedgec 0.9.1
wasm 7.rs 3226ms 4.2ms 6.2MB 3217ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 3406ms 239ms 10.3MB 3393ms 0ms wasmtime 0.37.0
wasm 7.rs 3414ms 251ms 9.7MB 3400ms 0ms wasmedgec 0.9.1
wasm 2.rs 3680ms 8.8ms 6.3MB 3670ms 0ms wasmer/llvm 2.2.1
wasm 7.rs 3832ms 272ms 46.6MB 3850ms 7ms node 16.15.0
wasm 7.rs 4251ms 297ms 10.3MB 4233ms 0ms wasmtime 0.37.0
wasm 2.rs 4272ms 294ms 46.4MB 4290ms 13ms node 16.15.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 7-m.cpp 226ms 6.2ms 3.2MB 413ms 0ms clang++ 11.0.0
cpp 7-m.cpp 230ms 6.3ms 1.0MB 420ms 0ms g++ 12.1.0
cpp 8-m.cpp 232ms 6.2ms 3.1MB 433ms 0ms clang++ 11.0.0
cpp 8-m.cpp 236ms 1.3ms 1.0MB 440ms 0ms g++ 12.1.0
cpp 6-im.cpp 462ms 2.2ms 1.0MB 877ms 0ms g++ 12.1.0
cpp 6-im.cpp 470ms 2.8ms 3.2MB 897ms 0ms clang++ 11.0.0
wasm 2.rs 772ms 0.5ms 9.6MB 760ms 0ms wasmedgec 0.9.1
wasm 7.rs 825ms 3.5ms 9.6MB 810ms 0ms wasmedgec 0.9.1
wasm 7.rs 884ms 61ms 6.2MB 870ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 895ms 0.4ms 10.3MB 880ms 0ms wasmtime 0.37.0
wasm 2.rs 926ms 0.7ms 6.3MB 910ms 0ms wasmer/llvm 2.2.1
wasm 7.rs 1076ms 70ms 46.4MB 1090ms 3ms node 16.15.0
wasm 7.rs 1114ms 0.8ms 10.3MB 1103ms 0ms wasmtime 0.37.0
wasm 2.rs 1187ms 1.0ms 46.3MB 1210ms 3ms node 16.15.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 7-m.cpp 63ms 1.6ms 3.1MB 103ms 0ms clang++ 11.0.0
cpp 7-m.cpp 63ms 1.3ms 0.9MB 103ms 0ms g++ 12.1.0
cpp 8-m.cpp 65ms 1.8ms 3.2MB 110ms 0ms clang++ 11.0.0
cpp 8-m.cpp 67ms 1.8ms 1.0MB 110ms 0ms g++ 12.1.0
cpp 6-im.cpp 123ms 2.8ms 0.9MB 220ms 0ms g++ 12.1.0
cpp 6-im.cpp 127ms 3.0ms 3.1MB 223ms 0ms clang++ 11.0.0
wasm 2.rs 214ms 16ms 11.5MB 200ms 0ms wasmedgec 0.9.1
wasm 7.rs 226ms 18ms 11.5MB 210ms 0ms wasmedgec 0.9.1
wasm 2.rs 231ms 1.1ms 9.2MB 217ms 0ms wasmtime 0.37.0
wasm 7.rs 238ms 10ms 5.8MB 220ms 0ms wasmer/llvm 2.2.1
wasm 2.rs 243ms 14ms 5.9MB 223ms 0ms wasmer/llvm 2.2.1
wasm 7.rs 286ms 1.2ms 9.8MB 273ms 0ms wasmtime 0.37.0
wasm 7.rs 323ms 2.1ms 50.3MB 333ms 13ms node 16.15.0
wasm 2.rs 375ms 1.8ms 46.3MB 397ms 7ms node 16.15.0