Programming Language and compiler
Benchmarks

Crystal VS Wasm benchmarks

Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2438ms 1.7ms 64.3MB 2393ms 23ms crystal 1.7.2
wasm 3.rs 2706ms 17ms 48.1MB 2673ms 17ms wasmedgec 0.11.2
wasm 5.rs 2707ms 6.6ms 31.2MB 2683ms 3ms wasmedgec 0.11.2
wasm 4.rs 2873ms 6.5ms 31.7MB 2840ms 13ms wasmedgec 0.11.2
wasm 5.rs 3216ms 6.5ms 59.3MB 3213ms 20ms node 16.19.0
wasm 3.rs 3302ms 25ms 74.9MB 3267ms 27ms node 16.19.0
wasm 4.rs 3315ms 8.3ms 59.7MB 3310ms 23ms node 16.19.0
wasm 5.rs 3364ms 1.0ms 26.9MB 3343ms 7ms wasmtime 5.0.0
wasm 4.rs 3507ms 18ms 26.8MB 3480ms 10ms wasmtime 5.0.0
wasm 3.rs 3669ms 17ms 42.5MB 3647ms 3ms wasmtime 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 185ms 11ms 11.0MB 167ms 0ms crystal 1.7.2
wasm 3.rs 247ms 1.1ms 19.0MB 240ms 0ms wasmedgec 0.11.2
wasm 5.rs 260ms 3.4ms 18.7MB 243ms 0ms wasmedgec 0.11.2
wasm 4.rs 275ms 4.6ms 17.0MB 260ms 0ms wasmedgec 0.11.2
wasm 5.rs 322ms 4.3ms 12.9MB 310ms 0ms wasmtime 5.0.0
wasm 4.rs 332ms 3.2ms 12.9MB 317ms 0ms wasmtime 5.0.0
wasm 3.rs 337ms 0.5ms 14.8MB 320ms 0ms wasmtime 5.0.0
wasm 3.rs 389ms 13ms 46.2MB 393ms 7ms node 16.19.0
wasm 5.rs 390ms 8.9ms 45.2MB 400ms 7ms node 16.19.0
wasm 4.rs 392ms 3.8ms 45.1MB 403ms 10ms node 16.19.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1809ms 30ms 49.9MB 1860ms 13ms node 16.19.0
wasm 3.rs 1955ms 5.0ms 12.9MB 1940ms 0ms wasmtime 5.0.0
crystal 1.cr 2418ms 41ms 20.3MB 2357ms 37ms crystal 1.7.2
wasm 3.rs 2468ms 7.7ms 17.3MB 2443ms 7ms wasmedgec 0.11.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 131ms 0.6ms 11.6MB 117ms 0ms wasmtime 5.0.0
crystal 1.cr 136ms 1.4ms 7.2MB 120ms 3ms crystal 1.7.2
wasm 3.rs 168ms 5.8ms 15.9MB 157ms 0ms wasmedgec 0.11.2
wasm 3.rs 260ms 12ms 48.5MB 303ms 20ms node 16.19.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 95ms 7.6ms 6.4MB 80ms 3ms crystal 1.7.2
wasm 1.rs 565ms 4.5ms 16.2MB 550ms 0ms wasmedgec 0.11.2
wasm 1.rs 707ms 1.8ms 12.3MB 693ms 0ms wasmtime 5.0.0
wasm 1.rs 776ms 3.6ms 49.5MB 810ms 23ms node 16.19.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 32ms 0.7ms 5.3MB 20ms 0ms crystal 1.7.2
wasm 1.rs 153ms 1.8ms 15.5MB 140ms 0ms wasmedgec 0.11.2
wasm 1.rs 186ms 0.7ms 11.5MB 173ms 0ms wasmtime 5.0.0
wasm 1.rs 312ms 9.8ms 49.6MB 360ms 13ms node 16.19.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 4460ms 4.4ms 3.0MB 4447ms 0ms crystal 1.7.2
wasm 1.rs timeout 0.0ms 44.3MB 5003ms 10ms node 16.19.0
wasm 1.rs timeout 0.0ms 15.6MB 4980ms 0ms wasmedgec 0.11.2
wasm 1.rs timeout 0.0ms 10.6MB 4983ms 0ms wasmtime 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 372ms 15ms 3.0MB 360ms 0ms crystal 1.7.2
wasm 1.rs 537ms 4.5ms 10.8MB 520ms 0ms wasmtime 5.0.0
wasm 1.rs 541ms 1.2ms 15.6MB 523ms 0ms wasmedgec 0.11.2
wasm 1.rs 606ms 28ms 44.2MB 613ms 10ms node 16.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 382ms 14ms 14.9MB 360ms 0ms wasmedgec 0.11.2
wasm 1.rs 421ms 7.6ms 11.2MB 410ms 0ms wasmtime 5.0.0
wasm 1.rs 465ms 3.7ms 43.7MB 477ms 7ms node 16.19.0
crystal 2.cr 873ms 17ms 3.1MB 757ms 100ms crystal 1.7.2
crystal 1.cr 1124ms 3.1ms 14.6MB 967ms 137ms crystal 1.7.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 51ms 4.2ms 10.8MB 40ms 0ms wasmtime 5.0.0
wasm 1.rs 53ms 3.1ms 16.0MB 37ms 0ms wasmedgec 0.11.2
crystal 2.cr 91ms 0.9ms 3.2MB 73ms 7ms crystal 1.7.2
crystal 1.cr 117ms 0.6ms 4.5MB 90ms 17ms crystal 1.7.2
wasm 1.rs 137ms 3.0ms 43.5MB 153ms 7ms node 16.19.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.6ms 0.5ms 3.0MB 0ms 0ms crystal 1.7.2
wasm 1.rs 8.0ms 1.2ms 9.2MB 0ms 0ms wasmtime 5.0.0
wasm 1.rs 8.7ms 0.8ms 16.1MB 0ms 0ms wasmedgec 0.11.2
wasm 1.rs 96ms 4.6ms 43.5MB 110ms 4ms node 16.19.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3606ms 81ms 193.5MB 693ms 417ms crystal 1.7.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1299ms 5.5ms 43.4MB 73ms 63ms crystal 1.7.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 69ms 3.1ms 3.0MB 57ms 0ms crystal 1.7.2
crystal 1.cr 113ms 1.8ms 3.0MB 100ms 0ms crystal 1.7.2
wasm 1.rs 185ms 0.4ms 15.7MB 170ms 0ms wasmedgec 0.11.2
wasm 1.rs 230ms 3.2ms 11.2MB 213ms 0ms wasmtime 5.0.0
wasm 1.rs 314ms 3.7ms 44.8MB 323ms 3ms node 16.19.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 195ms 4.7ms 3.0MB 180ms 0ms crystal 1.7.2
crystal 1.cr 324ms 1.4ms 3.0MB 310ms 0ms crystal 1.7.2
wasm 1.rs 539ms 1.4ms 16.2MB 523ms 0ms wasmedgec 0.11.2
wasm 1.rs 665ms 1.8ms 11.2MB 650ms 0ms wasmtime 5.0.0
wasm 1.rs 738ms 4.8ms 44.5MB 750ms 10ms node 16.19.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 36ms 2.2ms 2.9MB 23ms 0ms crystal 1.7.2
crystal 1.cr 56ms 0.1ms 2.9MB 47ms 0ms crystal 1.7.2
wasm 1.rs 100ms 3.4ms 15.1MB 87ms 0ms wasmedgec 0.11.2
wasm 1.rs 119ms 1.5ms 11.1MB 110ms 0ms wasmtime 5.0.0
wasm 1.rs 212ms 6.0ms 44.3MB 227ms 3ms node 16.19.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 492ms 4.7ms 9.8MB 480ms 0ms crystal 1.7.2
wasm 8.rs 1232ms 4.9ms 47.5MB 1243ms 7ms node 16.19.0
wasm 8.rs 1270ms 12ms 17.6MB 1253ms 0ms wasmedgec 0.11.2
wasm 8.rs 1693ms 1.2ms 14.1MB 1680ms 0ms wasmtime 5.0.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 26ms 0.0ms 6.7MB 13ms 0ms crystal 1.7.2
wasm 8.rs 61ms 0.5ms 16.0MB 50ms 0ms wasmedgec 0.11.2
wasm 8.rs 79ms 0.2ms 11.3MB 63ms 0ms wasmtime 5.0.0
wasm 8.rs 153ms 1.4ms 44.7MB 163ms 13ms node 16.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1482ms 1.7ms 39.6MB 1460ms 7ms wasmedgec 0.11.2
wasm 1.rs 1650ms 32ms 67.5MB 1647ms 17ms node 16.19.0
wasm 1.rs 1651ms 19ms 34.8MB 1623ms 10ms wasmtime 5.0.0
crystal 1.cr 1790ms 9.6ms 64.3MB 1750ms 17ms crystal 1.7.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 320ms 17ms 22.1MB 300ms 7ms crystal 1.7.2
wasm 1.rs 323ms 7.6ms 21.7MB 303ms 0ms wasmedgec 0.11.2
wasm 1.rs 355ms 6.4ms 17.0MB 337ms 3ms wasmtime 5.0.0
wasm 1.rs 427ms 4.6ms 48.9MB 437ms 7ms node 16.19.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 670ms 3.5ms 2.9MB 657ms 0ms crystal 1.7.2
wasm 1.rs 679ms 4.2ms 9.3MB 663ms 0ms wasmtime 5.0.0
crystal 2.cr 694ms 9.6ms 3.0MB 683ms 0ms crystal 1.7.2
wasm 1.rs 705ms 9.6ms 15.0MB 690ms 0ms wasmedgec 0.11.2
wasm 1.rs 779ms 2.6ms 47.5MB 800ms 15ms node 16.19.0
wasm 2.rs 960ms 16ms 9.3MB 950ms 0ms wasmtime 5.0.0
wasm 2.rs 994ms 3.2ms 15.3MB 977ms 0ms wasmedgec 0.11.2
wasm 2.rs 1059ms 0.4ms 48.8MB 1073ms 13ms node 16.19.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 73ms 1.3ms 3.0MB 60ms 0ms crystal 1.7.2
wasm 1.rs 76ms 3.4ms 11.3MB 63ms 3ms wasmtime 5.0.0
crystal 2.cr 79ms 4.1ms 2.9MB 70ms 0ms crystal 1.7.2
wasm 1.rs 80ms 1.6ms 15.3MB 67ms 0ms wasmedgec 0.11.2
wasm 2.rs 110ms 5.0ms 15.0MB 93ms 0ms wasmedgec 0.11.2
wasm 2.rs 110ms 9.3ms 11.2MB 93ms 0ms wasmtime 5.0.0
wasm 1.rs 183ms 5.6ms 48.1MB 200ms 13ms node 16.19.0
wasm 2.rs 219ms 7.2ms 48.7MB 240ms 13ms node 16.19.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 513ms 4.0ms 7.8MB 500ms 0ms crystal 1.7.2
wasm 2.rs 762ms 2.5ms 20.4MB 743ms 0ms wasmedgec 0.11.2
wasm 2.rs 942ms 31ms 48.6MB 943ms 10ms node 16.19.0
wasm 2.rs 998ms 2.0ms 15.9MB 983ms 3ms wasmtime 5.0.0
wasm 1.rs 1109ms 34ms 54.0MB 1077ms 10ms wasmedgec 0.11.2
crystal 1.cr 1150ms 55ms 41.9MB 1130ms 7ms crystal 1.7.2
wasm 1.rs 1279ms 24ms 82.8MB 1277ms 23ms node 16.19.0
wasm 1.rs 1455ms 33ms 50.1MB 1433ms 7ms wasmtime 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 117ms 2.4ms 4.1MB 103ms 0ms crystal 1.7.2
crystal 1.cr 175ms 1.0ms 12.9MB 160ms 0ms crystal 1.7.2
wasm 1.rs 179ms 5.6ms 24.8MB 163ms 0ms wasmedgec 0.11.2
wasm 2.rs 185ms 1.0ms 17.2MB 170ms 0ms wasmedgec 0.11.2
wasm 2.rs 243ms 5.7ms 12.2MB 227ms 0ms wasmtime 5.0.0
wasm 1.rs 259ms 10ms 20.6MB 240ms 0ms wasmtime 5.0.0
wasm 1.rs 285ms 8.9ms 53.2MB 283ms 20ms node 16.19.0
wasm 2.rs 294ms 7.3ms 44.8MB 300ms 10ms node 16.19.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2934ms 12ms 17.6MB 2917ms 0ms wasmedgec 0.11.2
crystal 1.cr 3260ms 137ms 7.4MB 3223ms 20ms crystal 1.7.2
wasm 2.rs 3366ms 6.9ms 11.8MB 3347ms 0ms wasmtime 5.0.0
wasm 2.rs 3692ms 11ms 49.2MB 3730ms 17ms node 16.19.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 699ms 5.8ms 16.4MB 683ms 0ms wasmedgec 0.11.2
crystal 1.cr 703ms 27ms 5.8MB 677ms 10ms crystal 1.7.2
wasm 2.rs 813ms 19ms 11.3MB 797ms 0ms wasmtime 5.0.0
wasm 2.rs 979ms 9.6ms 48.3MB 1023ms 17ms node 16.19.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2759ms 1.3ms 174.0MB 2687ms 57ms crystal 1.7.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 287ms 1.0ms 32.1MB 260ms 10ms crystal 1.7.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 4361ms 1.2ms 16.2MB 4340ms 0ms wasmedgec 0.11.2
wasm 7.rs 4413ms 17ms 16.7MB 4397ms 0ms wasmedgec 0.11.2
wasm 2.rs 4746ms 106ms 11.3MB 4730ms 0ms wasmtime 5.0.0
wasm 7.rs 4837ms 3.6ms 11.3MB 4820ms 0ms wasmtime 5.0.0
crystal 1.cr timeout 0.0ms 4.0MB 4977ms 3ms crystal 1.7.2
wasm 2.rs timeout 0.0ms 48.6MB 5023ms 10ms node 16.19.0
wasm 7.rs timeout 0.0ms 48.8MB 5027ms 3ms node 16.19.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 1104ms 4.3ms 16.1MB 1087ms 0ms wasmedgec 0.11.2
wasm 7.rs 1124ms 18ms 16.2MB 1107ms 0ms wasmedgec 0.11.2
wasm 7.rs 1216ms 1.7ms 11.2MB 1200ms 0ms wasmtime 5.0.0
wasm 2.rs 1216ms 4.6ms 11.3MB 1200ms 0ms wasmtime 5.0.0
wasm 7.rs 1349ms 9.2ms 48.8MB 1373ms 3ms node 16.19.0
wasm 2.rs 1423ms 11ms 48.6MB 1450ms 7ms node 16.19.0
crystal 1.cr 1847ms 33ms 3.7MB 1837ms 0ms crystal 1.7.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 286ms 2.0ms 15.9MB 270ms 0ms wasmedgec 0.11.2
wasm 7.rs 299ms 4.2ms 15.3MB 280ms 0ms wasmedgec 0.11.2
wasm 2.rs 311ms 1.3ms 11.4MB 297ms 0ms wasmtime 5.0.0
wasm 7.rs 317ms 9.7ms 9.5MB 300ms 0ms wasmtime 5.0.0
wasm 7.rs 438ms 5.9ms 48.9MB 460ms 10ms node 16.19.0
wasm 2.rs 454ms 13ms 48.2MB 467ms 20ms node 16.19.0
crystal 1.cr 466ms 4.6ms 3.6MB 453ms 0ms crystal 1.7.2