Crystal VS Wasm benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1316ms 80ms 64.1MB 1290ms 10ms crystal 1.15.0
wasm 3.rs 1735ms 38ms 51.3MB 1700ms 17ms wasmtime 29.0.1
wasm 4.rs 1755ms 3.5ms 35.3MB 1730ms 13ms wasmtime 29.0.1
wasm 5.rs 1769ms 18ms 37.2MB 1753ms 3ms wasmtime 29.0.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 9.3ms 10.9MB 100ms 0ms crystal 1.15.0
wasm 5.rs 170ms 0.9ms 21.3MB 160ms 0ms wasmtime 29.0.1
wasm 4.rs 171ms 2.2ms 23.3MB 160ms 0ms wasmtime 29.0.1
wasm 3.rs 172ms 6.1ms 23.3MB 160ms 3ms wasmtime 29.0.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1128ms 15ms 21.5MB 1110ms 0ms wasmtime 29.0.1
crystal 1.cr 1367ms 11ms 19.8MB 1300ms 50ms crystal 1.15.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 76ms 1.4ms 7.1MB 57ms 7ms crystal 1.15.0
wasm 3.rs 83ms 2.3ms 20.0MB 70ms 0ms wasmtime 29.0.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 62ms 1.9ms 6.4MB 43ms 3ms crystal 1.15.0
wasm 1.rs 416ms 1.5ms 20.8MB 403ms 3ms wasmtime 29.0.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.6ms 5.1MB 10ms 0ms crystal 1.15.0
wasm 1.rs 113ms 1.5ms 20.1MB 100ms 0ms wasmtime 29.0.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2495ms 6.5ms 2.8MB 2483ms 0ms crystal 1.15.0
wasm 1.rs 4263ms 18ms 20.8MB 4253ms 0ms wasmtime 29.0.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 205ms 1.5ms 2.8MB 193ms 0ms crystal 1.15.0
wasm 1.rs 357ms 5.3ms 19.4MB 347ms 0ms wasmtime 29.0.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 233ms 1.1ms 19.7MB 220ms 0ms wasmtime 29.0.1
crystal 2.cr 573ms 3.5ms 3.5MB 450ms 107ms crystal 1.15.0
crystal 1.cr 720ms 0.6ms 14.6MB 573ms 127ms crystal 1.15.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 31ms 1.1ms 19.5MB 17ms 3ms wasmtime 29.0.1
crystal 2.cr 61ms 1.2ms 3.5MB 43ms 7ms crystal 1.15.0
crystal 1.cr 76ms 0.8ms 4.9MB 53ms 7ms crystal 1.15.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1.9ms 0.2ms 2.9MB 0ms 0ms crystal 1.15.0
wasm 1.rs 7.3ms 0.2ms 20.6MB 0ms 0ms wasmtime 29.0.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2547ms 222ms 197.7MB 403ms 490ms crystal 1.15.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1102ms 0.9ms 36.6MB 47ms 77ms crystal 1.15.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 1.0ms 2.9MB 23ms 0ms crystal 1.15.0
crystal 1.cr 65ms 1.7ms 3.0MB 57ms 0ms crystal 1.15.0
wasm 1.rs 84ms 1.3ms 19.7MB 70ms 0ms wasmtime 29.0.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 101ms 1.0ms 2.9MB 90ms 0ms crystal 1.15.0
crystal 1.cr 184ms 2.6ms 2.9MB 170ms 0ms crystal 1.15.0
wasm 1.rs 233ms 2.5ms 19.6MB 223ms 0ms wasmtime 29.0.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 0.6ms 2.9MB 10ms 0ms crystal 1.15.0
crystal 1.cr 30ms 1.5ms 2.9MB 20ms 0ms crystal 1.15.0
wasm 1.rs 45ms 1.3ms 20.9MB 33ms 0ms wasmtime 29.0.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 314ms 3.9ms 9.2MB 303ms 0ms crystal 1.15.0
wasm 8.rs 816ms 2.6ms 22.5MB 800ms 0ms wasmtime 29.0.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.3ms 5.8MB 10ms 0ms crystal 1.15.0
wasm 8.rs 42ms 0.3ms 19.5MB 30ms 0ms wasmtime 29.0.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 860ms 29ms 64.1MB 830ms 10ms crystal 1.15.0
wasm 1.rs 886ms 9.9ms 45.3MB 853ms 17ms wasmtime 29.0.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 178ms 4.4ms 22.0MB 160ms 3ms crystal 1.15.0
wasm 1.rs 192ms 0.4ms 25.3MB 177ms 3ms wasmtime 29.0.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 2.4ms 3.3MB 330ms 0ms crystal 1.15.0
crystal 2.cr 342ms 1.6ms 3.3MB 330ms 0ms crystal 1.15.0
wasm 1.rs 407ms 1.8ms 19.2MB 390ms 0ms wasmtime 29.0.1
wasm 2.rs 579ms 1.4ms 19.2MB 563ms 0ms wasmtime 29.0.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.7ms 3.3MB 23ms 0ms crystal 1.15.0
crystal 1.cr 38ms 1.4ms 3.3MB 30ms 0ms crystal 1.15.0
wasm 1.rs 49ms 0.4ms 21.2MB 37ms 0ms wasmtime 29.0.1
wasm 2.rs 66ms 1.1ms 19.2MB 57ms 0ms wasmtime 29.0.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 299ms 3.7ms 8.2MB 287ms 0ms crystal 1.15.0
wasm 2.rs 370ms 9.0ms 24.2MB 357ms 0ms wasmtime 29.0.1
crystal 1.cr 419ms 1.3ms 42.8MB 403ms 0ms crystal 1.15.0
wasm 1.rs 471ms 3.2ms 58.5MB 453ms 3ms wasmtime 29.0.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 75ms 1.4ms 4.4MB 67ms 0ms crystal 1.15.0
crystal 1.cr 89ms 2.6ms 13.0MB 77ms 0ms crystal 1.15.0
wasm 2.rs 93ms 1.0ms 22.5MB 80ms 3ms wasmtime 29.0.1
wasm 1.rs 97ms 3.2ms 29.2MB 87ms 0ms wasmtime 29.0.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1907ms 10ms 6.2MB 1877ms 13ms crystal 1.15.0
wasm 2.rs 2195ms 7.4ms 20.2MB 2177ms 7ms wasmtime 29.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 449ms 18ms 5.1MB 430ms 0ms crystal 1.15.0
wasm 2.rs 520ms 2.1ms 21.4MB 503ms 0ms wasmtime 29.0.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3585ms 7.0ms 19.0MB 3567ms 0ms wasmtime 29.0.1
crystal 1.cr 3801ms 27ms 4.4MB 3787ms 0ms crystal 1.15.0
wasm 7.rs 4890ms 13ms 21.0MB 4873ms 0ms wasmtime 29.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 905ms 2.5ms 20.9MB 890ms 3ms wasmtime 29.0.1
crystal 1.cr 955ms 2.5ms 4.3MB 943ms 0ms crystal 1.15.0
wasm 7.rs 1227ms 3.4ms 20.7MB 1210ms 0ms wasmtime 29.0.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 243ms 13ms 18.8MB 230ms 0ms wasmtime 29.0.1
crystal 1.cr 245ms 2.9ms 3.8MB 237ms 0ms crystal 1.15.0
wasm 7.rs 315ms 2.2ms 20.7MB 300ms 0ms wasmtime 29.0.1