Programming Language and compiler
Benchmarks

Kotlin VS Rust benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 716ms 12ms 412.1MB 710ms 117ms kotlin/jvm 17.0.2
rust 4.rs 1768ms 38ms 33.7MB 1743ms 10ms rustc 1.64.0
rust 5.rs 1899ms 6.4ms 33.8MB 1880ms 3ms rustc 1.64.0
rust 3.rs 2017ms 65ms 49.9MB 1977ms 20ms rustc 1.64.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 146ms 16ms 109.7MB 123ms 27ms kotlin/jvm 17.0.2
rust 4.rs 157ms 0.7ms 5.6MB 143ms 0ms rustc 1.64.0
rust 3.rs 167ms 4.4ms 7.8MB 153ms 0ms rustc 1.64.0
rust 5.rs 168ms 0.6ms 6.0MB 157ms 0ms rustc 1.64.0
kotlin 1-m.kt 489ms 15ms 30.4MB 783ms 3ms kotlin/native 1.7.20

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 937ms 22ms 6.0MB 1790ms 30ms rustc 1.64.0
rust 5-m.rs 1022ms 195ms 5.4MB 1947ms 27ms rustc 1.64.0
rust 3.rs 1817ms 12ms 6.5MB 1773ms 27ms rustc 1.64.0
kotlin 2-m.kt 2801ms 185ms 163.4MB 5257ms 103ms kotlin/jvm 17.0.2
rust 4.rs 3031ms 1.3ms 4.5MB 3020ms 0ms rustc 1.64.0
kotlin 1.kt 3103ms 41ms 154.5MB 3897ms 87ms kotlin/jvm 17.0.2
rust 1-m.rs 3311ms 68ms 5.3MB 6430ms 60ms rustc 1.64.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20
kotlin 2-m.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 76ms 2.3ms 3.0MB 117ms 10ms rustc 1.64.0
rust 5-m.rs 94ms 9.1ms 2.8MB 160ms 0ms rustc 1.64.0
rust 3.rs 112ms 0.5ms 3.1MB 97ms 0ms rustc 1.64.0
rust 4.rs 200ms 1.7ms 2.6MB 183ms 0ms rustc 1.64.0
rust 1-m.rs 222ms 3.7ms 2.9MB 400ms 10ms rustc 1.64.0
kotlin 1-m.kt 730ms 3.1ms 95.7MB 1267ms 50ms kotlin/jvm 17.0.2
kotlin 2-m.kt 901ms 23ms 32.6MB 1610ms 30ms kotlin/native 1.7.20
kotlin 2-m.kt 1033ms 88ms 105.9MB 1860ms 57ms kotlin/jvm 17.0.2
kotlin 1.kt 1124ms 11ms 8.8MB 1280ms 7ms kotlin/native 1.7.20

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.8ms 0.4ms 0.6MB 0ms 0ms rustc 1.66.0-nightly
rust 1.rs 2.0ms 0.8ms 0.6MB 0ms 0ms rustc 1.64.0
kotlin 1.kt 3.1ms 1.1ms 1.1MB 0ms 0ms kotlin/native 1.7.20
kotlin 1.kt 70ms 3.2ms 41.0MB 48ms 16ms kotlin/jvm 17.0.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2-http2.rs 363ms 82ms 50.3MB 463ms 123ms rustc 1.64.0
rust 2-m.rs 556ms 4.6ms 112.8MB 313ms 553ms rustc 1.64.0
rust 1-http2.rs 1074ms 262ms 88.0MB 1423ms 480ms rustc 1.64.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 2.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
rust 1.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 79ms 20ms 16.7MB 27ms 27ms rustc 1.64.0
rust 2.rs 138ms 6.4ms 30.6MB 43ms 97ms rustc 1.64.0
rust 1-http2.rs 358ms 54ms 28.3MB 500ms 103ms rustc 1.64.0
kotlin 2-m.kt 2534ms 51ms 199.2MB 3670ms 320ms kotlin/jvm 17.0.2
kotlin 1-m.kt 2727ms 118ms 180.6MB 4110ms 330ms kotlin/jvm 17.0.2
rust 2-http2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3.rs 84ms 1.6ms 36.4MB 57ms 13ms rustc 1.64.0
rust 2.rs 85ms 0.4ms 38.1MB 57ms 10ms rustc 1.64.0
rust 1.rs 147ms 0.9ms 75.5MB 103ms 27ms rustc 1.64.0
kotlin 1-m.kt 1160ms 10.0ms 204.6MB 1933ms 100ms kotlin/jvm 17.0.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3.rs 518ms 0.9ms 258.6MB 397ms 107ms rustc 1.64.0
rust 2.rs 533ms 0.2ms 258.5MB 403ms 113ms rustc 1.64.0
rust 1.rs 954ms 2.4ms 605.5MB 663ms 273ms rustc 1.64.0
kotlin 1-m.kt 4300ms 36ms 1104.1MB 6223ms 383ms kotlin/jvm 17.0.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 53ms 0.9ms 0.6MB 50ms 0ms rustc 1.64.0
rust 1.rs 83ms 5.1ms 2.2MB 73ms 0ms rustc 1.64.0
kotlin 2-m.kt 245ms 1.4ms 112.5MB 343ms 30ms kotlin/jvm 17.0.2
kotlin 1.kt 255ms 2.6ms 109.3MB 300ms 40ms kotlin/jvm 17.0.2
kotlin 2.kt 446ms 4.7ms 42.5MB 650ms 17ms kotlin/native 1.7.20
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 208ms 10ms 0.6MB 197ms 0ms rustc 1.64.0
rust 1.rs 300ms 24ms 2.1MB 287ms 0ms rustc 1.64.0
kotlin 2.kt 419ms 2.7ms 125.4MB 507ms 37ms kotlin/jvm 17.0.2
kotlin 1.kt 486ms 1.1ms 138.2MB 540ms 23ms kotlin/jvm 17.0.2
kotlin 2.kt 1400ms 17ms 109.1MB 2043ms 43ms kotlin/native 1.7.20
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 32ms 0.8ms 0.6MB 20ms 0ms rustc 1.64.0
rust 1.rs 45ms 0.5ms 0.6MB 37ms 0ms rustc 1.64.0
kotlin 1.kt 184ms 1.7ms 74.2MB 250ms 17ms kotlin/jvm 17.0.2
kotlin 2-m.kt 196ms 7.5ms 78.7MB 277ms 27ms kotlin/jvm 17.0.2
kotlin 2-m.kt 227ms 2.9ms 28.5MB 350ms 3ms kotlin/native 1.7.20
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 529ms 3.3ms 286.5MB 503ms 103ms kotlin/jvm 17.0.2
rust 1.rs 894ms 6.7ms 33.8MB 863ms 13ms rustc 1.64.0
kotlin 1.kt 3050ms 5.6ms 138.6MB 4407ms 40ms kotlin/native 1.7.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 186ms 1.2ms 9.8MB 170ms 0ms rustc 1.64.0
kotlin 1.kt 203ms 2.0ms 221.7MB 170ms 57ms kotlin/jvm 17.0.2
kotlin 1.kt 579ms 11ms 38.6MB 833ms 3ms kotlin/native 1.7.20

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 207ms 1.2ms 0.6MB 197ms 0ms rustc 1.64.0
rust 7-i.rs 287ms 0.9ms 0.6MB 277ms 0ms rustc 1.64.0
rust 3.rs 342ms 0.5ms 0.7MB 330ms 0ms rustc 1.66.0-nightly
rust 2.rs 359ms 3.4ms 0.6MB 347ms 0ms rustc 1.64.0
rust 1.rs 415ms 5.8ms 0.6MB 407ms 0ms rustc 1.64.0
kotlin 1.kt 646ms 2.2ms 42.8MB 653ms 13ms kotlin/jvm 17.0.2
kotlin 1n.kt 686ms 8.1ms 1.2MB 670ms 0ms kotlin/native 1.7.20

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 24ms 1.2ms 0.6MB 13ms 0ms rustc 1.64.0
rust 7-i.rs 31ms 0.3ms 0.6MB 20ms 0ms rustc 1.64.0
rust 3.rs 37ms 0.5ms 0.7MB 30ms 0ms rustc 1.66.0-nightly
rust 2.rs 38ms 0.1ms 0.6MB 30ms 0ms rustc 1.64.0
rust 1.rs 45ms 0.9ms 0.6MB 33ms 0ms rustc 1.64.0
kotlin 1n.kt 71ms 2.0ms 1.2MB 60ms 0ms kotlin/native 1.7.20
kotlin 1.kt 150ms 0.4ms 42.8MB 153ms 23ms kotlin/jvm 17.0.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1738ms 3.3ms 2.8MB 1573ms 150ms rustc 1.64.0
rust 2.rs 1805ms 1.0ms 2.7MB 1737ms 43ms rustc 1.64.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 374ms 0.9ms 2.4MB 357ms 3ms rustc 1.64.0
rust 2.rs 409ms 0.3ms 2.6MB 397ms 0ms rustc 1.64.0
kotlin 1.kt 1568ms 14ms 212.9MB 1933ms 73ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 566ms 0.2ms 77.9MB 743ms 20ms rustc 1.64.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 63ms 0.6ms 11.2MB 70ms 0ms rustc 1.64.0
kotlin 1.kt 1013ms 18ms 95.9MB 1387ms 30ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.20

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 135ms 0.4ms 0.6MB 130ms 0ms rustc 1.64.0
rust 1.rs 1855ms 6.0ms 0.6MB 1843ms 0ms rustc 1.64.0
kotlin 1.kt 4536ms 19ms 183.2MB 5437ms 87ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 36ms 0.5ms 0.6MB 27ms 0ms rustc 1.64.0
rust 1.rs 466ms 0.4ms 0.7MB 453ms 0ms rustc 1.64.0
kotlin 1-m.kt 1381ms 9.6ms 183.5MB 2153ms 80ms kotlin/jvm 17.0.2