Acton VS Kotlin benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 480ms 16ms 575.9MB 567ms 87ms kotlin/jvm 21
kotlin 1-m.kt 3116ms 32ms 248.5MB 5177ms 713ms kotlin/native 1.8.21
acton 1.act timeout 0.0ms 67.0MB 5933ms 90ms actonc 0.24.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 102ms 1.9ms 158.0MB 110ms 27ms kotlin/jvm 21
kotlin 1-m.kt 299ms 30ms 32.5MB 463ms 60ms kotlin/native 1.8.21
acton 1.act 842ms 30ms 12.1MB 970ms 73ms actonc 0.24.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 262ms 23ms 8.7MB 243ms 53ms actonc 0.24.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 95ms 11ms 5.5MB 73ms 30ms actonc 0.24.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.4ms 0.2ms 4.7MB 0ms 0ms kotlin/native 1.8.21
acton 1.act 4.2ms 0.4ms 4.0MB 0ms 0ms actonc 0.24.1
kotlin 1.kt 58ms 4.7ms 47.4MB 56ms 16ms kotlin/jvm 21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 353ms 4.0ms 679.4MB 377ms 90ms kotlin/jvm 21
kotlin 1-m.kt 1537ms 54ms 136.5MB 2363ms 343ms kotlin/native 1.8.21
acton 1.act 3348ms 28ms 104.1MB 3660ms 47ms actonc 0.24.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 131ms 0.9ms 206.5MB 157ms 40ms kotlin/jvm 21
kotlin 1-m.kt 319ms 4.8ms 40.5MB 470ms 77ms kotlin/native 1.8.21
acton 1.act 727ms 21ms 30.5MB 773ms 23ms actonc 0.24.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act timeout 0.0ms 561.0MB 6780ms 90ms actonc 0.24.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 2372ms 19ms 192.6MB 2880ms 53ms actonc 0.24.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1-m.act 3055ms 71ms 6.1MB 2737ms 2097ms actonc 0.24.1
kotlin 1.kt 3707ms 69ms 352.5MB 4577ms 93ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 20.9MB 6393ms 267ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 4993ms 160ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1-m.act 882ms 34ms 7.6MB 747ms 613ms actonc 0.24.1
kotlin 1-m.kt 1004ms 32ms 354.5MB 1770ms 80ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6367ms 263ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.3MB 5000ms 160ms kotlin/native 1.8.21