Dart VS Codon benchmarks

Current benchmark data was generated on Sun Jan 29 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 1005ms 0.9ms 87.6MB 970ms 37ms dart/exe 2.19.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 103ms 2.9ms 47.2MB 70ms 20ms dart/exe 2.19.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart timeout 0.0ms 24.9MB 4927ms 50ms dart/exe 2.19.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 546ms 7.7ms 18.2MB 503ms 23ms dart/exe 2.19.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 4926ms 5.5ms 23.6MB 4873ms 37ms dart/exe 2.19.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 795ms 6.0ms 15.6MB 767ms 7ms dart/exe 2.19.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 4060ms 12ms 11.5MB 4047ms 0ms dart/exe 2.19.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 328ms 0.5ms 14.1MB 317ms 0ms dart/exe 2.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 561ms 2.6ms 15.1MB 543ms 3ms dart/exe 2.19.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 67ms 1.1ms 14.7MB 50ms 0ms dart/exe 2.19.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.1ms 0.8ms 5.3MB 0ms 0ms codon 0.15.4
dart 1.dart 7.3ms 0.7ms 13.8MB 0ms 0ms dart/exe 2.19.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 1662ms 393ms 116.8MB 980ms 667ms dart/exe 2.19.0
dart 1.dart 3782ms 83ms 110.1MB 1027ms 623ms dart/exe 2.19.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 254ms 15ms 57.0MB 163ms 123ms dart/exe 2.19.0
dart 1.dart 1379ms 155ms 55.3MB 163ms 87ms dart/exe 2.19.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 263ms 0.4ms 57.2MB 240ms 10ms dart/exe 2.19.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 2152ms 27ms 301.5MB 2190ms 103ms dart/exe 2.19.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 3-m.dart 2550ms 83ms 253.5MB 4280ms 90ms dart/exe 2.19.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 3-m.dart 400ms 3.5ms 198.7MB 633ms 57ms dart/exe 2.19.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 252ms 1.3ms 16.4MB 233ms 3ms dart/exe 2.19.0
dart 1.dart 1464ms 2.0ms 14.7MB 1443ms 0ms dart/exe 2.19.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 728ms 3.8ms 16.5MB 707ms 3ms dart/exe 2.19.0
dart 1.dart 4368ms 4.4ms 14.7MB 4347ms 3ms dart/exe 2.19.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 117ms 1.8ms 14.2MB 103ms 0ms dart/exe 2.19.0
dart 1.dart 212ms 0.7ms 15.0MB 200ms 0ms dart/exe 2.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 497ms 2.6ms 71.0MB 467ms 33ms dart/exe 2.19.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 124ms 0.5ms 48.7MB 103ms 7ms dart/exe 2.19.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 3.dart 530ms 5.0ms 13.5MB 517ms 0ms dart/exe 2.19.0
codon 1.py 1947ms 23ms 5.3MB 1933ms 0ms codon 0.15.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 3.dart 62ms 1.3ms 14.2MB 50ms 0ms dart/exe 2.19.0
codon 1.py 197ms 0.8ms 5.3MB 187ms 0ms codon 0.15.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 1695ms 12ms 22.2MB 1627ms 40ms dart/exe 2.19.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 424ms 0.6ms 22.6MB 380ms 27ms dart/exe 2.19.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart timeout 0.0ms 104.4MB 4960ms 20ms dart/exe 2.19.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 785ms 2.4ms 56.4MB 757ms 13ms dart/exe 2.19.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart timeout 0.0ms 13.7MB 4980ms 0ms dart/exe 2.19.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 1293ms 1.0ms 13.9MB 1273ms 0ms dart/exe 2.19.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 333ms 2.8ms 13.5MB 317ms 0ms dart/exe 2.19.0