Programming Language and compiler
Benchmarks

V VS Chapel benchmarks

Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1321ms 16ms 37.0MB 1293ms 7ms v/clang 0.3.3
v 1.v 1359ms 0.9ms 37.0MB 1337ms 7ms v/clang+gc 0.3.3
chapel 4.chpl 2946ms 5.9ms 64.3MB 2910ms 20ms chpl 1.29.0
chapel 3.chpl 3233ms 39ms 64.3MB 3197ms 17ms chpl 1.29.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 109ms 4.2ms 5.6MB 97ms 0ms v/clang 0.3.3
v 1.v 110ms 7.0ms 5.6MB 90ms 0ms v/clang+gc 0.3.3
chapel 4.chpl 279ms 2.6ms 34.3MB 260ms 7ms chpl 1.29.0
chapel 3.chpl 294ms 2.5ms 32.1MB 270ms 7ms chpl 1.29.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 4803ms 115ms 83.5MB 9277ms 70ms chpl 1.29.0
v 1.v timeout 0.0ms 20.6MB 5197ms 4170ms v/clang 0.3.3
v 1.v timeout 0.0ms 16.9MB 5010ms 4343ms v/clang+gc 0.3.3

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 348ms 12ms 48.1MB 623ms 20ms chpl 1.29.0
v 1-m.v 3554ms 853ms 14.5MB 3587ms 2920ms v/clang+gc 0.3.3
v 1-m.v 4741ms 230ms 14.6MB 4897ms 3993ms v/clang 0.3.3

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 104ms 0.6ms 18.5MB 90ms 0ms chpl 1.29.0
v 1.v timeout 0.0ms 28.5MB 4977ms 7ms v/clang+gc 0.3.3

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 46ms 3.8ms 34.1MB 37ms 0ms chpl 1.29.0
v 1.v timeout 0.0ms 12.9MB 4970ms 7ms v/clang+gc 0.3.3

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 3377ms 5.0ms 2.0MB 3363ms 0ms v/clang+gc 0.3.3
v 1.v 3398ms 1.4ms 2.0MB 3387ms 0ms v/clang 0.3.3

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 284ms 4.5ms 2.0MB 270ms 0ms v/clang+gc 0.3.3
v 1.v 291ms 11ms 1.9MB 273ms 0ms v/clang 0.3.3

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 164ms 5.7ms 32.0MB 277ms 3ms chpl 1.29.0
v 1.v 747ms 13ms 2.0MB 730ms 0ms v/clang+gc 0.3.3
v 1.v 765ms 28ms 2.0MB 750ms 0ms v/clang 0.3.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 33ms 3.1ms 22.0MB 30ms 7ms chpl 1.29.0
v 1.v 79ms 1.4ms 2.2MB 70ms 0ms v/clang 0.3.3
v 1.v 80ms 3.4ms 2.2MB 67ms 0ms v/clang+gc 0.3.3

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 2.2ms 0.7ms 2.0MB 0ms 0ms v/clang+gc 0.3.3
v 1.v 3.4ms 2.4ms 2.1MB 0ms 0ms v/clang 0.3.3
chapel 1.chpl 17ms 1.4ms 22.2MB 7ms 3ms chpl 1.29.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 535ms 228ms 15.1MB 247ms 367ms v/clang+gc 0.3.3

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 282ms 35ms 13.4MB 113ms 153ms v/clang+gc 0.3.3

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 433ms 10ms 2.2MB 420ms 0ms v/clang+gc 0.3.3
v 1.v 443ms 2.2ms 2.2MB 433ms 0ms v/clang 0.3.3

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1259ms 9.9ms 2.2MB 1243ms 0ms v/clang+gc 0.3.3
v 1.v 1319ms 7.9ms 2.1MB 1310ms 0ms v/clang 0.3.3

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 153ms 3.9ms 2.2MB 143ms 0ms v/clang+gc 0.3.3
v 1.v 161ms 3.8ms 2.3MB 150ms 0ms v/clang 0.3.3

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 485ms 2.4ms 22.2MB 467ms 7ms chpl 1.29.0
v 1.v 1064ms 6.8ms 2.3MB 1047ms 0ms v/clang 0.3.3
v 1.v 1085ms 27ms 2.2MB 1070ms 0ms v/clang+gc 0.3.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 70ms 1.7ms 32.2MB 47ms 7ms chpl 1.29.0
v 1.v 109ms 0.9ms 2.3MB 100ms 0ms v/clang 0.3.3
v 1.v 110ms 0.1ms 2.3MB 100ms 0ms v/clang+gc 0.3.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 632ms 1.7ms 10.7MB 617ms 0ms v/clang 0.3.3
v 2.v 633ms 2.4ms 10.7MB 620ms 0ms v/clang+gc 0.3.3
v 1.v 950ms 56ms 41.3MB 927ms 10ms v/clang+gc 0.3.3
v 1.v 995ms 21ms 41.2MB 973ms 10ms v/clang 0.3.3

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 137ms 0.2ms 20.9MB 120ms 3ms v/clang 0.3.3
v 1.v 137ms 1.6ms 20.8MB 120ms 0ms v/clang+gc 0.3.3
v 2.v 149ms 0.7ms 4.0MB 140ms 0ms v/clang+gc 0.3.3
v 2.v 151ms 4.9ms 4.0MB 140ms 0ms v/clang 0.3.3

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 582ms 3.7ms 30.1MB 560ms 3ms chpl 1.29.0
v 1.v 4231ms 76ms 3.0MB 4203ms 7ms v/clang+gc 0.3.3
v 1.v timeout 0.0ms 4.1MB 4970ms 10ms v/clang 0.3.3
v 2.v timeout 0.0ms 3.1MB 4980ms 0ms v/clang+gc 0.3.3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 151ms 2.2ms 20.8MB 130ms 3ms chpl 1.29.0
v 1.v 1065ms 28ms 2.8MB 1050ms 0ms v/clang+gc 0.3.3
v 1.v 1791ms 13ms 3.1MB 1773ms 0ms v/clang 0.3.3
v 2.v 2070ms 45ms 2.8MB 2057ms 0ms v/clang+gc 0.3.3

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2324ms 13ms 32.3MB 4533ms 10ms chpl 1.29.0
chapel 1.chpl 4465ms 18ms 32.4MB 4443ms 7ms chpl 1.29.0
v 1.v timeout 0.0ms 2.9MB 4990ms 0ms v/clang 0.3.3
v 1.v timeout 0.0ms 2.8MB 4987ms 0ms v/clang+gc 0.3.3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 654ms 50ms 32.3MB 1177ms 10ms chpl 1.29.0
chapel 1.chpl 1147ms 4.0ms 32.3MB 1130ms 3ms chpl 1.29.0
v 1.v 1998ms 0.3ms 2.8MB 1987ms 0ms v/clang 0.3.3
v 1.v 1999ms 2.2ms 2.9MB 1990ms 0ms v/clang+gc 0.3.3

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 179ms 4.2ms 32.3MB 300ms 10ms chpl 1.29.0
chapel 1.chpl 309ms 5.9ms 32.3MB 287ms 7ms chpl 1.29.0
v 1.v 507ms 4.1ms 2.5MB 497ms 0ms v/clang+gc 0.3.3
v 1.v 512ms 11ms 2.5MB 497ms 0ms v/clang 0.3.3