Codon VS Java benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.5ms 0.8ms 7.2MB 0ms 0ms codon 0.16.3
java 1.java 66ms 3.1ms 54.7MB 64ms 24ms graal/jvm 17.0.8
java 1.java 73ms 1.9ms 43.8MB 74ms 14ms openjdk 21
java 1.java 73ms 2.7ms 43.9MB 80ms 14ms openjdk 23
java 1.java 189ms 6.4ms 42.6MB 84ms 132ms openjdk/zgc 21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 443ms 1.2ms 47.6MB 487ms 13ms openjdk 23
java 1.java 444ms 1.9ms 45.4MB 477ms 20ms openjdk 21
java 1.java 455ms 6.6ms 86.8MB 483ms 30ms graal/jvm 17.0.8
java 1.java 559ms 4.6ms 46.7MB 480ms 133ms openjdk/zgc 21
java 2.java 1234ms 5.9ms 597.7MB 1363ms 77ms openjdk 23
java 2.java 1238ms 9.8ms 647.8MB 1373ms 80ms openjdk 21
codon 1.py 1295ms 1.9ms 7.7MB 1287ms 0ms codon 0.16.3
java 2.java 3177ms 56ms 2367.4MB 1670ms 1723ms openjdk/zgc 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 119ms 1.1ms 45.5MB 147ms 23ms openjdk 21
java 1.java 120ms 0.2ms 47.8MB 153ms 20ms openjdk 23
java 1.java 126ms 5.3ms 87.5MB 157ms 27ms graal/jvm 17.0.8
codon 1.py 140ms 2.4ms 5.8MB 127ms 0ms codon 0.16.3
java 1.java 243ms 2.9ms 46.7MB 163ms 140ms openjdk/zgc 21
java 2-m.java 295ms 2.6ms 352.8MB 433ms 50ms openjdk 23
java 2-m.java 298ms 4.2ms 362.9MB 443ms 50ms openjdk 21
java 2.java 681ms 8.7ms 528.1MB 440ms 427ms openjdk/zgc 21

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 397ms 1.3ms 117.2MB 443ms 20ms openjdk 23
java 1.java 403ms 8.1ms 114.9MB 447ms 30ms openjdk 21
codon 1.py 406ms 0.9ms 46.5MB 390ms 0ms codon 0.16.3
codon 2.py 482ms 8.3ms 107.0MB 463ms 13ms codon 0.16.3
java 1.java 581ms 2.7ms 114.6MB 473ms 177ms openjdk/zgc 21
java 1-m.java 638ms 11ms 234.0MB 917ms 77ms graal/jvm 17.0.8
java 2.java 779ms 1.6ms 59.3MB 827ms 23ms openjdk 23
java 2.java 781ms 0.5ms 57.3MB 837ms 23ms openjdk 21
java 2.java 849ms 14ms 52.9MB 773ms 150ms openjdk/zgc 21
java 2-m.java 1353ms 17ms 264.4MB 2427ms 100ms graal/jvm 17.0.8

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 81ms 2.0ms 17.2MB 70ms 0ms codon 0.16.3
codon 2.py 110ms 3.4ms 26.0MB 97ms 3ms codon 0.16.3
java 1.java 158ms 3.3ms 67.3MB 207ms 20ms openjdk 23
java 1.java 162ms 8.7ms 64.7MB 203ms 27ms openjdk 21
java 1-m.java 214ms 20ms 137.5MB 287ms 60ms graal/jvm 17.0.8
java 2.java 257ms 0.4ms 49.6MB 293ms 30ms openjdk 23
java 2.java 257ms 3.8ms 49.8MB 313ms 23ms openjdk 21
java 1.java 284ms 4.8ms 63.3MB 210ms 143ms openjdk/zgc 21
java 2.java 365ms 2.0ms 49.3MB 307ms 137ms openjdk/zgc 21
java 2-m.java 582ms 94ms 203.7MB 1050ms 63ms graal/jvm 17.0.8