Codon VS Java benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.0ms 0.6ms 5.1MB 0ms 0ms codon 0.16.2
java 1.java 72ms 3.2ms 61.2MB 70ms 8ms graal/jvm 17.0.7
java 1.java 76ms 1.1ms 41.5MB 76ms 8ms openjdk 22
java 1.java 81ms 4.5ms 39.3MB 78ms 10ms openjdk 20
java 1.java 118ms 5.5ms 38.2MB 74ms 52ms openjdk/zgc 20

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 546ms 4.8ms 87.4MB 567ms 27ms graal/jvm 17.0.7
java 1.java 568ms 7.8ms 40.5MB 577ms 13ms openjdk 20
java 1.java 569ms 5.5ms 43.6MB 580ms 10ms openjdk 22
java 1.java 608ms 2.8ms 41.6MB 577ms 60ms openjdk/zgc 20
java 2.java 1893ms 12ms 514.6MB 1927ms 103ms openjdk 20
java 2.java 1933ms 5.9ms 506.0MB 1947ms 120ms openjdk 22
codon 1.py 1947ms 41ms 7.2MB 1933ms 0ms codon 0.16.2
java 2.java 2609ms 2.3ms 1195.5MB 2063ms 730ms openjdk/zgc 20

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 141ms 3.4ms 84.6MB 173ms 13ms graal/jvm 17.0.7
java 1.java 148ms 3.9ms 40.8MB 160ms 17ms openjdk 20
java 1.java 149ms 5.8ms 41.7MB 163ms 10ms openjdk 22
java 1.java 197ms 7.3ms 41.7MB 167ms 57ms openjdk/zgc 20
codon 1.py 198ms 2.4ms 7.3MB 190ms 0ms codon 0.16.2
java 2.java 424ms 2.6ms 338.1MB 493ms 60ms openjdk 20
java 2.java 425ms 2.7ms 330.8MB 493ms 67ms openjdk 22
java 2.java 762ms 1.2ms 522.5MB 547ms 360ms openjdk/zgc 20

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 682ms 64ms 44.5MB 657ms 10ms codon 0.16.2
java 1.java 694ms 14ms 85.4MB 700ms 23ms openjdk 22
java 1.java 734ms 33ms 84.7MB 750ms 23ms openjdk 20
codon 2.py 911ms 35ms 104.9MB 883ms 13ms codon 0.16.2
java 1.java 970ms 84ms 110.1MB 930ms 87ms openjdk/zgc 20
java 2.java 1000ms 5.3ms 48.9MB 980ms 57ms openjdk/zgc 20
java 2.java 1017ms 8.0ms 51.9MB 1053ms 7ms openjdk 22
java 2.java 1020ms 4.5ms 50.9MB 1043ms 13ms openjdk 20
java 1-m.java 1226ms 33ms 242.1MB 1830ms 90ms graal/jvm 17.0.7
java 2-m.java 1700ms 6.4ms 190.7MB 3000ms 70ms graal/jvm 17.0.7

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 150ms 1.1ms 15.1MB 140ms 0ms codon 0.16.2
codon 2.py 202ms 0.9ms 25.6MB 183ms 7ms codon 0.16.2
java 1.java 240ms 8.0ms 59.6MB 257ms 23ms openjdk 22
java 1.java 241ms 1.4ms 58.8MB 257ms 20ms openjdk 20
java 1.java 290ms 3.0ms 59.3MB 263ms 63ms openjdk/zgc 20
java 2.java 327ms 5.8ms 45.0MB 350ms 17ms openjdk 20
java 2.java 330ms 7.5ms 47.6MB 350ms 17ms openjdk 22
java 1-m.java 339ms 12ms 151.2MB 477ms 40ms graal/jvm 17.0.7
java 2.java 360ms 6.3ms 44.3MB 340ms 53ms openjdk/zgc 20
java 2-m.java 623ms 7.0ms 150.9MB 1083ms 63ms graal/jvm 17.0.7