Programming Language and compiler
Benchmarks

Lua VS Java benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 763ms 6.3ms 409.6MB 760ms 123ms openjdk 19
java 2.java 804ms 74ms 601.4MB 767ms 147ms openjdk 18.0.1
java 2.java 1100ms 12ms 681.2MB 903ms 160ms graal/jvm 17.0.3
java 2.java 1391ms 53ms 1047.4MB 987ms 620ms openjdk/zgc 18.0.1
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 167ms 8.8ms 106.6MB 153ms 40ms openjdk 18.0.1
java 2.java 178ms 3.6ms 107.5MB 177ms 33ms openjdk 19
java 2.java 328ms 2.3ms 235.7MB 187ms 167ms openjdk/zgc 18.0.1
java 2.java 518ms 12ms 169.0MB 247ms 50ms graal/jvm 17.0.3
lua 1.lua 542ms 22ms 25.2MB 523ms 7ms luajit 2.1.0
lua 1.lua 1204ms 6.2ms 17.3MB 1183ms 3ms lua 5.4.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.1ms 0.7ms 2.2MB 0ms 0ms luajit 2.1.0
lua 1.lua 3.1ms 1.1ms 1.1MB 0ms 0ms lua 5.4.4
java 1.java 79ms 1.8ms 61.3MB 73ms 18ms graal/jvm 17.0.3
java 1.java 81ms 2.9ms 38.9MB 82ms 10ms openjdk 18.0.1
java 1.java 85ms 4.6ms 38.3MB 78ms 14ms openjdk 19
java 1.java 131ms 1.4ms 38.7MB 86ms 58ms openjdk/zgc 18.0.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 573ms 6.4ms 366.3MB 573ms 103ms openjdk 18.0.1
java 1.java 575ms 12ms 364.4MB 590ms 83ms openjdk 19
java 1.java 972ms 22ms 447.4MB 777ms 140ms graal/jvm 17.0.3
java 1.java 1041ms 9.3ms 778.4MB 703ms 493ms openjdk/zgc 18.0.1
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 240ms 4.4ms 171.2MB 230ms 63ms openjdk 19
java 1.java 243ms 2.4ms 220.9MB 237ms 53ms openjdk 18.0.1
java 1.java 459ms 21ms 334.9MB 273ms 227ms openjdk/zgc 18.0.1
java 1.java 624ms 24ms 246.2MB 413ms 77ms graal/jvm 17.0.3
lua 1.lua 2331ms 46ms 35.3MB 2293ms 17ms luajit 2.1.0
lua 1.lua 3310ms 64ms 41.5MB 3277ms 20ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 626ms 14ms 40.9MB 643ms 13ms openjdk 18.0.1
java 1.java 628ms 13ms 39.7MB 637ms 17ms openjdk 19
java 1.java 696ms 1.2ms 38.4MB 663ms 53ms openjdk/zgc 18.0.1
java 1.java 891ms 1.3ms 88.1MB 610ms 33ms graal/jvm 17.0.3
lua 4.lua 1120ms 8.4ms 1.1MB 1107ms 0ms luajit 2.1.0
java 2.java 2253ms 3.5ms 526.9MB 2250ms 147ms openjdk 18.0.1
java 2.java 2272ms 9.4ms 508.4MB 2277ms 157ms openjdk 19
java 2.java 3326ms 73ms 1646.8MB 2433ms 1097ms openjdk/zgc 18.0.1
lua 4.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 116ms 1.0ms 1.0MB 100ms 0ms luajit 2.1.0
java 1.java 147ms 1.2ms 39.8MB 163ms 13ms openjdk 19
java 1.java 152ms 7.3ms 40.4MB 157ms 23ms openjdk 18.0.1
java 1.java 205ms 6.2ms 39.8MB 160ms 70ms openjdk/zgc 18.0.1
java 2.java 459ms 12ms 314.1MB 487ms 110ms openjdk 18.0.1
java 1.java 468ms 0.9ms 82.5MB 180ms 30ms graal/jvm 17.0.3
java 2.java 481ms 1.1ms 345.4MB 523ms 103ms openjdk 19
java 2.java 788ms 8.8ms 521.2MB 570ms 370ms openjdk/zgc 18.0.1
lua 4.lua 1449ms 38ms 1.1MB 1433ms 0ms lua 5.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 4400ms 28ms 115.2MB 8420ms 57ms graal/jvm 17.0.3
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 18.0.1
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 18.0.1
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms luajit 2.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 1262ms 17ms 114.8MB 2297ms 53ms graal/jvm 17.0.3
lua 1.lua 1357ms 86ms 2.4MB 1347ms 0ms luajit 2.1.0
java 2-m.java 1651ms 80ms 42.6MB 3087ms 23ms openjdk 19
java 2-m.java 2110ms 38ms 40.7MB 3980ms 13ms openjdk 18.0.1
java 2-m.java 2212ms 31ms 40.7MB 4127ms 67ms openjdk/zgc 18.0.1
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 325ms 27ms 2.4MB 313ms 0ms luajit 2.1.0
java 2-m.java 522ms 28ms 40.2MB 907ms 13ms openjdk 19
java 2-m.java 634ms 6.8ms 39.1MB 1107ms 13ms openjdk 18.0.1
java 2-m.java 710ms 20ms 38.6MB 1183ms 53ms openjdk/zgc 18.0.1
java 2.java 755ms 14ms 104.2MB 733ms 37ms graal/jvm 17.0.3
lua 1.lua timeout 0.0ms 0.0MB 0ms 0ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 579ms 3.1ms 5.0MB 567ms 0ms luajit 2.1.0
java 1.java timeout 0.0ms 0.0MB 0ms 0ms loom 19

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 38ms 2.0ms 3.0MB 27ms 0ms luajit 2.1.0
java 1-m.java 772ms 131ms 108.2MB 1330ms 67ms loom 19