Lua VS Java benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 470ms 7.7ms 638.0MB 577ms 97ms openjdk 23
java 2.java 471ms 26ms 576.1MB 553ms 93ms openjdk 21
java 2-m.java 471ms 4.1ms 646.9MB 670ms 100ms graal/jvm 17.0.8
java 2.java 1177ms 9.4ms 1047.0MB 560ms 777ms openjdk/zgc 21
lua 1.lua 3463ms 70ms 172.8MB 3323ms 123ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 104.9MB 4960ms 27ms lua 5.4.7

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 121ms 3.3ms 98.0MB 150ms 37ms openjdk 23
java 2.java 123ms 1.3ms 167.1MB 143ms 37ms openjdk 21
java 2-m.java 170ms 4.2ms 230.2MB 260ms 47ms graal/jvm 17.0.8
lua 1.lua 286ms 1.1ms 15.9MB 263ms 7ms luajit 2.1.0-beta3
java 2.java 309ms 1.6ms 242.5MB 163ms 200ms openjdk/zgc 21
lua 1.lua 810ms 1.8ms 16.9MB 790ms 0ms lua 5.4.7

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.4ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 1.5ms 0.2ms 2.1MB 0ms 0ms lua 5.4.7
java 1.java 64ms 3.0ms 58.5MB 62ms 24ms graal/jvm 17.0.8
java 1.java 68ms 5.7ms 44.4MB 68ms 20ms openjdk 23
java 1.java 71ms 3.9ms 43.8MB 72ms 22ms openjdk 21
java 1.java 186ms 3.8ms 44.8MB 76ms 136ms openjdk/zgc 21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 401ms 6.3ms 542.1MB 497ms 87ms openjdk 23
java 1.java 413ms 3.8ms 677.9MB 473ms 107ms openjdk 21
java 1-m.java 421ms 36ms 624.4MB 640ms 93ms graal/jvm 17.0.8
java 1.java 1080ms 2.8ms 968.3MB 450ms 743ms openjdk/zgc 21
lua 1.lua timeout 0.0ms 107.4MB 4953ms 33ms lua 5.4.7
lua 1.lua timeout 0.0ms 149.3MB 4933ms 47ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 163ms 0.5ms 158.7MB 240ms 33ms openjdk 23
java 1-m.java 165ms 4.7ms 206.5MB 243ms 30ms openjdk 21
java 1-m.java 218ms 8.1ms 258.5MB 370ms 50ms graal/jvm 17.0.8
java 1.java 415ms 13ms 342.0MB 200ms 287ms openjdk/zgc 21
lua 1.lua 1122ms 32ms 31.0MB 1097ms 10ms luajit 2.1.0-beta3
lua 1.lua 2145ms 2.0ms 28.6MB 2120ms 10ms lua 5.4.7

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 441ms 0.5ms 44.8MB 473ms 17ms openjdk 21
java 1.java 443ms 0.5ms 48.2MB 473ms 20ms openjdk 23
java 1.java 448ms 4.1ms 87.2MB 477ms 33ms graal/jvm 17.0.8
java 1.java 561ms 5.7ms 44.9MB 477ms 143ms openjdk/zgc 21
lua 4.lua 716ms 7.4ms 2.4MB 707ms 0ms luajit 2.1.0-beta3
java 2.java 1229ms 2.7ms 655.9MB 1363ms 70ms openjdk 21
java 2.java 1235ms 8.6ms 756.2MB 1357ms 87ms openjdk 23
java 2.java 3343ms 165ms 2671.0MB 1647ms 1893ms openjdk/zgc 21
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 76ms 2.2ms 2.4MB 67ms 0ms luajit 2.1.0-beta3
java 1.java 112ms 4.9ms 45.5MB 147ms 13ms openjdk 21
java 1.java 119ms 3.9ms 47.9MB 147ms 20ms openjdk 23
java 1.java 124ms 8.9ms 87.2MB 153ms 30ms graal/jvm 17.0.8
java 1.java 239ms 6.7ms 46.6MB 147ms 147ms openjdk/zgc 21
java 2-m.java 296ms 11ms 364.7MB 430ms 60ms openjdk 21
java 2-m.java 307ms 7.8ms 389.9MB 443ms 60ms openjdk 23
java 2.java 699ms 7.2ms 532.4MB 463ms 420ms openjdk/zgc 21
lua 4.lua 1120ms 22ms 2.3MB 1107ms 0ms lua 5.4.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 1961ms 4.4ms 47.6MB 7457ms 33ms openjdk 21
java 2-m.java 1968ms 4.8ms 48.4MB 7473ms 27ms openjdk 23
java 2-m.java 2079ms 15ms 45.4MB 7450ms 147ms openjdk/zgc 21
java 2-m.java 2453ms 9.0ms 99.2MB 8760ms 27ms graal/jvm 17.0.8
lua 1.lua 4052ms 6.0ms 2.5MB 4043ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.5MB 4990ms 0ms lua 5.4.7

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 584ms 3.8ms 48.4MB 2047ms 17ms openjdk 23
java 2-m.java 584ms 2.4ms 47.5MB 2050ms 23ms openjdk 21
java 2-m.java 710ms 3.8ms 47.5MB 2070ms 140ms openjdk/zgc 21
java 2-m.java 739ms 5.6ms 96.7MB 2483ms 43ms graal/jvm 17.0.8
lua 1.lua 1024ms 0.9ms 2.4MB 1010ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 243ms 3.7ms 48.4MB 690ms 17ms openjdk 23
java 2-m.java 252ms 12ms 48.0MB 717ms 23ms openjdk 21
lua 1.lua 258ms 1.0ms 2.3MB 247ms 0ms luajit 2.1.0-beta3
java 2-m.java 281ms 21ms 98.1MB 813ms 33ms graal/jvm 17.0.8
java 2-m.java 358ms 5.7ms 47.1MB 680ms 140ms openjdk/zgc 21
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7