Programming Language and compiler
Benchmarks

Java VS Kotlin benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CPU INFO:[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

show numbers without parallelization

show numbers with parallelization

binarytrees

Input: 18

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1.kt	639ms	9.7ms	412.9MB	660ms	77ms	kotlin/jvm 17.0.2
java	2.java	672ms	7.4ms	412.4MB	670ms	97ms	openjdk 20
java	2.java	673ms	14ms	413.9MB	690ms	80ms	openjdk 22
java	2.java	799ms	50ms	666.8MB	807ms	187ms	graal/jvm 17.0.7
java	2.java	1336ms	56ms	1147.9MB	903ms	630ms	openjdk/zgc 20
kotlin	1.kt	timeout	0.0ms	222.5MB	8533ms	983ms	kotlin/native 1.8.21

Input: 15

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1.kt	132ms	9.9ms	109.4MB	123ms	13ms	kotlin/jvm 17.0.2
java	2.java	165ms	6.2ms	108.9MB	160ms	27ms	openjdk 22
java	2.java	165ms	3.9ms	108.4MB	157ms	33ms	openjdk 20
java	2.java	187ms	9.1ms	164.5MB	217ms	40ms	graal/jvm 17.0.7
java	2.java	298ms	0.3ms	235.9MB	193ms	137ms	openjdk/zgc 20
kotlin	1-m.kt	458ms	8.4ms	30.6MB	813ms	50ms	kotlin/native 1.8.21

edigits

Input: 250001

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1-m.java	814ms	88ms	182.0MB	1423ms	77ms	openjdk 20
java	1-m.java	834ms	39ms	326.2MB	1440ms	113ms	graal/jvm 17.0.7
java	1-m.java	888ms	79ms	197.5MB	1563ms	90ms	openjdk 22
java	1-m.java	1052ms	56ms	468.2MB	1553ms	307ms	openjdk/zgc 20

Input: 100000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1-m.java	383ms	16ms	161.4MB	613ms	53ms	graal/jvm 17.0.7
java	1-m.java	430ms	5.0ms	118.4MB	703ms	33ms	openjdk 22
java	1-m.java	447ms	27ms	115.5MB	730ms	40ms	openjdk 20
java	1-m.java	527ms	17ms	206.2MB	743ms	147ms	openjdk/zgc 20

fannkuch-redux

Input: 11

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1-m.java	1660ms	24ms	92.0MB	3147ms	30ms	graal/jvm 17.0.7
java	1-m.java	1678ms	19ms	43.4MB	3203ms	13ms	openjdk 22
java	1-m.java	1706ms	16ms	42.4MB	3177ms	57ms	openjdk/zgc 20
java	1-m.java	1751ms	60ms	40.7MB	3347ms	10ms	openjdk 20

Input: 10

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1-m.java	275ms	5.3ms	40.7MB	440ms	13ms	openjdk 20
java	1-m.java	283ms	13ms	92.9MB	453ms	20ms	graal/jvm 17.0.7
java	1-m.java	285ms	8.9ms	43.6MB	443ms	17ms	openjdk 22
java	1-m.java	311ms	6.6ms	42.4MB	427ms	53ms	openjdk/zgc 20

fasta

Input: 2500000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	4.java	512ms	6.3ms	41.0MB	587ms	13ms	openjdk 22
java	4.java	521ms	11ms	40.5MB	583ms	17ms	openjdk 20
java	4.java	558ms	4.2ms	40.2MB	583ms	57ms	openjdk/zgc 20
java	4.java	612ms	3.2ms	97.1MB	797ms	27ms	graal/jvm 17.0.7

Input: 250000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	4.java	147ms	14ms	39.8MB	167ms	7ms	openjdk 20
java	4.java	149ms	10ms	40.2MB	170ms	7ms	openjdk 22
java	4.java	158ms	3.6ms	86.0MB	183ms	17ms	graal/jvm 17.0.7
java	4.java	189ms	7.0ms	39.3MB	170ms	50ms	openjdk/zgc 20

helloworld

Input: QwQ

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1.kt	2.2ms	0.6ms	1.5MB	0ms	0ms	kotlin/native 1.8.21
kotlin	1.kt	65ms	4.9ms	40.9MB	50ms	10ms	kotlin/jvm 17.0.2
java	1.java	72ms	3.2ms	61.2MB	70ms	8ms	graal/jvm 17.0.7
java	1.java	76ms	1.1ms	41.5MB	76ms	8ms	openjdk 22
java	1.java	81ms	4.5ms	39.3MB	78ms	10ms	openjdk 20
java	1.java	118ms	5.5ms	38.2MB	74ms	52ms	openjdk/zgc 20

knucleotide

Input: 2500000_in

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	3-m.java	1459ms	35ms	114.5MB	2660ms	40ms	openjdk 20
java	3-m.java	1485ms	8.5ms	114.9MB	2710ms	33ms	openjdk 22
java	3-m.java	1563ms	84ms	169.6MB	2880ms	53ms	graal/jvm 17.0.7
java	3-m.java	1945ms	74ms	171.7MB	3443ms	137ms	openjdk/zgc 20

Input: 250000_in

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	3-m.java	457ms	23ms	84.8MB	763ms	17ms	openjdk 20
java	3-m.java	462ms	17ms	86.8MB	783ms	13ms	openjdk 22
java	3-m.java	465ms	26ms	134.9MB	763ms	43ms	graal/jvm 17.0.7
java	3-m.java	476ms	21ms	94.0MB	710ms	93ms	openjdk/zgc 20

mandelbrot

Input: 5000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1b.java	1411ms	4.8ms	47.7MB	1480ms	20ms	openjdk 22
java	1b.java	1424ms	14ms	47.3MB	1527ms	13ms	openjdk 20
java	1b.java	1458ms	20ms	47.4MB	1507ms	60ms	openjdk/zgc 20
java	1b.java	1470ms	5.7ms	108.0MB	1697ms	27ms	graal/jvm 17.0.7
java	1a.java	1541ms	3.5ms	47.3MB	1613ms	13ms	openjdk 20
java	1a.java	1552ms	5.7ms	48.0MB	1623ms	17ms	openjdk 22
java	1a.java	1557ms	2.6ms	99.4MB	1653ms	17ms	graal/jvm 17.0.7
java	1a.java	1579ms	7.5ms	48.6MB	1623ms	53ms	openjdk/zgc 20
java	1.java	1620ms	3.0ms	205.7MB	1643ms	43ms	openjdk 22
java	1.java	2015ms	21ms	163.3MB	2103ms	33ms	graal/jvm 17.0.7
java	1.java	2133ms	6.2ms	200.5MB	2180ms	40ms	openjdk 20
java	1.java	2521ms	8.8ms	576.8MB	2233ms	397ms	openjdk/zgc 20
java	2.java	timeout	0.0ms	583.5MB	5140ms	137ms	openjdk 20
java	2.java	timeout	0.0ms	535.8MB	5163ms	127ms	openjdk 22
java	2.java	timeout	0.0ms	1758.3MB	4587ms	833ms	openjdk/zgc 20

Input: 1000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1a.java	210ms	9.5ms	44.0MB	257ms	20ms	openjdk 20
java	1a.java	215ms	2.1ms	44.1MB	270ms	10ms	openjdk 22
java	1.java	219ms	11ms	95.5MB	263ms	20ms	openjdk 20
java	1b.java	219ms	8.3ms	43.1MB	267ms	20ms	openjdk 20
java	1b.java	224ms	5.1ms	43.7MB	297ms	10ms	openjdk 22
java	1a.java	234ms	13ms	95.4MB	300ms	20ms	graal/jvm 17.0.7
java	1.java	241ms	10ms	98.0MB	293ms	23ms	openjdk 22
java	1.java	242ms	14ms	101.2MB	313ms	23ms	graal/jvm 17.0.7
java	1b-m.java	250ms	31ms	96.5MB	370ms	27ms	graal/jvm 17.0.7
java	1a.java	251ms	2.6ms	45.6MB	260ms	57ms	openjdk/zgc 20
java	1b.java	266ms	9.2ms	44.9MB	293ms	53ms	openjdk/zgc 20
java	1.java	292ms	13ms	110.2MB	303ms	77ms	openjdk/zgc 20
java	2.java	778ms	33ms	545.6MB	950ms	117ms	openjdk 22
java	2.java	788ms	25ms	566.3MB	973ms	120ms	openjdk 20
java	2.java	1377ms	10ms	1001.3MB	1017ms	643ms	openjdk/zgc 20

merkletrees

Input: 17

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1.kt	451ms	3.4ms	285.9MB	453ms	57ms	kotlin/jvm 17.0.2
java	1.java	512ms	13ms	287.9MB	523ms	67ms	openjdk 22
java	1.java	521ms	6.6ms	286.6MB	533ms	67ms	openjdk 20
java	1.java	573ms	65ms	370.7MB	733ms	83ms	graal/jvm 17.0.7
java	1.java	957ms	46ms	764.8MB	643ms	447ms	openjdk/zgc 20
kotlin	1-m.kt	2659ms	202ms	142.4MB	4287ms	450ms	kotlin/native 1.8.21

Input: 15

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1.kt	178ms	0.4ms	221.7MB	157ms	47ms	kotlin/jvm 17.0.2
java	1.java	230ms	13ms	223.6MB	233ms	47ms	openjdk 22
java	1.java	233ms	11ms	222.5MB	247ms	43ms	openjdk 20
java	1-m.java	269ms	18ms	279.1MB	370ms	57ms	graal/jvm 17.0.7
java	1.java	433ms	5.6ms	346.0MB	257ms	217ms	openjdk/zgc 20
kotlin	1-m.kt	474ms	3.2ms	38.4MB	753ms	73ms	kotlin/native 1.8.21

nbody

Input: 5000000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1n.kt	532ms	5.2ms	1.5MB	517ms	0ms	kotlin/native 1.8.21
java	1.java	546ms	4.8ms	87.4MB	567ms	27ms	graal/jvm 17.0.7
java	1.java	568ms	7.8ms	40.5MB	577ms	13ms	openjdk 20
java	1.java	569ms	5.5ms	43.6MB	580ms	10ms	openjdk 22
kotlin	1.kt	576ms	4.4ms	42.8MB	577ms	17ms	kotlin/jvm 17.0.2
java	1.java	608ms	2.8ms	41.6MB	577ms	60ms	openjdk/zgc 20
java	2.java	1893ms	12ms	514.6MB	1927ms	103ms	openjdk 20
java	2.java	1933ms	5.9ms	506.0MB	1947ms	120ms	openjdk 22
java	2.java	2609ms	2.3ms	1195.5MB	2063ms	730ms	openjdk/zgc 20

Input: 500000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1n.kt	55ms	0.1ms	1.5MB	50ms	0ms	kotlin/native 1.8.21
java	1.java	141ms	3.4ms	84.6MB	173ms	13ms	graal/jvm 17.0.7
java	1.java	148ms	3.9ms	40.8MB	160ms	17ms	openjdk 20
kotlin	1.kt	148ms	2.5ms	43.4MB	150ms	10ms	kotlin/jvm 17.0.2
java	1.java	149ms	5.8ms	41.7MB	163ms	10ms	openjdk 22
java	1.java	197ms	7.3ms	41.7MB	167ms	57ms	openjdk/zgc 20
java	2.java	424ms	2.6ms	338.1MB	493ms	60ms	openjdk 20
java	2.java	425ms	2.7ms	330.8MB	493ms	67ms	openjdk 22
java	2.java	762ms	1.2ms	522.5MB	547ms	360ms	openjdk/zgc 20

nsieve

Input: 12

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1.java	694ms	14ms	85.4MB	700ms	23ms	openjdk 22
java	1.java	734ms	33ms	84.7MB	750ms	23ms	openjdk 20
java	1.java	970ms	84ms	110.1MB	930ms	87ms	openjdk/zgc 20
java	2.java	1000ms	5.3ms	48.9MB	980ms	57ms	openjdk/zgc 20
java	2.java	1017ms	8.0ms	51.9MB	1053ms	7ms	openjdk 22
java	2.java	1020ms	4.5ms	50.9MB	1043ms	13ms	openjdk 20
java	1-m.java	1226ms	33ms	242.1MB	1830ms	90ms	graal/jvm 17.0.7
java	2-m.java	1700ms	6.4ms	190.7MB	3000ms	70ms	graal/jvm 17.0.7

Input: 10

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1.java	240ms	8.0ms	59.6MB	257ms	23ms	openjdk 22
java	1.java	241ms	1.4ms	58.8MB	257ms	20ms	openjdk 20
java	1.java	290ms	3.0ms	59.3MB	263ms	63ms	openjdk/zgc 20
java	2.java	327ms	5.8ms	45.0MB	350ms	17ms	openjdk 20
java	2.java	330ms	7.5ms	47.6MB	350ms	17ms	openjdk 22
java	1-m.java	339ms	12ms	151.2MB	477ms	40ms	graal/jvm 17.0.7
java	2.java	360ms	6.3ms	44.3MB	340ms	53ms	openjdk/zgc 20
java	2-m.java	623ms	7.0ms	150.9MB	1083ms	63ms	graal/jvm 17.0.7

pidigits

Input: 8000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1.java	4975ms	15ms	338.9MB	5350ms	67ms	graal/jvm 17.0.7
java	1.java	timeout	0.0ms	299.0MB	5433ms	90ms	openjdk 20
java	1.java	timeout	0.0ms	285.3MB	5593ms	80ms	openjdk 22
java	1.java	timeout	0.0ms	1177.0MB	5083ms	597ms	openjdk/zgc 20
kotlin	1.kt	timeout	0.0ms	235.7MB	5407ms	70ms	kotlin/jvm 17.0.2
kotlin	1n.kt	timeout	0.0ms	22.7MB	6417ms	167ms	kotlin/native 1.8.21
kotlin	2n.kt	timeout	0.0ms	8.2MB	5040ms	90ms	kotlin/native 1.8.21

Input: 4000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	1.java	1328ms	19ms	352.8MB	1673ms	63ms	graal/jvm 17.0.7
java	1.java	1448ms	18ms	250.9MB	1840ms	73ms	openjdk 20
kotlin	1.kt	1452ms	7.6ms	216.7MB	1817ms	63ms	kotlin/jvm 17.0.2
java	1.java	1460ms	5.9ms	305.3MB	1907ms	63ms	openjdk 22
java	1.java	1985ms	21ms	968.9MB	1903ms	623ms	openjdk/zgc 20
kotlin	1n.kt	timeout	0.0ms	26.7MB	6497ms	150ms	kotlin/native 1.8.21
kotlin	2n.kt	timeout	0.0ms	10.6MB	5027ms	107ms	kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	3.java	timeout	0.0ms	250.5MB	5317ms	63ms	graal/jvm 17.0.7
java	3.java	timeout	0.0ms	204.5MB	5253ms	63ms	openjdk 20
java	3.java	timeout	0.0ms	228.0MB	5277ms	57ms	openjdk 22
java	3.java	timeout	0.0ms	331.8MB	4970ms	223ms	openjdk/zgc 20
kotlin	1.kt	timeout	0.0ms	161.2MB	5350ms	40ms	kotlin/jvm 17.0.2
kotlin	1n.kt	timeout	0.0ms	277.0MB	5783ms	483ms	kotlin/native 1.8.21

Input: 250000_in

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	3.java	1019ms	5.8ms	167.1MB	1397ms	50ms	graal/jvm 17.0.7
java	3.java	1043ms	13ms	98.4MB	1397ms	27ms	openjdk 22
java	3.java	1066ms	8.2ms	111.9MB	1410ms	23ms	openjdk 20
kotlin	1.kt	1078ms	2.1ms	91.3MB	1450ms	23ms	kotlin/jvm 17.0.2
java	3.java	1170ms	23ms	156.7MB	1343ms	123ms	openjdk/zgc 20
kotlin	1n.kt	4483ms	22ms	65.0MB	5897ms	23ms	kotlin/native 1.8.21

spectral-norm

Input: 8000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	2-m.java	4198ms	143ms	90.9MB	8130ms	17ms	graal/jvm 17.0.7
java	2-m.java	4416ms	29ms	45.5MB	8555ms	15ms	openjdk 22
java	2.java	timeout	0.0ms	40.2MB	9730ms	13ms	openjdk 20
java	2.java	timeout	0.0ms	42.4MB	9590ms	40ms	openjdk/zgc 20

Input: 4000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	2-m.java	1192ms	17ms	43.5MB	2213ms	13ms	openjdk 22
java	2-m.java	1208ms	38ms	91.5MB	2243ms	20ms	graal/jvm 17.0.7
java	2-m.java	1701ms	17ms	40.6MB	3223ms	3ms	openjdk 20
java	2-m.java	1845ms	184ms	40.3MB	3417ms	60ms	openjdk/zgc 20

Input: 2000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
java	2-m.java	418ms	13ms	43.6MB	710ms	7ms	openjdk 22
java	2-m.java	435ms	10ms	93.6MB	717ms	33ms	graal/jvm 17.0.7
java	2-m.java	595ms	5.3ms	40.9MB	1060ms	10ms	openjdk 20
java	2-m.java	638ms	37ms	42.3MB	1057ms	57ms	openjdk/zgc 20

coro-prime-sieve

Input: 4000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1.kt	2859ms	35ms	159.4MB	3670ms	50ms	kotlin/jvm 17.0.2
kotlin	2-m.kt	3154ms	425ms	183.1MB	5987ms	73ms	kotlin/jvm 17.0.2
java	1.java	timeout	0.0ms	142.9MB	9613ms	87ms	openjdk 20
java	1.java	timeout	0.0ms	146.5MB	9657ms	77ms	openjdk 22
java	1.java	timeout	0.0ms	931.7MB	9253ms	423ms	openjdk/zgc 20
kotlin	1.kt	timeout	0.0ms	10.8MB	6413ms	250ms	kotlin/native 1.8.21
kotlin	2-m.kt	timeout	0.0ms	33.2MB	9280ms	163ms	kotlin/native 1.8.21

Input: 1000

lang	code	time	stddev	peak-mem mem	time(user)	time(sys)	compiler compiler/runtime
kotlin	1-m.kt	691ms	31ms	100.3MB	1217ms	37ms	kotlin/jvm 17.0.2
java	1-m.java	796ms	16ms	113.4MB	1413ms	57ms	openjdk 20
kotlin	2-m.kt	875ms	33ms	25.1MB	1567ms	33ms	kotlin/native 1.8.21
java	1-m.java	887ms	100ms	102.5MB	1617ms	37ms	openjdk 22
java	1-m.java	899ms	17ms	206.7MB	1447ms	160ms	openjdk/zgc 20
kotlin	2-m.kt	1011ms	63ms	97.7MB	1837ms	37ms	kotlin/jvm 17.0.2
kotlin	1.kt	1033ms	12ms	8.8MB	1310ms	50ms	kotlin/native 1.8.21