feat: ScanPerf objective in sampling compressor #1068
+561
−378
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Vortex bytes_at
| Benchmark suite | Current: dc987c7 | Previous: c1cee33 | Ratio |
|---|---|---|---|
bytes_at/array_data |
744.9405716850827 ns (1.1383499515666813) |
775.6118839714973 ns (0.9937622936375874) |
0.96 |
bytes_at/array_view |
534.2727665617807 ns (0.6763141825526873) |
543.4684647416859 ns (0.8252923547032651) |
0.98 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
DataFusion
| Benchmark suite | Current: dc987c7 | Previous: c1cee33 | Ratio |
|---|---|---|---|
arrow/planning |
766727.8498683104 ns (1368.4943376347655) |
764650.3614937436 ns (1304.172342669277) |
1.00 |
arrow/exec |
1348848.0960750328 ns (2111.5239098756574) |
1335917.2935235286 ns (5271.0427332231775) |
1.01 |
vortex-pushdown-compressed/planning |
478158.4619219925 ns (2394.164681873808) |
472785.5267447528 ns (1910.9006836801418) |
1.01 |
vortex-pushdown-compressed/exec |
3322000.389999999 ns (13891.329066666774) |
2500102.6895000003 ns (11231.593043750385) |
1.33 |
vortex-pushdown-uncompressed/planning |
477182.7185614971 ns (2079.3654284911754) |
474078.5910658773 ns (880.867603579798) |
1.01 |
vortex-pushdown-uncompressed/exec |
2563275.4930000002 ns (5399.225106249796) |
2907701.167222223 ns (5542.9613958320115) |
0.88 |
vortex-nopushdown-compressed/planning |
784063.1541270247 ns (3390.2446551582543) |
782596.969157242 ns (1407.7445595603203) |
1.00 |
vortex-nopushdown-compressed/exec |
3509206.3060000003 ns (46451.03447499941) |
2934958.965 ns (20906.028979166644) |
1.20 |
vortex-nopushdown-uncompressed/planning |
780391.437909435 ns (1501.4083696135785) |
778858.2626122492 ns (1572.181782282947) |
1.00 |
vortex-nopushdown-uncompressed/exec |
4978383.258181816 ns (24723.995068182237) |
4466286.363333335 ns (9392.727322918363) |
1.11 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Random Access
| Benchmark suite | Current: dc987c7 | Previous: c1cee33 | Ratio |
|---|---|---|---|
random-access/vortex-tokio-local-disk |
18390063.366666663 ns (60427.80900000036) |
18351892.22333333 ns (74755.44233332947) |
1.00 |
random-access/vortex-local-fs |
20119175.19333333 ns (78526.43791666813) |
19546286.75999999 ns (55486.97500000149) |
1.03 |
random-access/parquet-tokio-local-disk |
225845067.63333336 ns (3516655.782499969) |
213564154.5 ns (3185410.886250019) |
1.06 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
TPC-H
| Benchmark suite | Current: dc987c7 | Previous: c1cee33 | Ratio |
|---|---|---|---|
tpch_q1/vortex-in-memory-no-pushdown |
565732828.3 ns (6346691.050000012) |
574361578.1 ns (5622885.751250029) |
0.98 |
tpch_q1/vortex-in-memory-pushdown |
453979785.25 ns (1856318.8337500095) |
459968376.5 ns (2020408.1499999762) |
0.99 |
tpch_q1/arrow |
541208468.6 ns (4542086.300000012) |
563784254 ns (3500541.707499981) |
0.96 |
tpch_q1/parquet |
679875114.7 ns (2373312.699999988) |
704917910.8 ns (2165428.9162499905) |
0.96 |
tpch_q1/vortex-file-compressed |
493291073.65 ns (2932290.454374999) |
506475189.1 ns (3576931.401250005) |
0.97 |
tpch_q1/vortex-file-uncompressed |
525044218.6 ns (1921968.25) |
542694070.1 ns (2846584.5950000286) |
0.97 |
tpch_q2/vortex-in-memory-no-pushdown |
117904814.83853176 ns (528875.8944181725) |
121659389.99611111 ns (840562.5608333349) |
0.97 |
tpch_q2/vortex-in-memory-pushdown |
117134517.8925397 ns (971269.3709851205) |
119727465.60218254 ns (632676.2686111033) |
0.98 |
tpch_q2/arrow |
115986456.8897222 ns (405483.84750694036) |
119706675.13956349 ns (1062046.824217759) |
0.97 |
tpch_q2/parquet |
145167866.00412697 ns (650771.5400873125) |
148885088.5601984 ns (1233637.8701497912) |
0.98 |
tpch_q2/vortex-file-compressed |
158745795.88789684 ns (2128224.8148392886) |
168934413.66555554 ns (3156637.121236101) |
0.94 |
tpch_q2/vortex-file-uncompressed |
159112541.5777381 ns (1091883.9734464139) |
166282442.21039683 ns (1260544.6573809534) |
0.96 |
tpch_q3/vortex-in-memory-no-pushdown |
158572941.99777776 ns (1015960.798333332) |
160935109.1389286 ns (1025473.2068154514) |
0.99 |
tpch_q3/vortex-in-memory-pushdown |
179486164.31988096 ns (2781860.079389885) |
182020502.53333336 ns (1500014.8666666597) |
0.99 |
tpch_q3/arrow |
144678092.59464285 ns (559343.9755118787) |
149581345.32297617 ns (758954.842392847) |
0.97 |
tpch_q3/parquet |
331877796.55 ns (2089114.833125025) |
339499678.35 ns (2151097.020624995) |
0.98 |
tpch_q3/vortex-file-compressed |
285937686.2 ns (2456495.854375005) |
288143112.45 ns (1284942.5150000155) |
0.99 |
tpch_q3/vortex-file-uncompressed |
258295515.25 ns (1081430.775000006) |
265749740.65 ns (1108326.7493750006) |
0.97 |
tpch_q4/vortex-in-memory-no-pushdown |
110000285.29908732 ns (479202.5728447512) |
112512766.10063493 ns (365043.8728551492) |
0.98 |
tpch_q4/vortex-in-memory-pushdown |
128322734.16944444 ns (1086324.3455486) |
131687725.1663492 ns (455131.4506349191) |
0.97 |
tpch_q4/arrow |
178173821.314246 ns (1088245.2529255897) |
184952503.06666666 ns (664425.7166666687) |
0.96 |
tpch_q4/parquet |
200217702.90000004 ns (546236.1799999923) |
207004328.06666666 ns (999671.7870833278) |
0.97 |
tpch_q4/vortex-file-compressed |
235373657.03333336 ns (1484486.3733333498) |
241718447.9 ns (938776.0666666776) |
0.97 |
tpch_q4/vortex-file-uncompressed |
234079061.36666664 ns (313190.8941666633) |
241201233.83333334 ns (1285668.5833333284) |
0.97 |
tpch_q5/vortex-in-memory-no-pushdown |
270156240.45 ns (1678157.2287499905) |
295978497.7 ns (3031694.881250024) |
0.91 |
tpch_q5/vortex-in-memory-pushdown |
276458301.95 ns (1837690.84375) |
289372781.3 ns (1788862.0243749619) |
0.96 |
tpch_q5/arrow |
263271025.2 ns (3086322.7974999994) |
267714411.95 ns (1554802.5368750244) |
0.98 |
tpch_q5/parquet |
429338318.75 ns (3736940.6962500215) |
437866959 ns (2577767.7962500155) |
0.98 |
tpch_q5/vortex-file-compressed |
360722069.85 ns (5721166.835000008) |
377990232.55 ns (2545604.7274999917) |
0.95 |
tpch_q5/vortex-file-uncompressed |
344609179.7 ns (3131661.4418750107) |
361029988.45 ns (3752365.410624981) |
0.95 |
tpch_q6/vortex-in-memory-no-pushdown |
34949540.97489418 ns (154081.3090181835) |
35998164.820978835 ns (298991.6685003303) |
0.97 |
tpch_q6/vortex-in-memory-pushdown |
72241805.72986111 ns (120897.5612777695) |
77151348.0332738 ns (295305.74695685506) |
0.94 |
tpch_q6/arrow |
25658322.759265874 ns (512572.83809523657) |
25939547.356140874 ns (146538.06640438922) |
0.99 |
tpch_q6/parquet |
136815972.2209127 ns (894040.2277579308) |
138906406.16015872 ns (428826.2976716161) |
0.98 |
tpch_q6/vortex-file-compressed |
22900669.79577381 ns (398426.2451934498) |
21139692.745357145 ns (434169.84309880994) |
1.08 |
tpch_q6/vortex-file-uncompressed |
241926083.76666665 ns (695389.8079167008) |
249378556.1 ns (426915.3724999726) |
0.97 |
tpch_q7/vortex-in-memory-no-pushdown |
550702115.9 ns (13350968.533750057) |
552228669.6 ns (7218375.121249974) |
1.00 |
tpch_q7/vortex-in-memory-pushdown |
562917407.2 ns (5114655.946249962) |
592532197.4 ns (5969838.256249964) |
0.95 |
tpch_q7/arrow |
525165635.1 ns (4463326.339999974) |
541493343 ns (3615244.023750007) |
0.97 |
tpch_q7/parquet |
647691198.9 ns (4960476.877499938) |
667079309.8 ns (3727451.0412499905) |
0.97 |
tpch_q7/vortex-file-compressed |
676322119.4 ns (4294579.200000048) |
691380754.9 ns (6904383.977500021) |
0.98 |
tpch_q7/vortex-file-uncompressed |
661958977.6 ns (6609149.990000069) |
698855510.3 ns (8896098.501250029) |
0.95 |
tpch_q8/vortex-in-memory-no-pushdown |
219989302.4666667 ns (1343434.655000016) |
224058723.5333333 ns (1215247.1887500435) |
0.98 |
tpch_q8/vortex-in-memory-pushdown |
227390491.33333334 ns (521193.3166666776) |
229571543.36666664 ns (1582875.0737500042) |
0.99 |
tpch_q8/arrow |
207961159.36666664 ns (1924764.1716666669) |
207849240.03333333 ns (729107.2754166573) |
1.00 |
tpch_q8/parquet |
476211870.6 ns (2849529.7693749964) |
490924484.6 ns (4300299.681249976) |
0.97 |
tpch_q8/vortex-file-compressed |
303922905.35 ns (2020541.9918750226) |
315710088.35 ns (2391013.9681250155) |
0.96 |
tpch_q8/vortex-file-uncompressed |
299207779.95 ns (2718202.007499993) |
303766104.65 ns (1714386.7762500048) |
0.98 |
tpch_q9/vortex-in-memory-no-pushdown |
396589060.6 ns (2349392.3012500107) |
433660361.3 ns (3663016.5881249905) |
0.91 |
tpch_q9/vortex-in-memory-pushdown |
401888830.9 ns (2759975.5) |
415647445.15 ns (2735231.0068750083) |
0.97 |
tpch_q9/arrow |
392023731.55 ns (7092041.365625024) |
405977315.25 ns (3310920.1318749785) |
0.97 |
tpch_q9/parquet |
685906681.4 ns (5307987.098749995) |
706439860.6 ns (6133038.657499969) |
0.97 |
tpch_q9/vortex-file-compressed |
482239461.9 ns (6565840.231875002) |
505073167.3 ns (6276582.548749983) |
0.95 |
tpch_q9/vortex-file-uncompressed |
470668537.6 ns (6342124.403125018) |
475427983.35 ns (5717167.263125002) |
0.99 |
tpch_q10/vortex-in-memory-no-pushdown |
268494153.75 ns (1509051.923750013) |
277425460.75 ns (1317243.4118750095) |
0.97 |
tpch_q10/vortex-in-memory-pushdown |
294422253.85 ns (1341114.724999994) |
311973734.05 ns (2075785.7400000095) |
0.94 |
tpch_q10/arrow |
260576916.65 ns (4690881.25) |
272938001.65 ns (986864.7768750191) |
0.95 |
tpch_q10/parquet |
489441726 ns (2288079.469999999) |
500908784.2 ns (3076597.6575000286) |
0.98 |
tpch_q10/vortex-file-compressed |
417808150.75 ns (1230884.4675000012) |
436540415.35 ns (2996633.395625025) |
0.96 |
tpch_q10/vortex-file-uncompressed |
407482022.35 ns (2635702.055000007) |
428627481.3 ns (2454628.625) |
0.95 |
tpch_q11/vortex-in-memory-no-pushdown |
174306067.1698016 ns (362187.2219017893) |
183548403.7 ns (925194.5399999917) |
0.95 |
tpch_q11/vortex-in-memory-pushdown |
175556630.92904764 ns (1755617.2661904842) |
180569145.1593651 ns (810408.1831745952) |
0.97 |
tpch_q11/arrow |
173357930.73218256 ns (1837544.9529598206) |
180027770.02031744 ns (1602949.2837996036) |
0.96 |
tpch_q11/parquet |
180961276.18142858 ns (639719.3541785777) |
186298390.8333333 ns (760659.7333333343) |
0.97 |
tpch_q11/vortex-file-compressed |
257968611.1 ns (2344836.0849999934) |
276707604.7 ns (3756048.083124995) |
0.93 |
tpch_q11/vortex-file-uncompressed |
256712911.25 ns (2416986.3681250066) |
265437908.75 ns (3004114.2162500024) |
0.97 |
tpch_q12/vortex-in-memory-no-pushdown |
233986162.4666667 ns (2054138.5537499785) |
231280566.43333334 ns (416894.46666668355) |
1.01 |
tpch_q12/vortex-in-memory-pushdown |
253013120.75 ns (910635.7918750048) |
254998240.85 ns (1180738.3681250066) |
0.99 |
tpch_q12/arrow |
187291289.46666664 ns (798109.8666666746) |
187828197.40000004 ns (430588.7025000453) |
1.00 |
tpch_q12/parquet |
335972415.55 ns (1292430.675000012) |
339626687.95 ns (1730623.5543749928) |
0.99 |
tpch_q12/vortex-file-compressed |
446291298.25 ns (1440576.375) |
457245040.1 ns (1606463.3406250179) |
0.98 |
tpch_q12/vortex-file-uncompressed |
431682599.15 ns (2528923.1881249845) |
437019300.4 ns (1497133.6774999797) |
0.99 |
tpch_q13/vortex-in-memory-no-pushdown |
173464980.00964287 ns (3386276.516174093) |
173278002.95650792 ns (1095501.4760843366) |
1.00 |
tpch_q13/vortex-in-memory-pushdown |
172082171.41178572 ns (4625494.662352681) |
181786160.27801588 ns (3767920.4386755973) |
0.95 |
tpch_q13/arrow |
162536094.75472224 ns (2365949.0258159637) |
174765746.5049603 ns (5323639.53160961) |
0.93 |
tpch_q13/parquet |
325162242.7 ns (5355904.170625001) |
334920347.3 ns (5053259.73999998) |
0.97 |
tpch_q13/vortex-file-compressed |
204250680.36666664 ns (3932628.6762500107) |
199797977.9333333 ns (1091901.750000015) |
1.02 |
tpch_q13/vortex-file-uncompressed |
198655629.06666666 ns (1754944.9783333242) |
200606026.6 ns (1719196.1225000024) |
0.99 |
tpch_q14/vortex-in-memory-no-pushdown |
45667014.824960314 ns (401445.9691567458) |
47860372.74263889 ns (436939.2135763839) |
0.95 |
tpch_q14/vortex-in-memory-pushdown |
77651814.36619046 ns (702341.3362380862) |
79330758.58674604 ns (367643.1660118997) |
0.98 |
tpch_q14/arrow |
34918899.66275132 ns (863564.3041884936) |
36020440.593029104 ns (653681.8256329373) |
0.97 |
tpch_q14/parquet |
227557241.2 ns (735453.142083332) |
228174754.53333336 ns (746933.5833333433) |
1.00 |
tpch_q14/vortex-file-compressed |
122484217.96126983 ns (1251122.3456726074) |
129726626.0345238 ns (578917.0980952382) |
0.94 |
tpch_q14/vortex-file-uncompressed |
143680386.8102778 ns (913282.6879895926) |
145648511.60702384 ns (462011.50912053883) |
0.99 |
tpch_q15/vortex-in-memory-no-pushdown |
71223114.9844246 ns (818021.2817857116) |
74593990.39625 ns (442379.61985415965) |
0.95 |
tpch_q15/vortex-in-memory-pushdown |
110910783.08757937 ns (493571.8706815541) |
111960424.62551586 ns (582171.6678338349) |
0.99 |
tpch_q15/arrow |
57061837.74515873 ns (426281.98314980045) |
59727038.545079365 ns (972077.3337648809) |
0.96 |
tpch_q15/parquet |
297267901.25 ns (1185505.3412500024) |
303022773 ns (1696577.1206249595) |
0.98 |
tpch_q15/vortex-file-compressed |
243434343.35 ns (962173.2443750054) |
252642311.6 ns (1864722.006249994) |
0.96 |
tpch_q15/vortex-file-uncompressed |
279424457.25 ns (1146538.9506250322) |
286325306.5 ns (1364904.1837500036) |
0.98 |
tpch_q16/vortex-in-memory-no-pushdown |
107091639.81238094 ns (628335.0191726163) |
106906735.07083334 ns (435355.9698958397) |
1.00 |
tpch_q16/vortex-in-memory-pushdown |
120082388.12742063 ns (1577331.9084890932) |
118493640.3970635 ns (384740.54855655134) |
1.01 |
tpch_q16/arrow |
106309451.79083332 ns (967918.539291665) |
106326948.2149603 ns (855174.9965248033) |
1.00 |
tpch_q16/parquet |
118470344.69158728 ns (1818024.5602301583) |
118702630.45321426 ns (408275.56158928573) |
1.00 |
tpch_q16/vortex-file-compressed |
125557441.62138888 ns (786615.674166657) |
132279480.72805557 ns (619451.4893263802) |
0.95 |
tpch_q16/vortex-file-uncompressed |
130059486.4479762 ns (527651.7304166779) |
131386755.42321427 ns (657566.4219181389) |
0.99 |
tpch_q17/vortex-in-memory-no-pushdown |
528810975.6 ns (9453785.800000012) |
562625959.6 ns (3536085.4137499332) |
0.94 |
tpch_q17/vortex-in-memory-pushdown |
628114146.7 ns (34437661.318750024) |
648358421 ns (9541726.36499995) |
0.97 |
tpch_q17/arrow |
502876469.9 ns (7090327.09375) |
542208296.9 ns (3441288.1575000286) |
0.93 |
tpch_q17/parquet |
642950952.7 ns (3888119.120000005) |
634489370.6 ns (4873122.673749983) |
1.01 |
tpch_q17/vortex-file-compressed |
614353321 ns (4921362.310000002) |
620067086 ns (6032196.686249971) |
0.99 |
tpch_q17/vortex-file-uncompressed |
606902178.9 ns (4756399.75) |
610907585.5 ns (4721440.75) |
0.99 |
tpch_q18/vortex-in-memory-no-pushdown |
1061443703.3 ns (6314806.877499998) |
1099050399.2 ns (17677134.88625002) |
0.97 |
tpch_q18/vortex-in-memory-pushdown |
1049371329.2 ns (8211202.935000062) |
1118002223.1 ns (19961671.400000095) |
0.94 |
tpch_q18/arrow |
1091017194.6 ns (26424236.049999952) |
1074333527.3 ns (9292122.199999928) |
1.02 |
tpch_q18/parquet |
1266882555.8 ns (18713290.299999952) |
1244843080.6 ns (16390404.422499895) |
1.02 |
tpch_q18/vortex-file-compressed |
1195727312.6 ns (16701655.388749957) |
1170654160.1 ns (12660714.293749928) |
1.02 |
tpch_q18/vortex-file-uncompressed |
1145261123.3 ns (23930547.350000024) |
1117079941.1 ns (6960608.799999952) |
1.03 |
tpch_q19/vortex-in-memory-no-pushdown |
180876228.73785713 ns (425851.41630654037) |
183281494.96666667 ns (252045.16916666925) |
0.99 |
tpch_q19/vortex-in-memory-pushdown |
250052543.63333336 ns (883262.0316666812) |
262322524.1 ns (290778.85437500477) |
0.95 |
tpch_q19/arrow |
169278172.55444443 ns (1219002.1928402781) |
165468420.94373018 ns (395616.4234136939) |
1.02 |
tpch_q19/parquet |
456797871.75 ns (3004438.8224999905) |
459746212.9 ns (1338008.6599999964) |
0.99 |
tpch_q19/vortex-file-compressed |
539466583.2 ns (9461727.243749976) |
444613783.25 ns (2523681.474999994) |
1.21 |
tpch_q19/vortex-file-uncompressed |
506748879.2 ns (7489240.949999988) |
423751195.1 ns (2427865.099999994) |
1.20 |
tpch_q20/vortex-in-memory-no-pushdown |
361533495.15 ns (10758483.92750004) |
245146419.70000005 ns (839579.0504166633) |
1.47 |
tpch_q20/vortex-in-memory-pushdown |
395173115 ns (4135091.823750019) |
265786013 ns (1785792.674999997) |
1.49 |
tpch_q20/arrow |
351619393.5 ns (7796678.472499996) |
238426390.3666667 ns (4754672.725833356) |
1.47 |
tpch_q20/parquet |
489235558.45 ns (7496473.094999999) |
369186545.7 ns (1218413.8618749678) |
1.33 |
tpch_q20/vortex-file-compressed |
558136505.7 ns (16793835.899999976) |
379941725.55 ns (4494982.028750002) |
1.47 |
tpch_q20/vortex-file-uncompressed |
536804269.4 ns (8235273.066249996) |
384154608.5 ns (2534459.175625026) |
1.40 |
tpch_q21/vortex-in-memory-no-pushdown |
1298801633.3 ns (18813446.006250024) |
899542382.5 ns (5328370.699999988) |
1.44 |
tpch_q21/vortex-in-memory-pushdown |
1324951494.5 ns (24298983.793750048) |
936224434.5 ns (6092560.061249971) |
1.42 |
tpch_q21/arrow |
1290496586.9 ns (22771729.149999976) |
871368845.8 ns (4011212.1375000477) |
1.48 |
tpch_q21/parquet |
1400361621.8 ns (27800402.299999952) |
1004554618.1 ns (4418399.949999988) |
1.39 |
tpch_q21/vortex-file-compressed |
1666897632 ns (15196320.75) |
1191474317.6 ns (9930319.694999933) |
1.40 |
tpch_q21/vortex-file-uncompressed |
1711363373 ns (10087327.487500072) |
1159036764.5 ns (6485052.5) |
1.48 |
tpch_q22/vortex-in-memory-no-pushdown |
94935138.90761904 ns (1443307.7636071295) |
77333168.21593253 ns (159026.79471205175) |
1.23 |
tpch_q22/vortex-in-memory-pushdown |
95790848.81472223 ns (2087422.382663183) |
77246183.81472223 ns (277057.03086805344) |
1.24 |
tpch_q22/arrow |
92479704.04555556 ns (2568194.801083334) |
75597912.80906746 ns (114875.81529761106) |
1.22 |
tpch_q22/parquet |
130014697.57511905 ns (3183000.1806741133) |
93871933.01916666 ns (432988.05366666615) |
1.39 |
tpch_q22/vortex-file-compressed |
158347303.64142856 ns (1789258.762202382) |
120708992.99452381 ns (885822.8922559619) |
1.31 |
tpch_q22/vortex-file-uncompressed |
152238601.13166666 ns (3315656.248208329) |
118225931.52329366 ns (460137.30935516953) |
1.29 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Vortex Compression
| Benchmark suite | Current: dc987c7 | Previous: c1cee33 | Ratio |
|---|---|---|---|
compress time/taxi |
1252549532.7 ns (2899589.25) |
1295362143.3 ns (2166932.399999976) |
0.97 |
compress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
parquet_rs-zstd compress time/taxi |
1781547010.4 ns (3277841.2350000143) |
1822095921.3 ns (3020737.4512500763) |
0.98 |
parquet_rs-zstd compress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
decompress time/taxi |
429227533.75 ns (2812967.095625013) |
409808158.05 ns (1722490.540625006) |
1.05 |
decompress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
parquet_rs-zstd decompress time/taxi |
309015418.3 ns (845066.2099999785) |
308466848.65 ns (427431.53687500954) |
1.00 |
parquet_rs-zstd decompress time/taxi throughput |
470808924 bytes |
470808924 bytes |
1 |
vortex:parquet-zstd size/taxi |
1.072177332672633 ratio |
1.0299843765663863 ratio |
1.04 |
vortex:raw size/taxi |
0.12744059201392707 ratio |
0.12242495216594493 ratio |
1.04 |
vortex size/taxi |
60000168 bytes |
57638760 bytes |
1.04 |
compress time/AirlineSentiment |
846761.2602469135 ns (2632.1013057485106) |
824226.5720406121 ns (877.1890923065948) |
1.03 |
compress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
parquet_rs-zstd compress time/AirlineSentiment |
56836.366798122835 ns (185.7449139218952) |
57545.62648714681 ns (229.42584627948236) |
0.99 |
parquet_rs-zstd compress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
decompress time/AirlineSentiment |
44535.717182578584 ns (135.96899645969825) |
44286.91494018808 ns (164.4529665099326) |
1.01 |
decompress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
parquet_rs-zstd decompress time/AirlineSentiment |
33524.54177470852 ns (72.56240895232986) |
33131.548060163754 ns (106.07892718463336) |
1.01 |
parquet_rs-zstd decompress time/AirlineSentiment throughput |
2020 bytes |
2020 bytes |
1 |
vortex:parquet-zstd size/AirlineSentiment |
9.042399172699069 ratio |
9.042399172699069 ratio |
1 |
vortex:raw size/AirlineSentiment |
4.328712871287129 ratio |
4.328712871287129 ratio |
1 |
vortex size/AirlineSentiment |
8744 bytes |
8744 bytes |
1 |
compress time/Arade |
2635592718.6 ns (5162783.298750162) |
2429903296.7 ns (4382143.078749895) |
1.08 |
compress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
parquet_rs-zstd compress time/Arade |
3062560380.2 ns (12307648.94999981) |
3099221087.5 ns (5237821.657500029) |
0.99 |
parquet_rs-zstd compress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
decompress time/Arade |
813781263 ns (4356935.648750007) |
757883709.9 ns (2184501.131250024) |
1.07 |
decompress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
parquet_rs-zstd decompress time/Arade |
650318209.8 ns (2072337.25) |
649649856.1 ns (2087032.862500012) |
1.00 |
parquet_rs-zstd decompress time/Arade throughput |
787023760 bytes |
787023760 bytes |
1 |
vortex:parquet-zstd size/Arade |
0.5143017584291169 ratio |
0.500537677423841 ratio |
1.03 |
vortex:raw size/Arade |
0.1995645671485191 ratio |
0.19422621751597435 ratio |
1.03 |
vortex size/Arade |
157062056 bytes |
152860648 bytes |
1.03 |
compress time/Bimbo |
9906970181.3 ns (16540862.707499504) |
11793601990.3 ns (13185647.921250343) |
0.84 |
compress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
parquet_rs-zstd compress time/Bimbo |
21182782896.6 ns (48972704.58250046) |
21617435281.9 ns (39866855.163749695) |
0.98 |
parquet_rs-zstd compress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
decompress time/Bimbo |
4675144538.1 ns (25510464.573749542) |
4925098356.9 ns (64536752.628750324) |
0.95 |
decompress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
parquet_rs-zstd decompress time/Bimbo |
2626858279 ns (6670347.5) |
2645991218.1 ns (9118653.950000048) |
0.99 |
parquet_rs-zstd decompress time/Bimbo throughput |
7121333608 bytes |
7121333608 bytes |
1 |
vortex:parquet-zstd size/Bimbo |
1.3761796859608517 ratio |
1.4422883961876998 ratio |
0.95 |
vortex:raw size/Bimbo |
0.07500919201424948 ratio |
0.07861247215986346 ratio |
0.95 |
vortex size/Bimbo |
534165480 bytes |
559825640 bytes |
0.95 |
compress time/CMSprovider |
14639148342.3 ns (42683498.82124901) |
14154839403.5 ns (16396633.357499123) |
1.03 |
compress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
parquet_rs-zstd compress time/CMSprovider |
20613633979.4 ns (29416293.286251068) |
21216726035.5 ns (20048893.049999237) |
0.97 |
parquet_rs-zstd compress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
decompress time/CMSprovider |
7220839230.8 ns (24188364.067500114) |
6230372137.4 ns (19174193.82499981) |
1.16 |
decompress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
parquet_rs-zstd decompress time/CMSprovider |
5679652435.4 ns (24545506.878749847) |
6088492492.9 ns (17661748.467499733) |
0.93 |
parquet_rs-zstd decompress time/CMSprovider throughput |
5149123964 bytes |
5149123964 bytes |
1 |
vortex:parquet-zstd size/CMSprovider |
1.2403437137920204 ratio |
1.2487125445973772 ratio |
0.99 |
vortex:raw size/CMSprovider |
0.1853638697908808 ratio |
0.18661487870910384 ratio |
0.99 |
vortex size/CMSprovider |
954461544 bytes |
960903144 bytes |
0.99 |
compress time/Euro2016 |
2475645676.3 ns (6549748.442500114) |
2772666256.1 ns (2803495.6124999523) |
0.89 |
compress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
parquet_rs-zstd compress time/Euro2016 |
1583011440.7 ns (4940033.4499999285) |
1595842111.4 ns (1777385.4812499285) |
0.99 |
parquet_rs-zstd compress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
decompress time/Euro2016 |
423854910.6 ns (1233946.25) |
319594685.05 ns (1476529.6337500215) |
1.33 |
decompress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
parquet_rs-zstd decompress time/Euro2016 |
493652097.3 ns (2454433.6837500036) |
488895856.55 ns (1295473.9118750095) |
1.01 |
parquet_rs-zstd decompress time/Euro2016 throughput |
393253221 bytes |
393253221 bytes |
1 |
vortex:parquet-zstd size/Euro2016 |
1.4905739927735153 ratio |
1.4502231114782558 ratio |
1.03 |
vortex:raw size/Euro2016 |
0.4506369701165143 ratio |
0.43843727855950604 ratio |
1.03 |
vortex size/Euro2016 |
177214440 bytes |
172416872 bytes |
1.03 |
compress time/Food |
1262640642.2 ns (5813662.266250014) |
1214405935.4 ns (3384823.1050001383) |
1.04 |
compress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
parquet_rs-zstd compress time/Food |
1126088827.5 ns (3884220.9837499857) |
1128812684.1 ns (1992325.8824999332) |
1.00 |
parquet_rs-zstd compress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
decompress time/Food |
234271150.5 ns (1204230.3058333248) |
201872746.8333333 ns (1108520.8050000072) |
1.16 |
decompress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
parquet_rs-zstd decompress time/Food |
216012765.13333336 ns (424341.9033333212) |
215266978.3 ns (279072.1008333564) |
1.00 |
parquet_rs-zstd decompress time/Food throughput |
332718229 bytes |
332718229 bytes |
1 |
vortex:parquet-zstd size/Food |
1.6437847814186541 ratio |
1.3132884053892004 ratio |
1.25 |
vortex:raw size/Food |
0.17899333072009108 ratio |
0.1430052574606605 ratio |
1.25 |
vortex size/Food |
59554344 bytes |
47580456 bytes |
1.25 |
compress time/HashTags |
2854286676.3 ns (6649843.027499914) |
2718792728.4 ns (2054576.100000143) |
1.05 |
compress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
parquet_rs-zstd compress time/HashTags |
2547405965.5 ns (4323868.174999952) |
2558436635.4 ns (3666519.4937500954) |
1.00 |
parquet_rs-zstd compress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
decompress time/HashTags |
675989594.9 ns (2694975.6974999905) |
567806612.1 ns (3390370.367500007) |
1.19 |
decompress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
parquet_rs-zstd decompress time/HashTags |
824565196.5 ns (7220301.194999993) |
804546286.1 ns (3040899.2037499547) |
1.02 |
parquet_rs-zstd decompress time/HashTags throughput |
804495592 bytes |
804495592 bytes |
1 |
vortex:parquet-zstd size/HashTags |
1.6047540240547606 ratio |
1.6873911818698275 ratio |
0.95 |
vortex:raw size/HashTags |
0.2672254989807328 ratio |
0.2809862505747577 ratio |
0.95 |
vortex size/HashTags |
214981736 bytes |
226052200 bytes |
0.95 |
compress time/TPC-H l_comment chunked without fsst |
3746942614.6 ns (27235929.254999876) |
3774158295.2 ns (7205992.347500086) |
0.99 |
compress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst |
915496435 ns (2783827.7999999523) |
917289782.4 ns (1653678.4399999976) |
1.00 |
parquet_rs-zstd compress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
decompress time/TPC-H l_comment chunked without fsst |
109664774.75765872 ns (1009484.659538202) |
109687119.71039684 ns (955723.5676795617) |
1.00 |
decompress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst |
252116507.65 ns (996096.1756249964) |
251855072.3 ns (859853.924999997) |
1.00 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked without fsst throughput |
249197090 bytes |
249197090 bytes |
1 |
vortex:parquet-zstd size/TPC-H l_comment chunked without fsst |
4.609841047839932 ratio |
4.6098764117128965 ratio |
1.00 |
vortex:raw size/TPC-H l_comment chunked without fsst |
1.0532043692805562 ratio |
1.053185107418389 ratio |
1.00 |
vortex size/TPC-H l_comment chunked without fsst |
262455464 bytes |
262450664 bytes |
1.00 |
compress time/TPC-H l_comment chunked |
1627249445.7 ns (10261596.1049999) |
898236917.7 ns (1253379.8500000238) |
1.81 |
compress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd compress time/TPC-H l_comment chunked |
911425504.7 ns (1730281.7337499857) |
914741113.6 ns (1860149.264999926) |
1.00 |
parquet_rs-zstd compress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
decompress time/TPC-H l_comment chunked |
136935262.17083335 ns (790098.34375) |
121719296.22396827 ns (592369.3443978205) |
1.13 |
decompress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked |
251294166.3 ns (781391.775000006) |
252565363.4 ns (1131850.075000003) |
0.99 |
parquet_rs-zstd decompress time/TPC-H l_comment chunked throughput |
249197090 bytes |
249197090 bytes |
1 |
vortex:parquet-zstd size/TPC-H l_comment chunked |
1.544960321766354 ratio |
1.3522132690473394 ratio |
1.14 |
vortex:raw size/TPC-H l_comment chunked |
0.3529750688501218 ratio |
0.3089303811693788 ratio |
1.14 |
vortex size/TPC-H l_comment chunked |
87960360 bytes |
76984552 bytes |
1.14 |
compress time/TPC-H l_comment canonical |
1618196999.6 ns (7340766.430000067) |
894183675.5 ns (867472.6331250072) |
1.81 |
compress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
parquet_rs-zstd compress time/TPC-H l_comment canonical |
914658593.35 ns (2945859.588750005) |
921470197 ns (1682253.2881250381) |
0.99 |
parquet_rs-zstd compress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
decompress time/TPC-H l_comment canonical |
138074805.01982144 ns (688791.9304873496) |
121655248.20451057 ns (403593.7212584391) |
1.13 |
decompress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
parquet_rs-zstd decompress time/TPC-H l_comment canonical |
250013836.7482539 ns (583852.9522807747) |
251847463.52624997 ns (897719.0429166853) |
0.99 |
parquet_rs-zstd decompress time/TPC-H l_comment canonical throughput |
249197106 bytes |
249197106 bytes |
1 |
vortex:parquet-zstd size/TPC-H l_comment canonical |
1.5449461297088676 ratio |
1.352209373850611 ratio |
1.14 |
vortex:raw size/TPC-H l_comment canonical |
0.3529750461869329 ratio |
0.30893036133413204 ratio |
1.14 |
vortex size/TPC-H l_comment canonical |
87960360 bytes |
76984552 bytes |
1.14 |
This comment was automatically generated by workflow using github-action-benchmark.
This reverts commit 6c7027c.
…ompression ratio >= 1.0
lwwmanning
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
new objective function that biases more strongly towards the fastest codecs, while still taking compressed size into account