Skip to content

duckdb: propagate per-file "partition" stats - #9639

Open
myrrc wants to merge 3 commits into
developfrom
myrrc/duckdb-partition-stats
Open

duckdb: propagate per-file "partition" stats#9639
myrrc wants to merge 3 commits into
developfrom
myrrc/duckdb-partition-stats

Conversation

@myrrc

@myrrc myrrc commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

This couldn't be done previously since we didn't have ordering of files
for threads. Since migration to MultiFileReader, we now have well-defined
batch indices.

Propagate per-file partition stats to duckdb. MultiFileSession already caches
footers by file path, so we can use this information. This change makes
Clickbench Q0 and Q6 constant (supplied from metadata) from second iteration.

Resolves: #3393

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 26, 2026
@myrrc
myrrc enabled auto-merge (squash) August 26, 2026 10:33
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 26, 2026
@myrrc
myrrc requested a review from joseph-isaacs August 26, 2026 10:34
@codspeed-hq

codspeed-hq Bot commented Aug 26, 2026

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 5 improved benchmarks
❌ 1 regressed benchmark
✅ 2106 untouched benchmarks
⏩ 106 skipped benchmarks1
🗄️ 4 archived benchmarks run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_avx2[16384] 17.7 µs 21.3 µs -16.81%
WallTime arrow_checked_add_u32_neon[16384] 20.4 µs 13.5 µs +50.76%
WallTime arrow_checked_add_u32_avx512[16384] 21.3 µs 17.6 µs +20.72%
Simulation take[duplicates/repeated/primitive/nonnull/chunks=16/indices=1000] 245 µs 207 µs +18.39%
WallTime words_gather_dispatch_avx512[1024] 9 ns 8 ns +12.5%
WallTime mul_u32_nonnull_avx512 6.3 µs 5.7 µs +10.4%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-partition-stats (8b3244b) with develop (ee1ac25)

Open in CodSpeed

Footnotes

  1. 106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. 4 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them.

@myrrc
myrrc marked this pull request as draft August 26, 2026 10:39
auto-merge was automatically disabled August 26, 2026 10:39

Pull request was converted to draft

@github-actions

github-actions Bot commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 00b8cab statpopgen 1 Explore Profiling Data
🟢 Done 00b8cab clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 00b8cab tpch-nvme-10 1 Explore Profiling Data
🟢 Done 00b8cab fineweb-s3 1 Explore Profiling Data
🟢 Done 00b8cab clickbench-nvme 1 Explore Profiling Data
🟢 Done 00b8cab fineweb 1 Explore Profiling Data
🟢 Done 00b8cab tpcds-nvme 1 Explore Profiling Data
🟢 Done 00b8cab polarsignals 1 Explore Profiling Data
🟢 Done 00b8cab tpch-nvme 1 Explore Profiling Data
🟢 Done 00b8cab tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 00b8cabd vs base ee1ac252
Vortex (geomean): hot 1.010x ➖ · cold 0.989x ➖


datafusion / vortex-file-compressed / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 100987858 / 102125986 / -1.1% 204590849 / 203937652 / +0.3% 0.49 / 0.50 / -1.4%
polarsignals_q01/datafusion:vortex-file-compressed 157867856 / 158328208 / -0.3% 271254756 / 276067873 / -1.7% 0.58 / 0.57 / +1.5%
polarsignals_q02/datafusion:vortex-file-compressed 22439458 / 21659296 / +3.6% 91490973 / 87239941 / +4.9% 0.25 / 0.25 / -1.2%
polarsignals_q03/datafusion:vortex-file-compressed 158855662 / 159699100 / -0.5% 279010675 / 276074299 / +1.1% 0.57 / 0.58 / -1.6%
polarsignals_q04/datafusion:vortex-file-compressed 10517837 / 10735664 / -2.0% 77696459 / 79107923 / -1.8% 0.14 / 0.14 / -0.2%
polarsignals_q05/datafusion:vortex-file-compressed 13934857 / 14568370 / -4.3% 81127440 / 89833275 / -9.7% 0.17 / 0.16 / +5.9%
polarsignals_q06/datafusion:vortex-file-compressed 22966320 / 24040792 / -4.5% 96263793 / 96432631 / -0.2% 0.24 / 0.25 / -4.3%
polarsignals_q07/datafusion:vortex-file-compressed 12359174 / 12399826 / -0.3% 83125871 / 83284174 / -0.2% 0.15 / 0.15 / -0.1%
polarsignals_q08/datafusion:vortex-file-compressed 271999279 / 274701238 / -1.0% 382177404 / 378247887 / +1.0% 0.71 / 0.73 / -2.0%
polarsignals_q09/datafusion:vortex-file-compressed 15771730 / 12780388 / +23.4% 🔴 75889913 / 78760457 / -3.6% 0.21 / 0.16 / +28.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (+2.7%, environment too noisy confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 0.985x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7578571 / 8318732 / -8.9% 35873285 / 35001444 / +2.5% 0.21 / 0.24 / -11.1%
fineweb_q01/datafusion:vortex-file-compressed 31515054 / 31199768 / +1.0% 100234685 / 95144739 / +5.3% 0.31 / 0.33 / -4.1%
fineweb_q02/datafusion:vortex-file-compressed 33256804 / 33646806 / -1.2% 103822451 / 107706027 / -3.6% 0.32 / 0.31 / +2.5%
fineweb_q03/datafusion:vortex-file-compressed 43252456 / 44533128 / -2.9% 193224344 / 185735807 / +4.0% 0.22 / 0.24 / -6.6%
fineweb_q04/datafusion:vortex-file-compressed 206450572 / 204723457 / +0.8% 320296893 / 330043985 / -3.0% 0.64 / 0.62 / +3.9%
fineweb_q05/datafusion:vortex-file-compressed 153427573 / 153364466 / +0.0% 276341890 / 284376837 / -2.8% 0.56 / 0.54 / +2.9%
fineweb_q06/datafusion:vortex-file-compressed 39599575 / 39963161 / -0.9% 188121810 / 185459709 / +1.4% 0.21 / 0.22 / -2.3%
fineweb_q07/datafusion:vortex-file-compressed 39475663 / 40818940 / -3.3% 182843028 / 180084551 / +1.5% 0.22 / 0.23 / -4.7%
fineweb_q08/datafusion:vortex-file-compressed 20187419 / 16613950 / +21.5% 🔴 82045095 / 88805813 / -7.6% 0.25 / 0.19 / +31.5%
datafusion / parquet / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 8480506 / 9927330 / -14.6% 🟢 50119063 / 47448673 / +5.6% 0.17 / 0.21 / -19.1%
fineweb_q01/datafusion:parquet 194522998 / 195710054 / -0.6% 333314221 / 330116975 / +1.0% 0.58 / 0.59 / -1.6%
fineweb_q02/datafusion:parquet 197415370 / 198941234 / -0.8% 327073202 / 334755056 / -2.3% 0.60 / 0.59 / +1.6%
fineweb_q03/datafusion:parquet 188096841 / 189666718 / -0.8% 289637560 / 285282657 / +1.5% 0.65 / 0.66 / -2.3%
fineweb_q04/datafusion:parquet 208651942 / 207184904 / +0.7% 299295878 / 299975230 / -0.2% 0.70 / 0.69 / +0.9%
fineweb_q05/datafusion:parquet 205847266 / 206888522 / -0.5% 300282180 / 297231259 / +1.0% 0.69 / 0.70 / -1.5%
fineweb_q06/datafusion:parquet 198682802 / 204076428 / -2.6% 334504658 / 329243950 / +1.6% 0.59 / 0.62 / -4.2%
fineweb_q07/datafusion:parquet 191607694 / 192168566 / -0.3% 288064798 / 291414109 / -1.1% 0.67 / 0.66 / +0.9%
fineweb_q08/datafusion:parquet 188678670 / 187896026 / +0.4% 284900445 / 279025258 / +2.1% 0.66 / 0.67 / -1.7%
duckdb / vortex-file-compressed / ns (1.008x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 4143546 / 3871519 / +7.0% 14594639 / 15540670 / -6.1% 0.28 / 0.25 / +14.0%
fineweb_q01/duckdb:vortex-file-compressed 40008560 / 40751508 / -1.8% 122293749 / 136786089 / -10.6% 🟢 0.33 / 0.30 / +9.8%
fineweb_q02/duckdb:vortex-file-compressed 50613761 / 46975703 / +7.7% 119475871 / 135848440 / -12.1% 🟢 0.42 / 0.35 / +22.5%
fineweb_q03/duckdb:vortex-file-compressed 63485288 / 62043704 / +2.3% 208553259 / 193688316 / +7.7% 0.30 / 0.32 / -5.0%
fineweb_q04/duckdb:vortex-file-compressed 280162614 / 286040380 / -2.1% 404672017 / 407337488 / -0.7% 0.69 / 0.70 / -1.4%
fineweb_q05/duckdb:vortex-file-compressed 213792882 / 224192996 / -4.6% 325069699 / 300170578 / +8.3% 0.66 / 0.75 / -11.9%
fineweb_q06/duckdb:vortex-file-compressed 67730734 / 61204990 / +10.7% 🔴 246283668 / 258823308 / -4.8% 0.28 / 0.24 / +16.3%
fineweb_q07/duckdb:vortex-file-compressed 63940234 / 59827342 / +6.9% 192008859 / 180155049 / +6.6% 0.33 / 0.33 / +0.3%
fineweb_q08/duckdb:vortex-file-compressed 25607648 / 30561726 / -16.2% 🟢 93146957 / 102201168 / -8.9% 0.27 / 0.30 / -8.1%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 36548636 / 34316033 / +6.5% 38175299 / 40634691 / -6.1% 0.96 / 0.84 / +13.4%
fineweb_q01/duckdb:parquet 77231515 / 76741528 / +0.6% 103853536 / 108752100 / -4.5% 0.74 / 0.71 / +5.4%
fineweb_q02/duckdb:parquet 76958702 / 77105308 / -0.2% 107435988 / 109721431 / -2.1% 0.72 / 0.70 / +1.9%
fineweb_q03/duckdb:parquet 207193366 / 207213976 / -0.0% 431072433 / 430850776 / +0.1% 0.48 / 0.48 / -0.1%
fineweb_q04/duckdb:parquet 232250332 / 228825304 / +1.5% 435312827 / 432721140 / +0.6% 0.53 / 0.53 / +0.9%
fineweb_q05/duckdb:parquet 203420106 / 203395190 / +0.0% 439092517 / 420297259 / +4.5% 0.46 / 0.48 / -4.3%
fineweb_q06/duckdb:parquet 142076360 / 143342114 / -0.9% 277832647 / 281629431 / -1.3% 0.51 / 0.51 / +0.5%
fineweb_q07/duckdb:parquet 145742892 / 145859855 / -0.1% 334591347 / 347960678 / -3.8% 0.44 / 0.42 / +3.9%
fineweb_q08/duckdb:parquet 38296430 / 38481222 / -0.5% 40111320 / 42908446 / -6.5% 0.95 / 0.90 / +6.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.010x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 42203991 / 42689954 / -1.1% 99261856 / 101981241 / -2.7% 0.43 / 0.42 / +1.6%
tpch_q02/datafusion:vortex-file-compressed 23799330 / 24557577 / -3.1% 68187861 / 67432336 / +1.1% 0.35 / 0.36 / -4.2%
tpch_q03/datafusion:vortex-file-compressed 30000215 / 29755468 / +0.8% 91246062 / 88992540 / +2.5% 0.33 / 0.33 / -1.7%
tpch_q04/datafusion:vortex-file-compressed 15372221 / 16193856 / -5.1% 61605892 / 65264719 / -5.6% 0.25 / 0.25 / +0.6%
tpch_q05/datafusion:vortex-file-compressed 51014378 / 50232727 / +1.6% 116891476 / 117901717 / -0.9% 0.44 / 0.43 / +2.4%
tpch_q06/datafusion:vortex-file-compressed 8840315 / 8330277 / +6.1% 55915415 / 54352763 / +2.9% 0.16 / 0.15 / +3.2%
tpch_q07/datafusion:vortex-file-compressed 54810566 / 54928816 / -0.2% 121662837 / 121299329 / +0.3% 0.45 / 0.45 / -0.5%
tpch_q08/datafusion:vortex-file-compressed 45240187 / 45950757 / -1.5% 110653818 / 110045701 / +0.6% 0.41 / 0.42 / -2.1%
tpch_q09/datafusion:vortex-file-compressed 55591929 / 55755498 / -0.3% 125199603 / 129533796 / -3.3% 0.44 / 0.43 / +3.2%
tpch_q10/datafusion:vortex-file-compressed 28706143 / 29078022 / -1.3% 100207858 / 93406600 / +7.3% 0.29 / 0.31 / -8.0%
tpch_q11/datafusion:vortex-file-compressed 17682949 / 17556896 / +0.7% 61998804 / 60583777 / +2.3% 0.29 / 0.29 / -1.6%
tpch_q12/datafusion:vortex-file-compressed 26304585 / 26431471 / -0.5% 72929636 / 70848718 / +2.9% 0.36 / 0.37 / -3.3%
tpch_q13/datafusion:vortex-file-compressed 24814329 / 24968220 / -0.6% 76200455 / 74174934 / +2.7% 0.33 / 0.34 / -3.3%
tpch_q14/datafusion:vortex-file-compressed 16327677 / 15978577 / +2.2% 69814978 / 75139701 / -7.1% 0.23 / 0.21 / +10.0%
tpch_q15/datafusion:vortex-file-compressed 21496181 / 21123199 / +1.8% 77269939 / 78236228 / -1.2% 0.28 / 0.27 / +3.0%
tpch_q16/datafusion:vortex-file-compressed 24786328 / 24791310 / -0.0% 72444169 / 73833787 / -1.9% 0.34 / 0.34 / +1.9%
tpch_q17/datafusion:vortex-file-compressed 54258637 / 54732653 / -0.9% 119448754 / 120920509 / -1.2% 0.45 / 0.45 / +0.4%
tpch_q18/datafusion:vortex-file-compressed 68433897 / 70094440 / -2.4% 123955882 / 126686333 / -2.2% 0.55 / 0.55 / -0.2%
tpch_q19/datafusion:vortex-file-compressed 15915660 / 16136528 / -1.4% 63984887 / 62433676 / +2.5% 0.25 / 0.26 / -3.8%
tpch_q20/datafusion:vortex-file-compressed 31173765 / 30875928 / +1.0% 82526804 / 84181971 / -2.0% 0.38 / 0.37 / +3.0%
tpch_q21/datafusion:vortex-file-compressed 60109955 / 60393437 / -0.5% 137511791 / 139739013 / -1.6% 0.44 / 0.43 / +1.1%
tpch_q22/datafusion:vortex-file-compressed 13461503 / 13358774 / +0.8% 55783933 / 55612493 / +0.3% 0.24 / 0.24 / +0.5%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 107321131 / 107058102 / +0.2% 140076252 / 137987935 / +1.5% 0.77 / 0.78 / -1.2%
tpch_q02/datafusion:parquet 69310567 / 68977314 / +0.5% 120249122 / 118315789 / +1.6% 0.58 / 0.58 / -1.1%
tpch_q03/datafusion:parquet 98089699 / 93476665 / +4.9% 163699503 / 161346754 / +1.5% 0.60 / 0.58 / +3.4%
tpch_q04/datafusion:parquet 49432410 / 50171442 / -1.5% 97009058 / 99232471 / -2.2% 0.51 / 0.51 / +0.8%
tpch_q05/datafusion:parquet 127249715 / 119874889 / +6.2% 199608680 / 180505051 / +10.6% 🔴 0.64 / 0.66 / -4.0%
tpch_q06/datafusion:parquet 49750349 / 50221867 / -0.9% 90047301 / 93185198 / -3.4% 0.55 / 0.54 / +2.5%
tpch_q07/datafusion:parquet 125432622 / 130048080 / -3.5% 201020181 / 193207409 / +4.0% 0.62 / 0.67 / -7.3%
tpch_q08/datafusion:parquet 120062863 / 118622830 / +1.2% 189217167 / 187219041 / +1.1% 0.63 / 0.63 / +0.1%
tpch_q09/datafusion:parquet 159483292 / 149909022 / +6.4% 230641110 / 231901510 / -0.5% 0.69 / 0.65 / +7.0%
tpch_q10/datafusion:parquet 116734344 / 114296525 / +2.1% 198587800 / 187717652 / +5.8% 0.59 / 0.61 / -3.5%
tpch_q11/datafusion:parquet 49307185 / 49227573 / +0.2% 99883818 / 103038274 / -3.1% 0.49 / 0.48 / +3.3%
tpch_q12/datafusion:parquet 107212517 / 99975587 / +7.2% 152237835 / 157025374 / -3.0% 0.70 / 0.64 / +10.6%
tpch_q13/datafusion:parquet 218236573 / 219236483 / -0.5% 264233476 / 263599472 / +0.2% 0.83 / 0.83 / -0.7%
tpch_q14/datafusion:parquet 45206767 / 50090210 / -9.7% 105208201 / 104869942 / +0.3% 0.43 / 0.48 / -10.0%
tpch_q15/datafusion:parquet 65916505 / 70018157 / -5.9% 122840858 / 116257092 / +5.7% 0.54 / 0.60 / -10.9%
tpch_q16/datafusion:parquet 48926097 / 48805977 / +0.2% 104001477 / 105247616 / -1.2% 0.47 / 0.46 / +1.4%
tpch_q17/datafusion:parquet 150136123 / 152300491 / -1.4% 223046800 / 211544988 / +5.4% 0.67 / 0.72 / -6.5%
tpch_q18/datafusion:parquet 176051852 / 170821602 / +3.1% 227158390 / 246941890 / -8.0% 0.78 / 0.69 / +12.0%
tpch_q19/datafusion:parquet 68822767 / 68988592 / -0.2% 144946240 / 152492834 / -4.9% 0.47 / 0.45 / +5.0%
tpch_q20/datafusion:parquet 83448183 / 92413264 / -9.7% 156545745 / 148953584 / +5.1% 0.53 / 0.62 / -14.1%
tpch_q21/datafusion:parquet 167652458 / 167141731 / +0.3% 233384361 / 258985859 / -9.9% 0.72 / 0.65 / +11.3%
tpch_q22/datafusion:parquet 56610935 / 55329638 / +2.3% 99302795 / 98350963 / +1.0% 0.57 / 0.56 / +1.3%
duckdb / vortex-file-compressed / ns (0.993x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 21141113 / 21451899 / -1.4% 64491142 / 62409076 / +3.3% 0.33 / 0.34 / -4.6%
tpch_q02/duckdb:vortex-file-compressed 30189655 / 30179950 / +0.0% 52584614 / 56369969 / -6.7% 0.57 / 0.54 / +7.2%
tpch_q03/duckdb:vortex-file-compressed 35208256 / 36397235 / -3.3% 83254641 / 80875910 / +2.9% 0.42 / 0.45 / -6.0%
tpch_q04/duckdb:vortex-file-compressed 32486886 / 32840672 / -1.1% 69655676 / 65737967 / +6.0% 0.47 / 0.50 / -6.6%
tpch_q05/duckdb:vortex-file-compressed 41033943 / 40542144 / +1.2% 81705999 / 83954888 / -2.7% 0.50 / 0.48 / +4.0%
tpch_q06/duckdb:vortex-file-compressed 9037190 / 8911434 / +1.4% 40493840 / 41115087 / -1.5% 0.22 / 0.22 / +3.0%
tpch_q07/duckdb:vortex-file-compressed 39368912 / 39000059 / +0.9% 82034583 / 85598245 / -4.2% 0.48 / 0.46 / +5.3%
tpch_q08/duckdb:vortex-file-compressed 47233203 / 46870522 / +0.8% 96236957 / 94857556 / +1.5% 0.49 / 0.49 / -0.7%
tpch_q09/duckdb:vortex-file-compressed 59121621 / 59761478 / -1.1% 111763619 / 105369604 / +6.1% 0.53 / 0.57 / -6.7%
tpch_q10/duckdb:vortex-file-compressed 50087415 / 48461272 / +3.4% 88210641 / 87784447 / +0.5% 0.57 / 0.55 / +2.9%
tpch_q11/duckdb:vortex-file-compressed 17556943 / 16971627 / +3.4% 35373531 / 36111089 / -2.0% 0.50 / 0.47 / +5.6%
tpch_q12/duckdb:vortex-file-compressed 26217438 / 26831539 / -2.3% 56025457 / 63184453 / -11.3% 🟢 0.47 / 0.42 / +10.2%
tpch_q13/duckdb:vortex-file-compressed 42810059 / 41616367 / +2.9% 123357294 / 112925343 / +9.2% 0.35 / 0.37 / -5.8%
tpch_q14/duckdb:vortex-file-compressed 22348987 / 20614539 / +8.4% 57797175 / 53837696 / +7.4% 0.39 / 0.38 / +1.0%
tpch_q15/duckdb:vortex-file-compressed 17611758 / 19465700 / -9.5% 54797012 / 56037967 / -2.2% 0.32 / 0.35 / -7.5%
tpch_q16/duckdb:vortex-file-compressed 29369600 / 30057484 / -2.3% 48101301 / 47093088 / +2.1% 0.61 / 0.64 / -4.3%
tpch_q17/duckdb:vortex-file-compressed 33355637 / 32447202 / +2.8% 79675419 / 84070858 / -5.2% 0.42 / 0.39 / +8.5%
tpch_q18/duckdb:vortex-file-compressed 51147644 / 53361668 / -4.1% 88661363 / 77455420 / +14.5% 🔴 0.58 / 0.69 / -16.3%
tpch_q19/duckdb:vortex-file-compressed 36016356 / 41163434 / -12.5% 🟢 61901477 / 89432474 / -30.8% 🟢 0.58 / 0.46 / +26.4%
tpch_q20/duckdb:vortex-file-compressed 35137182 / 35086785 / +0.1% 89366954 / 88896426 / +0.5% 0.39 / 0.39 / -0.4%
tpch_q21/duckdb:vortex-file-compressed 118452137 / 117613307 / +0.7% 160518138 / 159937516 / +0.4% 0.74 / 0.74 / +0.3%
tpch_q22/duckdb:vortex-file-compressed 20416275 / 20941883 / -2.5% 42556390 / 41763376 / +1.9% 0.48 / 0.50 / -4.3%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 81779806 / 81756793 / +0.0% 93363737 / 93065968 / +0.3% 0.88 / 0.88 / -0.3%
tpch_q02/duckdb:parquet 46463573 / 46247264 / +0.5% 63731650 / 61916266 / +2.9% 0.73 / 0.75 / -2.4%
tpch_q03/duckdb:parquet 81081465 / 81268373 / -0.2% 103008782 / 104615658 / -1.5% 0.79 / 0.78 / +1.3%
tpch_q04/duckdb:parquet 58252353 / 58589117 / -0.6% 75038680 / 75849105 / -1.1% 0.78 / 0.77 / +0.5%
tpch_q05/duckdb:parquet 78777915 / 78579842 / +0.3% 99584761 / 100947681 / -1.4% 0.79 / 0.78 / +1.6%
tpch_q06/duckdb:parquet 25292503 / 24944889 / +1.4% 34329347 / 32954170 / +4.2% 0.74 / 0.76 / -2.7%
tpch_q07/duckdb:parquet 80301007 / 79978375 / +0.4% 120843252 / 99869421 / +21.0% 🔴 0.66 / 0.80 / -17.0%
tpch_q08/duckdb:parquet 98374945 / 97401093 / +1.0% 122090927 / 120300152 / +1.5% 0.81 / 0.81 / -0.5%
tpch_q09/duckdb:parquet 148402846 / 148310957 / +0.1% 201127419 / 170883130 / +17.7% 🔴 0.74 / 0.87 / -15.0%
tpch_q10/duckdb:parquet 142446923 / 142025346 / +0.3% 166613161 / 169081118 / -1.5% 0.85 / 0.84 / +1.8%
tpch_q11/duckdb:parquet 25441656 / 25529324 / -0.3% 34959285 / 34719355 / +0.7% 0.73 / 0.74 / -1.0%
tpch_q12/duckdb:parquet 53834477 / 53590500 / +0.5% 68330099 / 68215176 / +0.2% 0.79 / 0.79 / +0.3%
tpch_q13/duckdb:parquet 288582154 / 285527642 / +1.1% 306671186 / 306761547 / -0.0% 0.94 / 0.93 / +1.1%
tpch_q14/duckdb:parquet 56282054 / 56163119 / +0.2% 72131555 / 71320242 / +1.1% 0.78 / 0.79 / -0.9%
tpch_q15/duckdb:parquet 30873707 / 31190817 / -1.0% 45126929 / 45233519 / -0.2% 0.68 / 0.69 / -0.8%
tpch_q16/duckdb:parquet 67019561 / 67514779 / -0.7% 82678251 / 81173198 / +1.9% 0.81 / 0.83 / -2.5%
tpch_q17/duckdb:parquet 58386574 / 58186256 / +0.3% 76928662 / 75942819 / +1.3% 0.76 / 0.77 / -0.9%
tpch_q18/duckdb:parquet 125575561 / 127575754 / -1.6% 143481904 / 153694659 / -6.6% 0.88 / 0.83 / +5.4%
tpch_q19/duckdb:parquet 78011958 / 78223036 / -0.3% 95909795 / 97541949 / -1.7% 0.81 / 0.80 / +1.4%
tpch_q20/duckdb:parquet 78355241 / 77527043 / +1.1% 102820389 / 101559257 / +1.2% 0.76 / 0.76 / -0.2%
tpch_q21/duckdb:parquet 188840261 / 203171842 / -7.1% 209622698 / 207020645 / +1.3% 0.90 / 0.98 / -8.2%
tpch_q22/duckdb:parquet 64301283 / 64972300 / -1.0% 78359722 / 78389069 / -0.0% 0.82 / 0.83 / -1.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Engines: DataFusion No clear signal (-0.6%, environment too noisy confidence) · DuckDB No clear signal (+5.0%, environment too noisy confidence)
Vortex (geomean): hot 1.009x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.987x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -1.3% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 245797436 / 283910689 / -13.4% 🟢 510018838 / 453170041 / +12.5% 🔴 0.48 / 0.63 / -23.1%
clickbench-sorted_q24/datafusion:vortex-file-compressed 26485617 / 26268290 / +0.8% 91202665 / 94694483 / -3.7% 0.29 / 0.28 / +4.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed 27581656 / 25520946 / +8.1% 95846844 / 91105315 / +5.2% 0.29 / 0.28 / +2.7%
clickbench-sorted_q36/datafusion:vortex-file-compressed 51192283 / 51928242 / -1.4% 125379595 / 126037476 / -0.5% 0.41 / 0.41 / -0.9%
clickbench-sorted_q37/datafusion:vortex-file-compressed 41068914 / 39132710 / +4.9% 103923983 / 104851257 / -0.9% 0.40 / 0.37 / +5.9%
clickbench-sorted_q38/datafusion:vortex-file-compressed 49937902 / 51662090 / -3.3% 112013704 / 110691320 / +1.2% 0.45 / 0.47 / -4.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed 123557136 / 122837858 / +0.6% 202932097 / 201839736 / +0.5% 0.61 / 0.61 / +0.0%
clickbench-sorted_q40/datafusion:vortex-file-compressed 20858502 / 21403090 / -2.5% 76546259 / 76479540 / +0.1% 0.27 / 0.28 / -2.6%
clickbench-sorted_q41/datafusion:vortex-file-compressed 20060613 / 20210036 / -0.7% 80248080 / 81057774 / -1.0% 0.25 / 0.25 / +0.3%
clickbench-sorted_q42/datafusion:vortex-file-compressed 15822348 / 15868180 / -0.3% 66970439 / 65217789 / +2.7% 0.24 / 0.24 / -2.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 2910959430 / 2950381180 / -1.3% 3385323520 / 3377404957 / +0.2% 0.86 / 0.87 / -1.6%
clickbench-sorted_q24/datafusion:parquet 32986436 / 33064243 / -0.2% 155545581 / 148244220 / +4.9% 0.21 / 0.22 / -4.9%
clickbench-sorted_q26/datafusion:parquet 32879266 / 35299277 / -6.9% 148221444 / 148390551 / -0.1% 0.22 / 0.24 / -6.7%
clickbench-sorted_q36/datafusion:parquet 177598175 / 162358670 / +9.4% 335291326 / 309391164 / +8.4% 0.53 / 0.52 / +0.9%
clickbench-sorted_q37/datafusion:parquet 104763844 / 106208816 / -1.4% 214293508 / 233897447 / -8.4% 0.49 / 0.45 / +7.7%
clickbench-sorted_q38/datafusion:parquet 153546980 / 161959260 / -5.2% 287307234 / 276197771 / +4.0% 0.53 / 0.59 / -8.9%
clickbench-sorted_q39/datafusion:parquet 314250192 / 289110568 / +8.7% 433586033 / 415409845 / +4.4% 0.72 / 0.70 / +4.1%
clickbench-sorted_q40/datafusion:parquet 65262282 / 64783018 / +0.7% 189517589 / 192604733 / -1.6% 0.34 / 0.34 / +2.4%
clickbench-sorted_q41/datafusion:parquet 58680613 / 62842096 / -6.6% 186102839 / 180440418 / +3.1% 0.32 / 0.35 / -9.5%
clickbench-sorted_q42/datafusion:parquet 34805161 / 34503428 / +0.9% 150245421 / 144643659 / +3.9% 0.23 / 0.24 / -2.9%
duckdb / vortex-file-compressed / ns (1.027x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 116295132 / 117006273 / -0.6% 197858754 / 184342979 / +7.3% 0.59 / 0.63 / -7.4%
clickbench-sorted_q24/duckdb:vortex-file-compressed 31721477 / 29531342 / +7.4% 76864831 / 74208806 / +3.6% 0.41 / 0.40 / +3.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 25201304 / 26013254 / -3.1% 83455188 / 87040132 / -4.1% 0.30 / 0.30 / +1.0%
clickbench-sorted_q36/duckdb:vortex-file-compressed 74739154 / 71690962 / +4.3% 188335729 / 190644737 / -1.2% 0.40 / 0.38 / +5.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed 65439822 / 58927708 / +11.1% 🔴 151965939 / 180605339 / -15.9% 🟢 0.43 / 0.33 / +32.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed 74634448 / 76867782 / -2.9% 182706230 / 179159264 / +2.0% 0.41 / 0.43 / -4.8%
clickbench-sorted_q39/duckdb:vortex-file-compressed 190336300 / 170431328 / +11.7% 🔴 270417111 / 265666186 / +1.8% 0.70 / 0.64 / +9.7%
clickbench-sorted_q40/duckdb:vortex-file-compressed 34402024 / 33379678 / +3.1% 108022290 / 120622725 / -10.4% 🟢 0.32 / 0.28 / +15.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 33273562 / 33696618 / -1.3% 117949043 / 122368569 / -3.6% 0.28 / 0.28 / +2.4%
clickbench-sorted_q42/duckdb:vortex-file-compressed 28830394 / 29254296 / -1.4% 108371032 / 112741585 / -3.9% 0.27 / 0.26 / +2.5%
duckdb / parquet / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 228224972 / 226904024 / +0.6% 269162605 / 258359061 / +4.2% 0.85 / 0.88 / -3.5%
clickbench-sorted_q24/duckdb:parquet 33527332 / 39428930 / -15.0% 🟢 59078081 / 62132558 / -4.9% 0.57 / 0.63 / -10.6%
clickbench-sorted_q26/duckdb:parquet 23873012 / 26308974 / -9.3% 51369181 / 51275337 / +0.2% 0.46 / 0.51 / -9.4%
clickbench-sorted_q36/duckdb:parquet 71551953 / 67948353 / +5.3% 100703194 / 101361334 / -0.6% 0.71 / 0.67 / +6.0%
clickbench-sorted_q37/duckdb:parquet 59893670 / 61250969 / -2.2% 91118467 / 89373066 / +2.0% 0.66 / 0.69 / -4.1%
clickbench-sorted_q38/duckdb:parquet 62809087 / 63699819 / -1.4% 93480218 / 93009167 / +0.5% 0.67 / 0.68 / -1.9%
clickbench-sorted_q39/duckdb:parquet 107491678 / 113272541 / -5.1% 159574730 / 158459306 / +0.7% 0.67 / 0.71 / -5.8%
clickbench-sorted_q40/duckdb:parquet 28539700 / 28403187 / +0.5% 71675641 / 69805899 / +2.7% 0.40 / 0.41 / -2.1%
clickbench-sorted_q41/duckdb:parquet 30978786 / 30201468 / +2.6% 66344775 / 63406331 / +4.6% 0.47 / 0.48 / -2.0%
clickbench-sorted_q42/duckdb:parquet 21384098 / 20638773 / +3.6% 44654835 / 43189636 / +3.4% 0.48 / 0.48 / +0.2%

File Size Changes (100 files changed, -0.0% overall, 52↑ 48↓)
File Scale Format Base HEAD Change %
hits_049.vortex 1.0 vortex-file-compressed 190.41 MB 192.37 MB +1.95 MB +1.0%
hits_059.vortex 1.0 vortex-file-compressed 197.21 MB 198.97 MB +1.76 MB +0.9%
hits_060.vortex 1.0 vortex-file-compressed 192.00 MB 193.40 MB +1.40 MB +0.7%
hits_090.vortex 1.0 vortex-file-compressed 191.88 MB 193.19 MB +1.31 MB +0.7%
hits_056.vortex 1.0 vortex-file-compressed 134.57 MB 135.48 MB +933.81 KB +0.7%
hits_098.vortex 1.0 vortex-file-compressed 136.84 MB 137.50 MB +680.94 KB +0.5%
hits_053.vortex 1.0 vortex-file-compressed 189.31 MB 190.12 MB +838.16 KB +0.4%
hits_037.vortex 1.0 vortex-file-compressed 176.27 MB 177.03 MB +779.73 KB +0.4%
hits_082.vortex 1.0 vortex-file-compressed 138.68 MB 139.18 MB +511.30 KB +0.4%
hits_079.vortex 1.0 vortex-file-compressed 180.27 MB 180.89 MB +636.82 KB +0.3%
hits_065.vortex 1.0 vortex-file-compressed 160.28 MB 160.82 MB +557.20 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 158.47 MB 158.94 MB +477.29 KB +0.3%
hits_042.vortex 1.0 vortex-file-compressed 200.57 MB 201.14 MB +587.82 KB +0.3%
hits_041.vortex 1.0 vortex-file-compressed 130.16 MB 130.49 MB +334.96 KB +0.3%
hits_084.vortex 1.0 vortex-file-compressed 153.57 MB 153.93 MB +369.34 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.33 MB 179.75 MB +426.30 KB +0.2%
hits_001.vortex 1.0 vortex-file-compressed 188.07 MB 188.46 MB +399.32 KB +0.2%
hits_054.vortex 1.0 vortex-file-compressed 145.92 MB 146.19 MB +280.37 KB +0.2%
hits_021.vortex 1.0 vortex-file-compressed 153.52 MB 153.76 MB +249.22 KB +0.2%
hits_030.vortex 1.0 vortex-file-compressed 130.92 MB 131.12 MB +206.37 KB +0.2%
hits_058.vortex 1.0 vortex-file-compressed 154.09 MB 154.31 MB +228.02 KB +0.1%
hits_092.vortex 1.0 vortex-file-compressed 197.51 MB 197.79 MB +290.22 KB +0.1%
hits_034.vortex 1.0 vortex-file-compressed 180.87 MB 181.12 MB +246.81 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 129.90 MB 130.04 MB +145.45 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 197.61 MB 197.82 MB +220.51 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.73 MB 130.87 MB +143.90 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 171.91 MB 172.09 MB +181.51 KB +0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.22 MB 102.33 MB +107.13 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.64 MB 153.79 MB +156.52 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.09 MB 159.21 MB +122.41 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 188.89 MB 189.01 MB +122.92 KB +0.1%
hits_040.vortex 1.0 vortex-file-compressed 142.99 MB 143.09 MB +92.92 KB +0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.60 MB 153.69 MB +98.05 KB +0.1%
hits_087.vortex 1.0 vortex-file-compressed 159.96 MB 160.05 MB +94.73 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.16 MB 191.26 MB +109.53 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.12 MB 156.21 MB +89.24 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.09 MB 199.20 MB +112.59 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 160.16 MB 160.24 MB +76.94 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 171.33 MB 171.41 MB +80.61 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.78 MB 130.83 MB +53.54 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 199.86 MB 199.93 MB +65.27 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.23 MB 126.26 MB +40.12 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.40 MB 130.44 MB +40.04 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 171.36 MB 171.40 MB +45.06 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.79 MB 125.82 MB +28.44 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.10 MB 146.13 MB +27.14 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.67 MB 125.69 MB +22.90 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 198.47 MB 198.50 MB +33.22 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.72 MB 135.74 MB +20.80 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.79 MB 145.81 MB +21.48 KB +0.0%
hits_066.vortex 1.0 vortex-file-compressed 162.31 MB 162.34 MB +22.11 KB +0.0%
hits_019.vortex 1.0 vortex-file-compressed 139.69 MB 139.70 MB +13.07 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.21 MB 130.21 MB 1.30 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.50 MB 153.50 MB 2.30 KB -0.0%
hits_099.vortex 1.0 vortex-file-compressed 170.58 MB 170.58 MB 3.88 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 159.99 MB 159.99 MB 7.61 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.03 MB 130.02 MB 7.74 KB -0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.50 MB 100.49 MB 16.17 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 199.01 MB 198.97 MB 32.50 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.83 MB 159.79 MB 31.90 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.13 MB 168.09 MB 37.64 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.30 MB 194.26 MB 44.39 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 170.62 MB 170.57 MB 44.26 KB -0.0%
hits_009.vortex 1.0 vortex-file-compressed 100.74 MB 100.70 MB 35.08 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 191.73 MB 191.66 MB 67.04 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.69 MB 141.63 MB 58.14 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 158.99 MB 158.91 MB 72.52 KB -0.0%
hits_044.vortex 1.0 vortex-file-compressed 199.58 MB 199.49 MB 95.15 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 188.98 MB 188.89 MB 94.68 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 160.06 MB 159.98 MB 84.18 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 159.46 MB 159.37 MB 92.78 KB -0.1%
hits_028.vortex 1.0 vortex-file-compressed 150.94 MB 150.85 MB 88.84 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.80 MB 101.74 MB 61.91 KB -0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.66 MB 130.57 MB 92.62 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 157.75 MB 157.64 MB 117.44 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.65 MB 130.51 MB 145.40 KB -0.1%
hits_012.vortex 1.0 vortex-file-compressed 190.13 MB 189.90 MB 237.55 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 199.50 MB 199.21 MB 299.74 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.05 MB 138.82 MB 240.62 KB -0.2%
hits_089.vortex 1.0 vortex-file-compressed 130.65 MB 130.43 MB 228.31 KB -0.2%
hits_077.vortex 1.0 vortex-file-compressed 171.86 MB 171.55 MB 321.80 KB -0.2%
hits_062.vortex 1.0 vortex-file-compressed 169.92 MB 169.55 MB 372.52 KB -0.2%
hits_096.vortex 1.0 vortex-file-compressed 199.23 MB 198.75 MB 489.10 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 172.16 MB 171.73 MB 437.40 KB -0.2%
hits_067.vortex 1.0 vortex-file-compressed 131.13 MB 130.79 MB 345.66 KB -0.3%
hits_022.vortex 1.0 vortex-file-compressed 198.80 MB 198.25 MB 560.01 KB -0.3%
hits_068.vortex 1.0 vortex-file-compressed 160.24 MB 159.79 MB 462.61 KB -0.3%
hits_002.vortex 1.0 vortex-file-compressed 160.54 MB 160.08 MB 479.09 KB -0.3%
hits_005.vortex 1.0 vortex-file-compressed 167.08 MB 166.58 MB 510.43 KB -0.3%
hits_050.vortex 1.0 vortex-file-compressed 160.57 MB 159.92 MB 662.66 KB -0.4%
hits_074.vortex 1.0 vortex-file-compressed 198.46 MB 197.62 MB 859.51 KB -0.4%
hits_048.vortex 1.0 vortex-file-compressed 198.47 MB 197.62 MB 871.20 KB -0.4%
hits_071.vortex 1.0 vortex-file-compressed 139.57 MB 138.81 MB 782.35 KB -0.5%
hits_033.vortex 1.0 vortex-file-compressed 199.42 MB 198.32 MB 1.10 MB -0.6%
hits_025.vortex 1.0 vortex-file-compressed 172.09 MB 171.14 MB 979.04 KB -0.6%
hits_045.vortex 1.0 vortex-file-compressed 139.69 MB 138.65 MB 1.04 MB -0.7%
hits_055.vortex 1.0 vortex-file-compressed 199.10 MB 197.48 MB 1.62 MB -0.8%
hits_070.vortex 1.0 vortex-file-compressed 199.78 MB 198.01 MB 1.77 MB -0.9%
hits_075.vortex 1.0 vortex-file-compressed 190.59 MB 188.45 MB 2.14 MB -1.1%
hits_064.vortex 1.0 vortex-file-compressed 192.34 MB 189.93 MB 2.41 MB -1.3%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.87 GB (-0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+0.6%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.005x ➖
Parquet (geomean): hot 0.990x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 27817381 / 28000528 / -0.7% 80222720 / 81065372 / -1.0% 0.35 / 0.35 / +0.4%
tpcds_q02/datafusion:vortex-file-compressed 52922604 / 52836633 / +0.2% 103213337 / 101059338 / +2.1% 0.51 / 0.52 / -1.9%
tpcds_q03/datafusion:vortex-file-compressed 15252640 / 14850032 / +2.7% 64892843 / 59787600 / +8.5% 0.24 / 0.25 / -5.4%
tpcds_q04/datafusion:vortex-file-compressed 220199794 / 214544796 / +2.6% 286596521 / 279902284 / +2.4% 0.77 / 0.77 / +0.2%
tpcds_q05/datafusion:vortex-file-compressed 63882206 / 62549848 / +2.1% 124175268 / 122360235 / +1.5% 0.51 / 0.51 / +0.6%
tpcds_q06/datafusion:vortex-file-compressed 25754436 / 26046844 / -1.1% 79607634 / 78853670 / +1.0% 0.32 / 0.33 / -2.1%
tpcds_q07/datafusion:vortex-file-compressed 44491174 / 43985430 / +1.1% 95349093 / 99298549 / -4.0% 0.47 / 0.44 / +5.3%
tpcds_q08/datafusion:vortex-file-compressed 34554464 / 33871036 / +2.0% 90512397 / 84294058 / +7.4% 0.38 / 0.40 / -5.0%
tpcds_q09/datafusion:vortex-file-compressed 26235162 / 26405608 / -0.6% 69250732 / 66759473 / +3.7% 0.38 / 0.40 / -4.2%
tpcds_q10/datafusion:vortex-file-compressed 36732009 / 36625072 / +0.3% 84355326 / 85433865 / -1.3% 0.44 / 0.43 / +1.6%
tpcds_q11/datafusion:vortex-file-compressed 115747077 / 113211154 / +2.2% 181654401 / 182129923 / -0.3% 0.64 / 0.62 / +2.5%
tpcds_q12/datafusion:vortex-file-compressed 22058640 / 21951600 / +0.5% 68527390 / 66321693 / +3.3% 0.32 / 0.33 / -2.7%
tpcds_q13/datafusion:vortex-file-compressed 44269688 / 43759424 / +1.2% 93303204 / 92974184 / +0.4% 0.47 / 0.47 / +0.8%
tpcds_q14/datafusion:vortex-file-compressed 198990320 / 197394422 / +0.8% 269717589 / 263144849 / +2.5% 0.74 / 0.75 / -1.6%
tpcds_q15/datafusion:vortex-file-compressed 30202576 / 30938194 / -2.4% 79762852 / 77668331 / +2.7% 0.38 / 0.40 / -4.9%
tpcds_q16/datafusion:vortex-file-compressed 25820216 / 24034814 / +7.4% 73643869 / 72718333 / +1.3% 0.35 / 0.33 / +6.1%
tpcds_q17/datafusion:vortex-file-compressed 72862840 / 73306254 / -0.6% 140489058 / 141003870 / -0.4% 0.52 / 0.52 / -0.2%
tpcds_q18/datafusion:vortex-file-compressed 85873564 / 83799323 / +2.5% 148491288 / 145055845 / +2.4% 0.58 / 0.58 / +0.1%
tpcds_q19/datafusion:vortex-file-compressed 22557407 / 22876783 / -1.4% 74053866 / 71983481 / +2.9% 0.30 / 0.32 / -4.2%
tpcds_q20/datafusion:vortex-file-compressed 27258600 / 26639406 / +2.3% 76852436 / 74170132 / +3.6% 0.35 / 0.36 / -1.2%
tpcds_q21/datafusion:vortex-file-compressed 31740228 / 30358942 / +4.5% 90286544 / 89114469 / +1.3% 0.35 / 0.34 / +3.2%
tpcds_q22/datafusion:vortex-file-compressed 113367793 / 84216230 / +34.6% 🔴 187292494 / 191457192 / -2.2% 0.61 / 0.44 / +37.6%
tpcds_q23/datafusion:vortex-file-compressed 126380090 / 125282333 / +0.9% 191539526 / 199029169 / -3.8% 0.66 / 0.63 / +4.8%
tpcds_q24/datafusion:vortex-file-compressed 95185168 / 95125900 / +0.1% 164138149 / 166548701 / -1.4% 0.58 / 0.57 / +1.5%
tpcds_q25/datafusion:vortex-file-compressed 72781364 / 70763820 / +2.9% 149412263 / 146724793 / +1.8% 0.49 / 0.48 / +1.0%
tpcds_q26/datafusion:vortex-file-compressed 37798908 / 37849231 / -0.1% 85366154 / 90114428 / -5.3% 0.44 / 0.42 / +5.4%
tpcds_q27/datafusion:vortex-file-compressed 92514758 / 91197040 / +1.4% 168087535 / 168053488 / +0.0% 0.55 / 0.54 / +1.4%
tpcds_q28/datafusion:vortex-file-compressed 24147541 / 24033277 / +0.5% 66282931 / 69361705 / -4.4% 0.36 / 0.35 / +5.1%
tpcds_q29/datafusion:vortex-file-compressed 68904526 / 70860896 / -2.8% 141457359 / 138269823 / +2.3% 0.49 / 0.51 / -5.0%
tpcds_q30/datafusion:vortex-file-compressed 33216138 / 31853742 / +4.3% 74599481 / 77690336 / -4.0% 0.45 / 0.41 / +8.6%
tpcds_q31/datafusion:vortex-file-compressed 73790784 / 73140893 / +0.9% 141207356 / 136996842 / +3.1% 0.52 / 0.53 / -2.1%
tpcds_q32/datafusion:vortex-file-compressed 18445365 / 18639194 / -1.0% 60420905 / 61420749 / -1.6% 0.31 / 0.30 / +0.6%
tpcds_q33/datafusion:vortex-file-compressed 31462450 / 31838147 / -1.2% 87931421 / 90318959 / -2.6% 0.36 / 0.35 / +1.5%
tpcds_q34/datafusion:vortex-file-compressed 26632200 / 27179565 / -2.0% 76865340 / 75462156 / +1.9% 0.35 / 0.36 / -3.8%
tpcds_q35/datafusion:vortex-file-compressed 44744691 / 45688100 / -2.1% 101965327 / 93125075 / +9.5% 0.44 / 0.49 / -10.6%
tpcds_q36/datafusion:vortex-file-compressed 60150020 / 59471612 / +1.1% 133940253 / 136588198 / -1.9% 0.45 / 0.44 / +3.1%
tpcds_q37/datafusion:vortex-file-compressed 19172594 / 19762302 / -3.0% 63379636 / 61581488 / +2.9% 0.30 / 0.32 / -5.7%
tpcds_q38/datafusion:vortex-file-compressed 40917318 / 40725500 / +0.5% 97622355 / 95467477 / +2.3% 0.42 / 0.43 / -1.7%
tpcds_q39/datafusion:vortex-file-compressed 89236310 / 87784194 / +1.7% 150035975 / 146467384 / +2.4% 0.59 / 0.60 / -0.8%
tpcds_q40/datafusion:vortex-file-compressed 32050602 / 31785768 / +0.8% 91664461 / 87281914 / +5.0% 0.35 / 0.36 / -4.0%
tpcds_q41/datafusion:vortex-file-compressed 20820310 / 20854880 / -0.2% 53352670 / 51178192 / +4.2% 0.39 / 0.41 / -4.2%
tpcds_q42/datafusion:vortex-file-compressed 14018274 / 13739980 / +2.0% 57962302 / 57567253 / +0.7% 0.24 / 0.24 / +1.3%
tpcds_q43/datafusion:vortex-file-compressed 18515865 / 18972630 / -2.4% 66904537 / 64392585 / +3.9% 0.28 / 0.29 / -6.1%
tpcds_q44/datafusion:vortex-file-compressed 32553516 / 31717781 / +2.6% 85099639 / 83623873 / +1.8% 0.38 / 0.38 / +0.9%
tpcds_q45/datafusion:vortex-file-compressed 35189912 / 35839614 / -1.8% 82462939 / 82314783 / +0.2% 0.43 / 0.44 / -2.0%
tpcds_q46/datafusion:vortex-file-compressed 34485942 / 32845400 / +5.0% 98487342 / 98326680 / +0.2% 0.35 / 0.33 / +4.8%
tpcds_q47/datafusion:vortex-file-compressed 120867982 / 124106478 / -2.6% 202351662 / 198648249 / +1.9% 0.60 / 0.62 / -4.4%
tpcds_q48/datafusion:vortex-file-compressed 34443500 / 35472959 / -2.9% 82588988 / 81174936 / +1.7% 0.42 / 0.44 / -4.6%
tpcds_q49/datafusion:vortex-file-compressed 65085360 / 65616703 / -0.8% 125503105 / 123770387 / +1.4% 0.52 / 0.53 / -2.2%
tpcds_q50/datafusion:vortex-file-compressed 45083623 / 45497389 / -0.9% 100660664 / 97560123 / +3.2% 0.45 / 0.47 / -4.0%
tpcds_q51/datafusion:vortex-file-compressed 73394481 / 73892335 / -0.7% 134952341 / 134015829 / +0.7% 0.54 / 0.55 / -1.4%
tpcds_q52/datafusion:vortex-file-compressed 14872284 / 14959244 / -0.6% 57909287 / 59093306 / -2.0% 0.26 / 0.25 / +1.5%
tpcds_q53/datafusion:vortex-file-compressed 24472408 / 24498840 / -0.1% 77166975 / 75275436 / +2.5% 0.32 / 0.33 / -2.6%
tpcds_q54/datafusion:vortex-file-compressed 37452576 / 38379195 / -2.4% 89781197 / 87791343 / +2.3% 0.42 / 0.44 / -4.6%
tpcds_q55/datafusion:vortex-file-compressed 13608982 / 14231228 / -4.4% 58787387 / 56348920 / +4.3% 0.23 / 0.25 / -8.3%
tpcds_q56/datafusion:vortex-file-compressed 32245417 / 31362110 / +2.8% 89562681 / 87034764 / +2.9% 0.36 / 0.36 / -0.1%
tpcds_q57/datafusion:vortex-file-compressed 95114206 / 94630266 / +0.5% 167151397 / 162428934 / +2.9% 0.57 / 0.58 / -2.3%
tpcds_q58/datafusion:vortex-file-compressed 59587667 / 60276335 / -1.1% 128113603 / 124104153 / +3.2% 0.47 / 0.49 / -4.2%
tpcds_q59/datafusion:vortex-file-compressed 54676205 / 54222176 / +0.8% 109262551 / 107153794 / +2.0% 0.50 / 0.51 / -1.1%
tpcds_q60/datafusion:vortex-file-compressed 32125424 / 32137006 / -0.0% 88042476 / 87278496 / +0.9% 0.36 / 0.37 / -0.9%
tpcds_q61/datafusion:vortex-file-compressed 35292964 / 35498572 / -0.6% 89297314 / 85798482 / +4.1% 0.40 / 0.41 / -4.5%
tpcds_q62/datafusion:vortex-file-compressed 23841230 / 24068484 / -0.9% 67397296 / 68934831 / -2.2% 0.35 / 0.35 / +1.3%
tpcds_q63/datafusion:vortex-file-compressed 25562283 / 24759911 / +3.2% 80524032 / 75582878 / +6.5% 0.32 / 0.33 / -3.1%
tpcds_q64/datafusion:vortex-file-compressed 459435363 / 457762294 / +0.4% 572099053 / 570199762 / +0.3% 0.80 / 0.80 / +0.0%
tpcds_q65/datafusion:vortex-file-compressed 68134736 / 68282066 / -0.2% 128155363 / 128579635 / -0.3% 0.53 / 0.53 / +0.1%
tpcds_q66/datafusion:vortex-file-compressed 76174522 / 75123257 / +1.4% 133905949 / 135007758 / -0.8% 0.57 / 0.56 / +2.2%
tpcds_q67/datafusion:vortex-file-compressed 111997388 / 109260586 / +2.5% 195655856 / 198995037 / -1.7% 0.57 / 0.55 / +4.3%
tpcds_q68/datafusion:vortex-file-compressed 32615561 / 33311160 / -2.1% 98560925 / 98924301 / -0.4% 0.33 / 0.34 / -1.7%
tpcds_q69/datafusion:vortex-file-compressed 35229138 / 34270056 / +2.8% 79225087 / 77595368 / +2.1% 0.44 / 0.44 / +0.7%
tpcds_q70/datafusion:vortex-file-compressed 110193071 / 107718389 / +2.3% 168684420 / 162631744 / +3.7% 0.65 / 0.66 / -1.4%
tpcds_q71/datafusion:vortex-file-compressed 24006684 / 24342864 / -1.4% 71283581 / 72554296 / -1.8% 0.34 / 0.34 / +0.4%
tpcds_q72/datafusion:vortex-file-compressed 1457395194 / 1449254424 / +0.6% 1539897343 / 1524523948 / +1.0% 0.95 / 0.95 / -0.4%
tpcds_q73/datafusion:vortex-file-compressed 25003262 / 24480648 / +2.1% 76146918 / 75616900 / +0.7% 0.33 / 0.32 / +1.4%
tpcds_q74/datafusion:vortex-file-compressed 74693815 / 74475590 / +0.3% 135988465 / 137753596 / -1.3% 0.55 / 0.54 / +1.6%
tpcds_q75/datafusion:vortex-file-compressed 132409593 / 131703463 / +0.5% 212925465 / 210315863 / +1.2% 0.62 / 0.63 / -0.7%
tpcds_q76/datafusion:vortex-file-compressed 40596198 / 40783902 / -0.5% 90644736 / 91129738 / -0.5% 0.45 / 0.45 / +0.1%
tpcds_q77/datafusion:vortex-file-compressed 41561078 / 42404344 / -2.0% 98226465 / 94843680 / +3.6% 0.42 / 0.45 / -5.4%
tpcds_q78/datafusion:vortex-file-compressed 103648056 / 103987718 / -0.3% 178058702 / 172142090 / +3.4% 0.58 / 0.60 / -3.6%
tpcds_q79/datafusion:vortex-file-compressed 28364313 / 28748990 / -1.3% 85593731 / 81181294 / +5.4% 0.33 / 0.35 / -6.4%
tpcds_q80/datafusion:vortex-file-compressed 94142262 / 94284407 / -0.2% 181131578 / 183986943 / -1.6% 0.52 / 0.51 / +1.4%
tpcds_q81/datafusion:vortex-file-compressed 33676902 / 33985855 / -0.9% 75325452 / 76285552 / -1.3% 0.45 / 0.45 / +0.4%
tpcds_q82/datafusion:vortex-file-compressed 19246615 / 19794446 / -2.8% 62137139 / 66079685 / -6.0% 0.31 / 0.30 / +3.4%
tpcds_q83/datafusion:vortex-file-compressed 45524378 / 45085744 / +1.0% 85551830 / 86550745 / -1.2% 0.53 / 0.52 / +2.2%
tpcds_q84/datafusion:vortex-file-compressed 14667286 / 14537120 / +0.9% 53616825 / 49827013 / +7.6% 0.27 / 0.29 / -6.2%
tpcds_q85/datafusion:vortex-file-compressed 99267938 / 100312394 / -1.0% 168852540 / 166642283 / +1.3% 0.59 / 0.60 / -2.3%
tpcds_q86/datafusion:vortex-file-compressed 19053827 / 19163369 / -0.6% 62838525 / 60285091 / +4.2% 0.30 / 0.32 / -4.6%
tpcds_q87/datafusion:vortex-file-compressed 41837584 / 41028508 / +2.0% 94530480 / 95648654 / -1.2% 0.44 / 0.43 / +3.2%
tpcds_q88/datafusion:vortex-file-compressed 51308016 / 51140780 / +0.3% 101080702 / 115349141 / -12.4% 🟢 0.51 / 0.44 / +14.5%
tpcds_q89/datafusion:vortex-file-compressed 27259752 / 26108549 / +4.4% 80828199 / 81496837 / -0.8% 0.34 / 0.32 / +5.3%
tpcds_q90/datafusion:vortex-file-compressed 14923986 / 14451181 / +3.3% 52109571 / 48504169 / +7.4% 0.29 / 0.30 / -3.9%
tpcds_q91/datafusion:vortex-file-compressed 22102332 / 21270950 / +3.9% 55241454 / 55986210 / -1.3% 0.40 / 0.38 / +5.3%
tpcds_q92/datafusion:vortex-file-compressed 17786713 / 17962956 / -1.0% 59217306 / 58744784 / +0.8% 0.30 / 0.31 / -1.8%
tpcds_q93/datafusion:vortex-file-compressed 30734241 / 31701929 / -3.1% 81382741 / 84277316 / -3.4% 0.38 / 0.38 / +0.4%
tpcds_q94/datafusion:vortex-file-compressed 23122370 / 22711590 / +1.8% 65071384 / 65184481 / -0.2% 0.36 / 0.35 / +2.0%
tpcds_q95/datafusion:vortex-file-compressed 58686144 / 60249916 / -2.6% 117732015 / 117546144 / +0.2% 0.50 / 0.51 / -2.7%
tpcds_q96/datafusion:vortex-file-compressed 11688344 / 12110085 / -3.5% 51329064 / 51993648 / -1.3% 0.23 / 0.23 / -2.2%
tpcds_q97/datafusion:vortex-file-compressed 27107291 / 27056351 / +0.2% 81122719 / 81800915 / -0.8% 0.33 / 0.33 / +1.0%
tpcds_q98/datafusion:vortex-file-compressed 24313114 / 25111139 / -3.2% 78920111 / 81954533 / -3.7% 0.31 / 0.31 / +0.5%
tpcds_q99/datafusion:vortex-file-compressed 27143748 / 27794184 / -2.3% 77666820 / 74344404 / +4.5% 0.35 / 0.37 / -6.5%
datafusion / parquet / ns (0.997x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 29801150 / 30344952 / -1.8% 74915557 / 69622768 / +7.6% 0.40 / 0.44 / -8.7%
tpcds_q02/datafusion:parquet 52201642 / 53349229 / -2.2% 103012891 / 95923107 / +7.4% 0.51 / 0.56 / -8.9%
tpcds_q03/datafusion:parquet 18402246 / 18754856 / -1.9% 58277177 / 59328000 / -1.8% 0.32 / 0.32 / -0.1%
tpcds_q04/datafusion:parquet 319751638 / 317106258 / +0.8% 405120350 / 394894340 / +2.6% 0.79 / 0.80 / -1.7%
tpcds_q05/datafusion:parquet 83325178 / 80832126 / +3.1% 142273710 / 142342193 / -0.0% 0.59 / 0.57 / +3.1%
tpcds_q06/datafusion:parquet 29542717 / 30184956 / -2.1% 77914259 / 78609472 / -0.9% 0.38 / 0.38 / -1.3%
tpcds_q07/datafusion:parquet 96382507 / 97530376 / -1.2% 154015624 / 152630162 / +0.9% 0.63 / 0.64 / -2.1%
tpcds_q08/datafusion:parquet 37503997 / 37115513 / +1.0% 85365512 / 82568275 / +3.4% 0.44 / 0.45 / -2.3%
tpcds_q09/datafusion:parquet 33074360 / 35818976 / -7.7% 101961930 / 98376689 / +3.6% 0.32 / 0.36 / -10.9%
tpcds_q10/datafusion:parquet 90034486 / 88686747 / +1.5% 137667056 / 136139911 / +1.1% 0.65 / 0.65 / +0.4%
tpcds_q11/datafusion:parquet 162259683 / 158809373 / +2.2% 229819981 / 233155463 / -1.4% 0.71 / 0.68 / +3.7%
tpcds_q12/datafusion:parquet 25750329 / 26668024 / -3.4% 65762687 / 67013945 / -1.9% 0.39 / 0.40 / -1.6%
tpcds_q13/datafusion:parquet 98258725 / 95592833 / +2.8% 163537604 / 160995961 / +1.6% 0.60 / 0.59 / +1.2%
tpcds_q14/datafusion:parquet 263046306 / 262962368 / +0.0% 341081149 / 345396662 / -1.2% 0.77 / 0.76 / +1.3%
tpcds_q15/datafusion:parquet 37869346 / 39591638 / -4.4% 80148733 / 78988489 / +1.5% 0.47 / 0.50 / -5.7%
tpcds_q16/datafusion:parquet 46597636 / 46721350 / -0.3% 85662446 / 88335839 / -3.0% 0.54 / 0.53 / +2.8%
tpcds_q17/datafusion:parquet 107508808 / 106519421 / +0.9% 173426216 / 174571333 / -0.7% 0.62 / 0.61 / +1.6%
tpcds_q18/datafusion:parquet 126751299 / 125490928 / +1.0% 184210398 / 184350197 / -0.1% 0.69 / 0.68 / +1.1%
tpcds_q19/datafusion:parquet 29736181 / 29924740 / -0.6% 76493373 / 77982253 / -1.9% 0.39 / 0.38 / +1.3%
tpcds_q20/datafusion:parquet 30892092 / 31608779 / -2.3% 71851724 / 70250733 / +2.3% 0.43 / 0.45 / -4.4%
tpcds_q21/datafusion:parquet 22956984 / 23446472 / -2.1% 65573706 / 59639891 / +9.9% 0.35 / 0.39 / -10.9%
tpcds_q22/datafusion:parquet 118553632 / 113934662 / +4.1% 215789951 / 216018871 / -0.1% 0.55 / 0.53 / +4.2%
tpcds_q23/datafusion:parquet 163193089 / 162938955 / +0.2% 238546829 / 240230824 / -0.7% 0.68 / 0.68 / +0.9%
tpcds_q24/datafusion:parquet 133409092 / 133952716 / -0.4% 200964295 / 201088578 / -0.1% 0.66 / 0.67 / -0.3%
tpcds_q25/datafusion:parquet 110340488 / 107886970 / +2.3% 170737142 / 176011065 / -3.0% 0.65 / 0.61 / +5.4%
tpcds_q26/datafusion:parquet 83831808 / 84706552 / -1.0% 137099367 / 135528117 / +1.2% 0.61 / 0.63 / -2.2%
tpcds_q27/datafusion:parquet 151417799 / 148472658 / +2.0% 232708584 / 233905877 / -0.5% 0.65 / 0.63 / +2.5%
tpcds_q28/datafusion:parquet 36357292 / 36753454 / -1.1% 96854016 / 91788146 / +5.5% 0.38 / 0.40 / -6.3%
tpcds_q29/datafusion:parquet 107010490 / 108747192 / -1.6% 180032572 / 176261071 / +2.1% 0.59 / 0.62 / -3.7%
tpcds_q30/datafusion:parquet 44575561 / 44683340 / -0.2% 93033152 / 91093009 / +2.1% 0.48 / 0.49 / -2.3%
tpcds_q31/datafusion:parquet 90847554 / 88437789 / +2.7% 144613049 / 144138220 / +0.3% 0.63 / 0.61 / +2.4%
tpcds_q32/datafusion:parquet 25582618 / 26764611 / -4.4% 64202656 / 63386918 / +1.3% 0.40 / 0.42 / -5.6%
tpcds_q33/datafusion:parquet 40748764 / 38512753 / +5.8% 91555088 / 85766029 / +6.7% 0.45 / 0.45 / -0.9%
tpcds_q34/datafusion:parquet 29703824 / 29122726 / +2.0% 75944387 / 69293176 / +9.6% 0.39 / 0.42 / -6.9%
tpcds_q35/datafusion:parquet 93931323 / 94191436 / -0.3% 144769173 / 143848948 / +0.6% 0.65 / 0.65 / -0.9%
tpcds_q36/datafusion:parquet 64601526 / 62696292 / +3.0% 142546261 / 139675124 / +2.1% 0.45 / 0.45 / +1.0%
tpcds_q37/datafusion:parquet 24967596 / 24560044 / +1.7% 65020953 / 64675656 / +0.5% 0.38 / 0.38 / +1.1%
tpcds_q38/datafusion:parquet 56728912 / 55079976 / +3.0% 104553458 / 102904817 / +1.6% 0.54 / 0.54 / +1.4%
tpcds_q39/datafusion:parquet 77721212 / 77214103 / +0.7% 131870595 / 125806913 / +4.8% 0.59 / 0.61 / -4.0%
tpcds_q40/datafusion:parquet 32545468 / 32533664 / +0.0% 78240072 / 80481176 / -2.8% 0.42 / 0.40 / +2.9%
tpcds_q41/datafusion:parquet 20925156 / 21458675 / -2.5% 50077300 / 48407170 / +3.5% 0.42 / 0.44 / -5.7%
tpcds_q42/datafusion:parquet 17334006 / 17113684 / +1.3% 57082604 / 54375697 / +5.0% 0.30 / 0.31 / -3.5%
tpcds_q43/datafusion:parquet 22094722 / 22247026 / -0.7% 66250462 / 66826830 / -0.9% 0.33 / 0.33 / +0.2%
tpcds_q44/datafusion:parquet 38389474 / 39016394 / -1.6% 95801242 / 96381432 / -0.6% 0.40 / 0.40 / -1.0%
tpcds_q45/datafusion:parquet 45433618 / 44830976 / +1.3% 95627848 / 91261397 / +4.8% 0.48 / 0.49 / -3.3%
tpcds_q46/datafusion:parquet 40482552 / 41910958 / -3.4% 100320567 / 98025390 / +2.3% 0.40 / 0.43 / -5.6%
tpcds_q47/datafusion:parquet 141925482 / 139639354 / +1.6% 206687405 / 214420880 / -3.6% 0.69 / 0.65 / +5.4%
tpcds_q48/datafusion:parquet 86955521 / 86880640 / +0.1% 140975848 / 137401309 / +2.6% 0.62 / 0.63 / -2.5%
tpcds_q49/datafusion:parquet 71854020 / 70642200 / +1.7% 139228239 / 137269306 / +1.4% 0.52 / 0.51 / +0.3%
tpcds_q50/datafusion:parquet 71481970 / 73272734 / -2.4% 119004908 / 120475185 / -1.2% 0.60 / 0.61 / -1.2%
tpcds_q51/datafusion:parquet 79414772 / 78809438 / +0.8% 140722714 / 138526679 / +1.6% 0.56 / 0.57 / -0.8%
tpcds_q52/datafusion:parquet 16868422 / 18748066 / -10.0% 🟢 54955115 / 56102477 / -2.0% 0.31 / 0.33 / -8.1%
tpcds_q53/datafusion:parquet 26257320 / 25047667 / +4.8% 70706205 / 68415410 / +3.3% 0.37 / 0.37 / +1.4%
tpcds_q54/datafusion:parquet 44511049 / 44306746 / +0.5% 95708633 / 92581311 / +3.4% 0.47 / 0.48 / -2.8%
tpcds_q55/datafusion:parquet 17502591 / 16138976 / +8.4% 57265970 / 56555142 / +1.3% 0.31 / 0.29 / +7.1%
tpcds_q56/datafusion:parquet 37163758 / 38592970 / -3.7% 92657488 / 91237929 / +1.6% 0.40 / 0.42 / -5.2%
tpcds_q57/datafusion:parquet 121136390 / 118209190 / +2.5% 184946918 / 185879974 / -0.5% 0.65 / 0.64 / +3.0%
tpcds_q58/datafusion:parquet 78825128 / 79038020 / -0.3% 137464312 / 138532509 / -0.8% 0.57 / 0.57 / +0.5%
tpcds_q59/datafusion:parquet 70639859 / 71433488 / -1.1% 123790038 / 121248317 / +2.1% 0.57 / 0.59 / -3.1%
tpcds_q60/datafusion:parquet 38800774 / 36947508 / +5.0% 92014842 / 91572712 / +0.5% 0.42 / 0.40 / +4.5%
tpcds_q61/datafusion:parquet 45871052 / 46701542 / -1.8% 104305984 / 102929931 / +1.3% 0.44 / 0.45 / -3.1%
tpcds_q62/datafusion:parquet 27404067 / 31572291 / -13.2% 🟢 76316793 / 69699742 / +9.5% 0.36 / 0.45 / -20.7%
tpcds_q63/datafusion:parquet 25560712 / 25622355 / -0.2% 72286027 / 67467808 / +7.1% 0.35 / 0.38 / -6.9%
tpcds_q64/datafusion:parquet 348024354 / 354553890 / -1.8% 434575602 / 435898549 / -0.3% 0.80 / 0.81 / -1.5%
tpcds_q65/datafusion:parquet 46318950 / 46231416 / +0.2% 105669687 / 110676136 / -4.5% 0.44 / 0.42 / +4.9%
tpcds_q66/datafusion:parquet 85848496 / 81700482 / +5.1% 127894120 / 135524420 / -5.6% 0.67 / 0.60 / +11.3%
tpcds_q67/datafusion:parquet 130526422 / 133005032 / -1.9% 213241289 / 211603052 / +0.8% 0.61 / 0.63 / -2.6%
tpcds_q68/datafusion:parquet 40084823 / 39618825 / +1.2% 97254058 / 92601386 / +5.0% 0.41 / 0.43 / -3.7%
tpcds_q69/datafusion:parquet 85949644 / 84594764 / +1.6% 134254532 / 136998212 / -2.0% 0.64 / 0.62 / +3.7%
tpcds_q70/datafusion:parquet 43484926 / 42163861 / +3.1% 91724653 / 94984033 / -3.4% 0.47 / 0.44 / +6.8%
tpcds_q71/datafusion:parquet 26407636 / 28321514 / -6.8% 79515656 / 74858787 / +6.2% 0.33 / 0.38 / -12.2%
tpcds_q72/datafusion:parquet 441347546 / 443157626 / -0.4% 550408092 / 534891255 / +2.9% 0.80 / 0.83 / -3.2%
tpcds_q73/datafusion:parquet 29731856 / 29714644 / +0.1% 75052817 / 70374818 / +6.6% 0.40 / 0.42 / -6.2%
tpcds_q74/datafusion:parquet 96932077 / 98552030 / -1.6% 153991211 / 153694476 / +0.2% 0.63 / 0.64 / -1.8%
tpcds_q75/datafusion:parquet 157266532 / 160682554 / -2.1% 237986426 / 232560829 / +2.3% 0.66 / 0.69 / -4.4%
tpcds_q76/datafusion:parquet 56566213 / 56938944 / -0.7% 103653851 / 102658932 / +1.0% 0.55 / 0.55 / -1.6%
tpcds_q77/datafusion:parquet 54004194 / 55028340 / -1.9% 107072190 / 110985376 / -3.5% 0.50 / 0.50 / +1.7%
tpcds_q78/datafusion:parquet 121903876 / 116366326 / +4.8% 195206780 / 205364547 / -4.9% 0.62 / 0.57 / +10.2%
tpcds_q79/datafusion:parquet 33048379 / 32993820 / +0.2% 83888908 / 79349666 / +5.7% 0.39 / 0.42 / -5.3%
tpcds_q80/datafusion:parquet 94032169 / 91763635 / +2.5% 187606422 / 184584843 / +1.6% 0.50 / 0.50 / +0.8%
tpcds_q81/datafusion:parquet 40397600 / 40887678 / -1.2% 87684142 / 91204779 / -3.9% 0.46 / 0.45 / +2.8%
tpcds_q82/datafusion:parquet 24044940 / 24969817 / -3.7% 64049401 / 64610893 / -0.9% 0.38 / 0.39 / -2.9%
tpcds_q83/datafusion:parquet 56196182 / 56533834 / -0.6% 100063062 / 104369071 / -4.1% 0.56 / 0.54 / +3.7%
tpcds_q84/datafusion:parquet 47058316 / 46096682 / +2.1% 86862967 / 85218606 / +1.9% 0.54 / 0.54 / +0.2%
tpcds_q85/datafusion:parquet 182471228 / 183091294 / -0.3% 259409763 / 261156675 / -0.7% 0.70 / 0.70 / +0.3%
tpcds_q86/datafusion:parquet 23095586 / 25694737 / -10.1% 🟢 57969480 / 56710027 / +2.2% 0.40 / 0.45 / -12.1%
tpcds_q87/datafusion:parquet 58316988 / 59003886 / -1.2% 108867388 / 109458793 / -0.5% 0.54 / 0.54 / -0.6%
tpcds_q88/datafusion:parquet 56714466 / 57297529 / -1.0% 114100430 / 115839250 / -1.5% 0.50 / 0.49 / +0.5%
tpcds_q89/datafusion:parquet 29062861 / 29827008 / -2.6% 77508017 / 75388807 / +2.8% 0.37 / 0.40 / -5.2%
tpcds_q90/datafusion:parquet 20194292 / 19564572 / +3.2% 56136056 / 52087295 / +7.8% 0.36 / 0.38 / -4.2%
tpcds_q91/datafusion:parquet 63215420 / 62946894 / +0.4% 103665612 / 107012423 / -3.1% 0.61 / 0.59 / +3.7%
tpcds_q92/datafusion:parquet 23717926 / 24130588 / -1.7% 66620348 / 65036029 / +2.4% 0.36 / 0.37 / -4.0%
tpcds_q93/datafusion:parquet 33917684 / 33664634 / +0.8% 91130875 / 91745859 / -0.7% 0.37 / 0.37 / +1.4%
tpcds_q94/datafusion:parquet 32296534 / 31560306 / +2.3% 72361538 / 73674495 / -1.8% 0.45 / 0.43 / +4.2%
tpcds_q95/datafusion:parquet 85403465 / 85009194 / +0.5% 147014216 / 141482540 / +3.9% 0.58 / 0.60 / -3.3%
tpcds_q96/datafusion:parquet 15934053 / 16551801 / -3.7% 54242405 / 54728188 / -0.9% 0.29 / 0.30 / -2.9%
tpcds_q97/datafusion:parquet 37127844 / 37300187 / -0.5% 85084868 / 87280590 / -2.5% 0.44 / 0.43 / +2.1%
tpcds_q98/datafusion:parquet 27668490 / 27339308 / +1.2% 74239911 / 73415859 / +1.1% 0.37 / 0.37 / +0.1%
tpcds_q99/datafusion:parquet 34870538 / 35404026 / -1.5% 75838530 / 69088260 / +9.8% 0.46 / 0.51 / -10.3%
duckdb / vortex-file-compressed / ns (0.990x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 23379316 / 24865207 / -6.0% 44889931 / 44451409 / +1.0% 0.52 / 0.56 / -6.9%
tpcds_q02/duckdb:vortex-file-compressed 28131858 / 31133266 / -9.6% 47954965 / 52761451 / -9.1% 0.59 / 0.59 / -0.6%
tpcds_q03/duckdb:vortex-file-compressed 19318315 / 20138165 / -4.1% 41271664 / 42277239 / -2.4% 0.47 / 0.48 / -1.7%
tpcds_q04/duckdb:vortex-file-compressed 94344400 / 94891802 / -0.6% 125225644 / 126733431 / -1.2% 0.75 / 0.75 / +0.6%
tpcds_q05/duckdb:vortex-file-compressed 33656010 / 33706285 / -0.1% 56838328 / 58642804 / -3.1% 0.59 / 0.57 / +3.0%
tpcds_q06/duckdb:vortex-file-compressed 43700411 / 44125576 / -1.0% 71542201 / 72337304 / -1.1% 0.61 / 0.61 / +0.1%
tpcds_q07/duckdb:vortex-file-compressed 28682054 / 29913652 / -4.1% 66326191 / 61353813 / +8.1% 0.43 / 0.49 / -11.3%
tpcds_q08/duckdb:vortex-file-compressed 36456037 / 36878998 / -1.1% 58726912 / 58438577 / +0.5% 0.62 / 0.63 / -1.6%
tpcds_q09/duckdb:vortex-file-compressed 16650675 / 17883964 / -6.9% 59271915 / 51436896 / +15.2% 🔴 0.28 / 0.35 / -19.2%
tpcds_q10/duckdb:vortex-file-compressed 51838418 / 51975154 / -0.3% 90520125 / 87551264 / +3.4% 0.57 / 0.59 / -3.5%
tpcds_q11/duckdb:vortex-file-compressed 73684438 / 75199152 / -2.0% 99839719 / 100359623 / -0.5% 0.74 / 0.75 / -1.5%
tpcds_q12/duckdb:vortex-file-compressed 16938520 / 17006488 / -0.4% 35433614 / 35836301 / -1.1% 0.48 / 0.47 / +0.7%
tpcds_q13/duckdb:vortex-file-compressed 40475106 / 37904386 / +6.8% 75850393 / 71184908 / +6.6% 0.53 / 0.53 / +0.2%
tpcds_q14/duckdb:vortex-file-compressed 105714128 / 105263333 / +0.4% 159146046 / 151396499 / +5.1% 0.66 / 0.70 / -4.5%
tpcds_q15/duckdb:vortex-file-compressed 32480831 / 32604280 / -0.4% 53157884 / 52416539 / +1.4% 0.61 / 0.62 / -1.8%
tpcds_q16/duckdb:vortex-file-compressed 31242884 / 35558378 / -12.1% 🟢 56280794 / 53529590 / +5.1% 0.56 / 0.66 / -16.4%
tpcds_q17/duckdb:vortex-file-compressed 50280336 / 53667054 / -6.3% 89195948 / 90474803 / -1.4% 0.56 / 0.59 / -5.0%
tpcds_q18/duckdb:vortex-file-compressed 47960352 / 45989416 / +4.3% 70602223 / 70944910 / -0.5% 0.68 / 0.65 / +4.8%
tpcds_q19/duckdb:vortex-file-compressed 41383423 / 37403822 / +10.6% 🔴 67493327 / 64899783 / +4.0% 0.61 / 0.58 / +6.4%
tpcds_q20/duckdb:vortex-file-compressed 17982298 / 18856875 / -4.6% 32875251 / 37275362 / -11.8% 🟢 0.55 / 0.51 / +8.1%
tpcds_q21/duckdb:vortex-file-compressed 19604124 / 22542551 / -13.0% 🟢 60642832 / 57721127 / +5.1% 0.32 / 0.39 / -17.2%
tpcds_q22/duckdb:vortex-file-compressed 64237774 / 63084766 / +1.8% 108523143 / 106827532 / +1.6% 0.59 / 0.59 / +0.2%
tpcds_q23/duckdb:vortex-file-compressed 69867232 / 69562049 / +0.4% 109727987 / 109356072 / +0.3% 0.64 / 0.64 / +0.1%
tpcds_q24/duckdb:vortex-file-compressed 50342286 / 51450602 / -2.2% 80372561 / 83444480 / -3.7% 0.63 / 0.62 / +1.6%
tpcds_q25/duckdb:vortex-file-compressed 46165207 / 45338019 / +1.8% 78517304 / 77240564 / +1.7% 0.59 / 0.59 / +0.2%
tpcds_q26/duckdb:vortex-file-compressed 24680522 / 23823938 / +3.6% 40447834 / 40196223 / +0.6% 0.61 / 0.59 / +3.0%
tpcds_q27/duckdb:vortex-file-compressed 30771165 / 31260148 / -1.6% 61646565 / 64303673 / -4.1% 0.50 / 0.49 / +2.7%
tpcds_q28/duckdb:vortex-file-compressed 12478568 / 12099576 / +3.1% 28496774 / 26428290 / +7.8% 0.44 / 0.46 / -4.4%
tpcds_q29/duckdb:vortex-file-compressed 50187899 / 52692082 / -4.8% 91624820 / 87754588 / +4.4% 0.55 / 0.60 / -8.8%
tpcds_q30/duckdb:vortex-file-compressed 32849030 / 33470935 / -1.9% 62166518 / 52399277 / +18.6% 🔴 0.53 / 0.64 / -17.3%
tpcds_q31/duckdb:vortex-file-compressed 31900120 / 34645676 / -7.9% 60631273 / 56515773 / +7.3% 0.53 / 0.61 / -14.2%
tpcds_q32/duckdb:vortex-file-compressed 18582938 / 18596904 / -0.1% 37320278 / 37503005 / -0.5% 0.50 / 0.50 / +0.4%
tpcds_q33/duckdb:vortex-file-compressed 29927887 / 29845930 / +0.3% 58266909 / 60894103 / -4.3% 0.51 / 0.49 / +4.8%
tpcds_q34/duckdb:vortex-file-compressed 24434142 / 25305900 / -3.4% 48522027 / 50591934 / -4.1% 0.50 / 0.50 / +0.7%
tpcds_q35/duckdb:vortex-file-compressed 78860929 / 78119546 / +0.9% 114767260 / 112785519 / +1.8% 0.69 / 0.69 / -0.8%
tpcds_q36/duckdb:vortex-file-compressed 28419913 / 29775881 / -4.6% 62096467 / 61407214 / +1.1% 0.46 / 0.48 / -5.6%
tpcds_q37/duckdb:vortex-file-compressed 24465337 / 25374846 / -3.6% 50594759 / 56209993 / -10.0% 0.48 / 0.45 / +7.1%
tpcds_q38/duckdb:vortex-file-compressed 38637994 / 38390124 / +0.6% 62275756 / 59313560 / +5.0% 0.62 / 0.65 / -4.1%
tpcds_q39/duckdb:vortex-file-compressed 33891487 / 34242252 / -1.0% 71685167 / 67593165 / +6.1% 0.47 / 0.51 / -6.7%
tpcds_q40/duckdb:vortex-file-compressed 22161461 / 23243128 / -4.7% 43594427 / 39489367 / +10.4% 🔴 0.51 / 0.59 / -13.6%
tpcds_q41/duckdb:vortex-file-compressed 9510488 / 9074749 / +4.8% 19915337 / 20607902 / -3.4% 0.48 / 0.44 / +8.4%
tpcds_q42/duckdb:vortex-file-compressed 16513762 / 17276360 / -4.4% 40360962 / 41016433 / -1.6% 0.41 / 0.42 / -2.9%
tpcds_q43/duckdb:vortex-file-compressed 19249918 / 19702552 / -2.3% 36954485 / 42407096 / -12.9% 🟢 0.52 / 0.46 / +12.1%
tpcds_q44/duckdb:vortex-file-compressed 24145524 / 24396067 / -1.0% 65454568 / 60046612 / +9.0% 0.37 / 0.41 / -9.2%
tpcds_q45/duckdb:vortex-file-compressed 35060424 / 36036719 / -2.7% 55490035 / 51394157 / +8.0% 0.63 / 0.70 / -9.9%
tpcds_q46/duckdb:vortex-file-compressed 31654074 / 31016798 / +2.1% 63576837 / 60008809 / +5.9% 0.50 / 0.52 / -3.7%
tpcds_q47/duckdb:vortex-file-compressed 56269470 / 54512980 / +3.2% 86559979 / 84964180 / +1.9% 0.65 / 0.64 / +1.3%
tpcds_q48/duckdb:vortex-file-compressed 36216952 / 35349964 / +2.5% 67537081 / 71365212 / -5.4% 0.54 / 0.50 / +8.3%
tpcds_q49/duckdb:vortex-file-compressed 33385093 / 33524490 / -0.4% 69702191 / 69277945 / +0.6% 0.48 / 0.48 / -1.0%
tpcds_q50/duckdb:vortex-file-compressed 28901900 / 32124686 / -10.0% 🟢 58918634 / 57581952 / +2.3% 0.49 / 0.56 / -12.1%
tpcds_q51/duckdb:vortex-file-compressed 98039002 / 103291748 / -5.1% 121057410 / 121745332 / -0.6% 0.81 / 0.85 / -4.5%
tpcds_q52/duckdb:vortex-file-compressed 16518151 / 16202409 / +1.9% 42104404 / 40654288 / +3.6% 0.39 / 0.40 / -1.6%
tpcds_q53/duckdb:vortex-file-compressed 25446775 / 24471968 / +4.0% 51646793 / 57306530 / -9.9% 0.49 / 0.43 / +15.4%
tpcds_q54/duckdb:vortex-file-compressed 36323733 / 37079220 / -2.0% 68607502 / 63277215 / +8.4% 0.53 / 0.59 / -9.6%
tpcds_q55/duckdb:vortex-file-compressed 16410702 / 17397466 / -5.7% 40613833 / 40599345 / +0.0% 0.40 / 0.43 / -5.7%
tpcds_q56/duckdb:vortex-file-compressed 29696511 / 28647793 / +3.7% 61762341 / 59716244 / +3.4% 0.48 / 0.48 / +0.2%
tpcds_q57/duckdb:vortex-file-compressed 39210946 / 43133232 / -9.1% 63576900 / 58985331 / +7.8% 0.62 / 0.73 / -15.7%
tpcds_q58/duckdb:vortex-file-compressed 35043105 / 30840031 / +13.6% 🔴 59496070 / 64011927 / -7.1% 0.59 / 0.48 / +22.3%
tpcds_q59/duckdb:vortex-file-compressed 38361664 / 39751294 / -3.5% 59837242 / 58428796 / +2.4% 0.64 / 0.68 / -5.8%
tpcds_q60/duckdb:vortex-file-compressed 29974514 / 31535965 / -5.0% 63536429 / 61983572 / +2.5% 0.47 / 0.51 / -7.3%
tpcds_q61/duckdb:vortex-file-compressed 37851319 / 35662063 / +6.1% 78381346 / 74203404 / +5.6% 0.48 / 0.48 / +0.5%
tpcds_q62/duckdb:vortex-file-compressed 18491696 / 19831243 / -6.8% 38415879 / 35810043 / +7.3% 0.48 / 0.55 / -13.1%
tpcds_q63/duckdb:vortex-file-compressed 25898134 / 24843609 / +4.2% 52116571 / 46103763 / +13.0% 🔴 0.50 / 0.54 / -7.8%
tpcds_q64/duckdb:vortex-file-compressed 110387026 / 110608826 / -0.2% 149209635 / 152240925 / -2.0% 0.74 / 0.73 / +1.8%
tpcds_q65/duckdb:vortex-file-compressed 23844560 / 25345324 / -5.9% 51000805 / 44068681 / +15.7% 🔴 0.47 / 0.58 / -18.7%
tpcds_q66/duckdb:vortex-file-compressed 37719094 / 39619298 / -4.8% 69495700 / 67058296 / +3.6% 0.54 / 0.59 / -8.1%
tpcds_q67/duckdb:vortex-file-compressed 119198587 / 129269776 / -7.8% 163388003 / 162627977 / +0.5% 0.73 / 0.79 / -8.2%
tpcds_q68/duckdb:vortex-file-compressed 30807130 / 30034536 / +2.6% 65252576 / 64780130 / +0.7% 0.47 / 0.46 / +1.8%
tpcds_q69/duckdb:vortex-file-compressed 53011862 / 53096284 / -0.2% 89544063 / 91621563 / -2.3% 0.59 / 0.58 / +2.2%
tpcds_q70/duckdb:vortex-file-compressed 36317364 / 37577667 / -3.4% 63407787 / 67031209 / -5.4% 0.57 / 0.56 / +2.2%
tpcds_q71/duckdb:vortex-file-compressed 23718052 / 25997874 / -8.8% 58533240 / 54468824 / +7.5% 0.41 / 0.48 / -15.1%
tpcds_q72/duckdb:vortex-file-compressed 146563800 / 146257904 / +0.2% 192587393 / 184871175 / +4.2% 0.76 / 0.79 / -3.8%
tpcds_q73/duckdb:vortex-file-compressed 26636873 / 25503440 / +4.4% 45180879 / 46855300 / -3.6% 0.59 / 0.54 / +8.3%
tpcds_q74/duckdb:vortex-file-compressed 49379812 / 51478010 / -4.1% 74626233 / 72661741 / +2.7% 0.66 / 0.71 / -6.6%
tpcds_q75/duckdb:vortex-file-compressed 51266502 / 53940228 / -5.0% 84749021 / 87626206 / -3.3% 0.60 / 0.62 / -1.7%
tpcds_q76/duckdb:vortex-file-compressed 24757546 / 23922051 / +3.5% 55469115 / 58347863 / -4.9% 0.45 / 0.41 / +8.9%
tpcds_q77/duckdb:vortex-file-compressed 28324546 / 28145323 / +0.6% 52384922 / 53512207 / -2.1% 0.54 / 0.53 / +2.8%
tpcds_q78/duckdb:vortex-file-compressed 72780052 / 71881230 / +1.3% 102487284 / 102335986 / +0.1% 0.71 / 0.70 / +1.1%
tpcds_q79/duckdb:vortex-file-compressed 28225337 / 28867040 / -2.2% 55201994 / 59246483 / -6.8% 0.51 / 0.49 / +4.9%
tpcds_q80/duckdb:vortex-file-compressed 50195742 / 52221568 / -3.9% 87830526 / 89052782 / -1.4% 0.57 / 0.59 / -2.5%
tpcds_q81/duckdb:vortex-file-compressed 39618638 / 38976316 / +1.6% 56622987 / 57455089 / -1.4% 0.70 / 0.68 / +3.1%
tpcds_q82/duckdb:vortex-file-compressed 52482929 / 50351075 / +4.2% 79059725 / 75321800 / +5.0% 0.66 / 0.67 / -0.7%
tpcds_q83/duckdb:vortex-file-compressed 30723732 / 31715946 / -3.1% 44594836 / 45337888 / -1.6% 0.69 / 0.70 / -1.5%
tpcds_q84/duckdb:vortex-file-compressed 26278696 / 26410349 / -0.5% 43150878 / 42423890 / +1.7% 0.61 / 0.62 / -2.2%
tpcds_q85/duckdb:vortex-file-compressed 51592776 / 50839988 / +1.5% 69838213 / 76572786 / -8.8% 0.74 / 0.66 / +11.3%
tpcds_q86/duckdb:vortex-file-compressed 19399270 / 19667222 / -1.4% 35854131 / 38810499 / -7.6% 0.54 / 0.51 / +6.8%
tpcds_q87/duckdb:vortex-file-compressed 41520769 / 40225961 / +3.2% 70338664 / 71814819 / -2.1% 0.59 / 0.56 / +5.4%
tpcds_q88/duckdb:vortex-file-compressed 60299872 / 60765206 / -0.8% 121651048 / 118331854 / +2.8% 0.50 / 0.51 / -3.5%
tpcds_q89/duckdb:vortex-file-compressed 22996270 / 25391481 / -9.4% 50870684 / 53207916 / -4.4% 0.45 / 0.48 / -5.3%
tpcds_q90/duckdb:vortex-file-compressed 15124538 / 14603586 / +3.6% 28305371 / 30983106 / -8.6% 0.53 / 0.47 / +13.4%
tpcds_q91/duckdb:vortex-file-compressed 27341316 / 27737592 / -1.4% 43684496 / 48584117 / -10.1% 🟢 0.63 / 0.57 / +9.6%
tpcds_q92/duckdb:vortex-file-compressed 22149780 / 22103877 / +0.2% 41383422 / 46181956 / -10.4% 🟢 0.54 / 0.48 / +11.8%
tpcds_q93/duckdb:vortex-file-compressed 29094627 / 29600568 / -1.7% 47405802 / 51689005 / -8.3% 0.61 / 0.57 / +7.2%
tpcds_q94/duckdb:vortex-file-compressed 30349903 / 28788959 / +5.4% 51133931 / 54708332 / -6.5% 0.59 / 0.53 / +12.8%
tpcds_q95/duckdb:vortex-file-compressed 138195048 / 140097948 / -1.4% 162523121 / 157522284 / +3.2% 0.85 / 0.89 / -4.4%
tpcds_q96/duckdb:vortex-file-compressed 17013901 / 15897758 / +7.0% 34420501 / 33693276 / +2.2% 0.49 / 0.47 / +4.8%
tpcds_q97/duckdb:vortex-file-compressed 40027889 / 41175308 / -2.8% 55517826 / 62325609 / -10.9% 🟢 0.72 / 0.66 / +9.1%
tpcds_q98/duckdb:vortex-file-compressed 23829052 / 22755999 / +4.7% 46883941 / 47072020 / -0.4% 0.51 / 0.48 / +5.1%
tpcds_q99/duckdb:vortex-file-compressed 27228176 / 22734568 / +19.8% 🔴 39947631 / 45112485 / -11.4% 🟢 0.68 / 0.50 / +35.3%
duckdb / parquet / ns (0.984x ➖, 8↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 31292600 / 31171247 / +0.4% 48157703 / 47306613 / +1.8% 0.65 / 0.66 / -1.4%
tpcds_q02/duckdb:parquet 22117294 / 21940477 / +0.8% 36647390 / 34639453 / +5.8% 0.60 / 0.63 / -4.7%
tpcds_q03/duckdb:parquet 14281642 / 16092613 / -11.3% 🟢 24772809 / 24009572 / +3.2% 0.58 / 0.67 / -14.0%
tpcds_q04/duckdb:parquet 195493780 / 185164017 / +5.6% 200625999 / 206358054 / -2.8% 0.97 / 0.90 / +8.6%
tpcds_q05/duckdb:parquet 33156220 / 33258111 / -0.3% 44148966 / 41450797 / +6.5% 0.75 / 0.80 / -6.4%
tpcds_q06/duckdb:parquet 35992040 / 36128841 / -0.4% 59269511 / 58368281 / +1.5% 0.61 / 0.62 / -1.9%
tpcds_q07/duckdb:parquet 21819164 / 21987502 / -0.8% 36728045 / 36346602 / +1.0% 0.59 / 0.60 / -1.8%
tpcds_q08/duckdb:parquet 32735229 / 32938147 / -0.6% 45496089 / 49720765 / -8.5% 0.72 / 0.66 / +8.6%
tpcds_q09/duckdb:parquet 30438622 / 30731146 / -1.0% 37574539 / 41252113 / -8.9% 0.81 / 0.74 / +8.7%
tpcds_q10/duckdb:parquet 40640314 / 39806512 / +2.1% 61450620 / 56758780 / +8.3% 0.66 / 0.70 / -5.7%
tpcds_q11/duckdb:parquet 104925016 / 103601724 / +1.3% 121482869 / 126944045 / -4.3% 0.86 / 0.82 / +5.8%
tpcds_q12/duckdb:parquet 17560378 / 18143538 / -3.2% 27540301 / 27370579 / +0.6% 0.64 / 0.66 / -3.8%
tpcds_q13/duckdb:parquet 40114188 / 40589441 / -1.2% 52067751 / 51535622 / +1.0% 0.77 / 0.79 / -2.2%
tpcds_q14/duckdb:parquet 101941296 / 104981638 / -2.9% 122038754 / 120380940 / +1.4% 0.84 / 0.87 / -4.2%
tpcds_q15/duckdb:parquet 34835705 / 36717796 / -5.1% 46441381 / 48747428 / -4.7% 0.75 / 0.75 / -0.4%
tpcds_q16/duckdb:parquet 27433448 / 27237234 / +0.7% 43153825 / 44149506 / -2.3% 0.64 / 0.62 / +3.0%
tpcds_q17/duckdb:parquet 44686302 / 44812506 / -0.3% 61698312 / 57160647 / +7.9% 0.72 / 0.78 / -7.6%
tpcds_q18/duckdb:parquet 56348508 / 55895370 / +0.8% 76914894 / 78487631 / -2.0% 0.73 / 0.71 / +2.9%
tpcds_q19/duckdb:parquet 33573247 / 34880782 / -3.7% 45747410 / 47209100 / -3.1% 0.73 / 0.74 / -0.7%
tpcds_q20/duckdb:parquet 19250158 / 19532840 / -1.4% 28957662 / 29434018 / -1.6% 0.66 / 0.66 / +0.2%
tpcds_q21/duckdb:parquet 14333144 / 14497624 / -1.1% 24919307 / 28819512 / -13.5% 🟢 0.58 / 0.50 / +14.3%
tpcds_q22/duckdb:parquet 72752912 / 71856508 / +1.2% 84152633 / 76126577 / +10.5% 🔴 0.86 / 0.94 / -8.4%
tpcds_q23/duckdb:parquet 67490677 / 71647693 / -5.8% 85752866 / 81512503 / +5.2% 0.79 / 0.88 / -10.5%
tpcds_q24/duckdb:parquet 50634212 / 49120659 / +3.1% 67785893 / 70572439 / -3.9% 0.75 / 0.70 / +7.3%
tpcds_q25/duckdb:parquet 42077990 / 42150445 / -0.2% 59523331 / 58044927 / +2.5% 0.71 / 0.73 / -2.7%
tpcds_q26/duckdb:parquet 44334700 / 44540126 / -0.5% 57759855 / 57833162 / -0.1% 0.77 / 0.77 / -0.3%
tpcds_q27/duckdb:parquet 53057340 / 53565822 / -0.9% 74946743 / 68912279 / +8.8% 0.71 / 0.78 / -8.9%
tpcds_q28/duckdb:parquet 28300902 / 30644088 / -7.6% 35867369 / 38127291 / -5.9% 0.79 / 0.80 / -1.8%
tpcds_q29/duckdb:parquet 42874526 / 42867162 / +0.0% 57352818 / 57909095 / -1.0% 0.75 / 0.74 / +1.0%
tpcds_q30/duckdb:parquet 44199480 / 44253024 / -0.1% 59590343 / 61757706 / -3.5% 0.74 / 0.72 / +3.5%
tpcds_q31/duckdb:parquet 30505863 / 29713530 / +2.7% 43290237 / 42625582 / +1.6% 0.70 / 0.70 / +1.1%
tpcds_q32/duckdb:parquet 15443688 / 15056586 / +2.6% 28563448 / 27787198 / +2.8% 0.54 / 0.54 / -0.2%
tpcds_q33/duckdb:parquet 25708922 / 23720076 / +8.4% 38053251 / 37955255 / +0.3% 0.68 / 0.62 / +8.1%
tpcds_q34/duckdb:parquet 21944385 / 23457362 / -6.4% 35443145 / 37664363 / -5.9% 0.62 / 0.62 / -0.6%
tpcds_q35/duckdb:parquet 67892910 / 67638498 / +0.4% 88557110 / 86747860 / +2.1% 0.77 / 0.78 / -1.7%
tpcds_q36/duckdb:parquet 22309068 / 22603783 / -1.3% 41928274 / 38087000 / +10.1% 🔴 0.53 / 0.59 / -10.3%
tpcds_q37/duckdb:parquet 17538780 / 17270674 / +1.6% 29919996 / 30270052 / -1.2% 0.59 / 0.57 / +2.7%
tpcds_q38/duckdb:parquet 41691353 / 41098946 / +1.4% 50876577 / 50349760 / +1.0% 0.82 / 0.82 / +0.4%
tpcds_q39/duckdb:parquet 38954922 / 36398474 / +7.0% 54406532 / 51022621 / +6.6% 0.72 / 0.71 / +0.4%
tpcds_q40/duckdb:parquet 22977228 / 22269661 / +3.2% 32708003 / 31146622 / +5.0% 0.70 / 0.71 / -1.7%
tpcds_q41/duckdb:parquet 10614976 / 10550112 / +0.6% 22030198 / 21690904 / +1.6% 0.48 / 0.49 / -0.9%
tpcds_q42/duckdb:parquet 11792914 / 11683196 / +0.9% 23051429 / 23060617 / -0.0% 0.51 / 0.51 / +1.0%
tpcds_q43/duckdb:parquet 14919086 / 19203292 / -22.3% 🟢 25635110 / 31116507 / -17.6% 🟢 0.58 / 0.62 / -5.7%
tpcds_q44/duckdb:parquet 25731274 / 25124459 / +2.4% 38126622 / 40216060 / -5.2% 0.67 / 0.62 / +8.0%
tpcds_q45/duckdb:parquet 32619997 / 32695873 / -0.2% 44289199 / 44708267 / -0.9% 0.74 / 0.73 / +0.7%
tpcds_q46/duckdb:parquet 50455710 / 56418052 / -10.6% 🟢 65544423 / 67700823 / -3.2% 0.77 / 0.83 / -7.6%
tpcds_q47/duckdb:parquet 50842568 / 50449776 / +0.8% 62285952 / 63191508 / -1.4% 0.82 / 0.80 / +2.2%
tpcds_q48/duckdb:parquet 30401542 / 35424132 / -14.2% 🟢 48891631 / 49556910 / -1.3% 0.62 / 0.71 / -13.0%
tpcds_q49/duckdb:parquet 28547931 / 27856645 / +2.5% 44803064 / 49012494 / -8.6% 0.64 / 0.57 / +12.1%
tpcds_q50/duckdb:parquet 24653398 / 29758994 / -17.2% 🟢 38704942 / 38127493 / +1.5% 0.64 / 0.78 / -18.4%
tpcds_q51/duckdb:parquet 94956702 / 97880478 / -3.0% 148801914 / 115856475 / +28.4% 🔴 0.64 / 0.84 / -24.5%
tpcds_q52/duckdb:parquet 12241519 / 13721862 / -10.8% 🟢 22689158 / 22504807 / +0.8% 0.54 / 0.61 / -11.5%
tpcds_q53/duckdb:parquet 16531880 / 15945794 / +3.7% 28836027 / 30006642 / -3.9% 0.57 / 0.53 / +7.9%
tpcds_q54/duckdb:parquet 29562142 / 29967363 / -1.4% 47819144 / 46082845 / +3.8% 0.62 / 0.65 / -4.9%
tpcds_q55/duckdb:parquet 11983654 / 13481997 / -11.1% 🟢 22957948 / 24001726 / -4.3% 0.52 / 0.56 / -7.1%
tpcds_q56/duckdb:parquet 23810654 / 24121481 / -1.3% 38338536 / 44073241 / -13.0% 🟢 0.62 / 0.55 / +13.5%
tpcds_q57/duckdb:parquet 42375086 / 42949316 / -1.3% 54293025 / 54985379 / -1.3% 0.78 / 0.78 / -0.1%
tpcds_q58/duckdb:parquet 27014380 / 27233092 / -0.8% 39580695 / 40189324 / -1.5% 0.68 / 0.68 / +0.7%
tpcds_q59/duckdb:parquet 29315798 / 30109622 / -2.6% 42496394 / 42280684 / +0.5% 0.69 / 0.71 / -3.1%
tpcds_q60/duckdb:parquet 24883680 / 25755724 / -3.4% 40432350 / 41312032 / -2.1% 0.62 / 0.62 / -1.3%
tpcds_q61/duckdb:parquet 34206325 / 32185065 / +6.3% 44630901 / 43466893 / +2.7% 0.77 / 0.74 / +3.5%
tpcds_q62/duckdb:parquet 14613748 / 15215659 / -4.0% 23187459 / 23566240 / -1.6% 0.63 / 0.65 / -2.4%
tpcds_q63/duckdb:parquet 15406074 / 15406400 / -0.0% 31135636 / 29880616 / +4.2% 0.49 / 0.52 / -4.0%
tpcds_q64/duckdb:parquet 83640568 / 79173470 / +5.6% 100870369 / 99986768 / +0.9% 0.83 / 0.79 / +4.7%
tpcds_q65/duckdb:parquet 21935801 / 23436369 / -6.4% 36042849 / 36422237 / -1.0% 0.61 / 0.64 / -5.4%
tpcds_q66/duckdb:parquet 35376514 / 35576581 / -0.6% 48523342 / 46807227 / +3.7% 0.73 / 0.76 / -4.1%
tpcds_q67/duckdb:parquet 122191267 / 126083094 / -3.1% 132895086 / 133080829 / -0.1% 0.92 / 0.95 / -3.0%
tpcds_q68/duckdb:parquet 39736212 / 44040458 / -9.8% 60018654 / 64794048 / -7.4% 0.66 / 0.68 / -2.6%
tpcds_q69/duckdb:parquet 42808480 / 41975018 / +2.0% 62541531 / 61487984 / +1.7% 0.68 / 0.68 / +0.3%
tpcds_q70/duckdb:parquet 26810873 / 29110400 / -7.9% 47511722 / 42731097 / +11.2% 🔴 0.56 / 0.68 / -17.2%
tpcds_q71/duckdb:parquet 23330472 / 20999918 / +11.1% 🔴 35610581 / 36667760 / -2.9% 0.66 / 0.57 / +14.4%
tpcds_q72/duckdb:parquet 177750719 / 178983848 / -0.7% 161824139 / 128991664 / +25.5% 🔴 1.10 / 1.39 / -20.8%
tpcds_q73/duckdb:parquet 21424286 / 18499012 / +15.8% 🔴 33255227 / 30551494 / +8.8% 0.64 / 0.61 / +6.4%
tpcds_q74/duckdb:parquet 147457284 / 148472838 / -0.7% 156961199 / 165299664 / -5.0% 0.94 / 0.90 / +4.6%
tpcds_q75/duckdb:parquet 60160150 / 62090582 / -3.1% 80035404 / 80444493 / -0.5% 0.75 / 0.77 / -2.6%
tpcds_q76/duckdb:parquet 19398028 / 20523585 / -5.5% 34916781 / 33826131 / +3.2% 0.56 / 0.61 / -8.4%
tpcds_q77/duckdb:parquet 25647992 / 25204061 / +1.8% 40726520 / 40042863 / +1.7% 0.63 / 0.63 / +0.1%
tpcds_q78/duckdb:parquet 77948128 / 79148866 / -1.5% 96724593 / 96360158 / +0.4% 0.81 / 0.82 / -1.9%
tpcds_q79/duckdb:parquet 27846396 / 33416020 / -16.7% 🟢 43776651 / 44619102 / -1.9% 0.64 / 0.75 / -15.1%
tpcds_q80/duckdb:parquet 46772939 / 47444448 / -1.4% 61011207 / 62169073 / -1.9% 0.77 / 0.76 / +0.5%
tpcds_q81/duckdb:parquet 41587778 / 41156480 / +1.0% 58154019 / 58652394 / -0.8% 0.72 / 0.70 / +1.9%
tpcds_q82/duckdb:parquet 18735524 / 19103813 / -1.9% 33459647 / 34223756 / -2.2% 0.56 / 0.56 / +0.3%
tpcds_q83/duckdb:parquet 22090579 / 22683003 / -2.6% 32649663 / 33508666 / -2.6% 0.68 / 0.68 / -0.0%
tpcds_q84/duckdb:parquet 23305944 / 23651795 / -1.5% 33309843 / 33934552 / -1.8% 0.70 / 0.70 / +0.4%
tpcds_q85/duckdb:parquet 47060462 / 47704872 / -1.4% 64222005 / 66209536 / -3.0% 0.73 / 0.72 / +1.7%
tpcds_q86/duckdb:parquet 14992841 / 14984916 / +0.1% 26527121 / 25895853 / +2.4% 0.57 / 0.58 / -2.3%
tpcds_q87/duckdb:parquet 44013522 / 43707562 / +0.7% 56655922 / 54676338 / +3.6% 0.78 / 0.80 / -2.8%
tpcds_q88/duckdb:parquet 43004198 / 43109643 / -0.2% 50478711 / 50728190 / -0.5% 0.85 / 0.85 / +0.2%
tpcds_q89/duckdb:parquet 17776332 / 19182444 / -7.3% 34594978 / 32164149 / +7.6% 0.51 / 0.60 / -13.8%
tpcds_q90/duckdb:parquet 9790977 / 10355698 / -5.5% 21791469 / 21046158 / +3.5% 0.45 / 0.49 / -8.7%
tpcds_q91/duckdb:parquet 28362992 / 27745752 / +2.2% 42850870 / 44654069 / -4.0% 0.66 / 0.62 / +6.5%
tpcds_q92/duckdb:parquet 15642934 / 15629448 / +0.1% 27248291 / 27427402 / -0.7% 0.57 / 0.57 / +0.7%
tpcds_q93/duckdb:parquet 31428874 / 31427048 / +0.0% 47467153 / 49072372 / -3.3% 0.66 / 0.64 / +3.4%
tpcds_q94/duckdb:parquet 23005209 / 21830242 / +5.4% 36791499 / 34932724 / +5.3% 0.63 / 0.62 / +0.1%
tpcds_q95/duckdb:parquet 138678481 / 139773994 / -0.8% 182539637 / 149245651 / +22.3% 🔴 0.76 / 0.94 / -18.9%
tpcds_q96/duckdb:parquet 11175280 / 11865876 / -5.8% 17755805 / 17092815 / +3.9% 0.63 / 0.69 / -9.3%
tpcds_q97/duckdb:parquet 38859692 / 39118057 / -0.7% 52315808 / 50800175 / +3.0% 0.74 / 0.77 / -3.5%
tpcds_q98/duckdb:parquet 21233012 / 22937048 / -7.4% 35450205 / 35246131 / +0.6% 0.60 / 0.65 / -8.0%
tpcds_q99/duckdb:parquet 23776524 / 23782734 / -0.0% 32423966 / 34532843 / -6.1% 0.73 / 0.69 / +6.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +33.2%
Engines: DataFusion No clear signal (+24.2%, environment too noisy confidence) · DuckDB No clear signal (+42.8%, environment too noisy confidence)
Vortex (geomean): hot 1.060x ➖ · cold 0.975x ➖
Parquet (geomean): hot 0.796x ➖ · cold 0.875x ➖
Shifts: Parquet (control) -20.4% · Median polish -8.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.134x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 45680838 / 52743014 / -13.4% 186415854 / 164402646 / +13.4% 0.25 / 0.32 / -23.6%
fineweb_q01/datafusion:vortex-file-compressed 3531124250 / 464467054 / +660.3% 🔴 2160980801 / 716435225 / +201.6% 🔴 1.63 / 0.65 / +152.0%
fineweb_q02/datafusion:vortex-file-compressed 381994418 / 400600813 / -4.6% 442322816 / 551636773 / -19.8% 0.86 / 0.73 / +18.9%
fineweb_q03/datafusion:vortex-file-compressed 584216858 / 473010274 / +23.5% 684746574 / 1084854036 / -36.9% 🟢 0.85 / 0.44 / +95.7%
fineweb_q04/datafusion:vortex-file-compressed 666860718 / 632610599 / +5.4% 643052406 / 476060038 / +35.1% 🔴 1.04 / 1.33 / -22.0%
fineweb_q05/datafusion:vortex-file-compressed 581297328 / 661143818 / -12.1% 429248606 / 794741084 / -46.0% 🟢 1.35 / 0.83 / +62.8%
fineweb_q06/datafusion:vortex-file-compressed 661589849 / 719067560 / -8.0% 840315387 / 681085932 / +23.4% 0.79 / 1.06 / -25.4%
fineweb_q07/datafusion:vortex-file-compressed 450115890 / 523578938 / -14.0% 410558910 / 473170909 / -13.2% 1.10 / 1.11 / -0.9%
fineweb_q08/datafusion:vortex-file-compressed 223507183 / 408424075 / -45.3% 🟢 241128863 / 295879097 / -18.5% 0.93 / 1.38 / -32.9%
datafusion / parquet / ns (0.913x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 639440112 / 529530994 / +20.8% 1207810842 / 1005745657 / +20.1% 0.53 / 0.53 / +0.6%
fineweb_q01/datafusion:parquet 832098653 / 956284506 / -13.0% 899912191 / 1104205090 / -18.5% 0.92 / 0.87 / +6.8%
fineweb_q02/datafusion:parquet 977627799 / 1038037578 / -5.8% 1084878640 / 1517770093 / -28.5% 0.90 / 0.68 / +31.8%
fineweb_q03/datafusion:parquet 850727072 / 905812900 / -6.1% 948290419 / 945937949 / +0.2% 0.90 / 0.96 / -6.3%
fineweb_q04/datafusion:parquet 860951697 / 949234852 / -9.3% 918295244 / 1040893264 / -11.8% 0.94 / 0.91 / +2.8%
fineweb_q05/datafusion:parquet 785237344 / 1021402525 / -23.1% 842202252 / 1069807792 / -21.3% 0.93 / 0.95 / -2.3%
fineweb_q06/datafusion:parquet 785238189 / 967755344 / -18.9% 876492919 / 1074433277 / -18.4% 0.90 / 0.90 / -0.5%
fineweb_q07/datafusion:parquet 842232887 / 971402992 / -13.3% 842762195 / 1032571358 / -18.4% 1.00 / 0.94 / +6.2%
fineweb_q08/datafusion:parquet 950790848 / 980327622 / -3.0% 1029474198 / 1193925592 / -13.8% 0.92 / 0.82 / +12.5%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 70460247 / 72064531 / -2.2% 103107139 / 83020939 / +24.2% 0.68 / 0.87 / -21.3%
fineweb_q01/duckdb:vortex-file-compressed 528861150 / 553200146 / -4.4% 593959253 / 803920945 / -26.1% 0.89 / 0.69 / +29.4%
fineweb_q02/duckdb:vortex-file-compressed 710220046 / 707905161 / +0.3% 700098482 / 790694341 / -11.5% 1.01 / 0.90 / +13.3%
fineweb_q03/duckdb:vortex-file-compressed 1511033714 / 1590364976 / -5.0% 1655693011 / 1741455941 / -4.9% 0.91 / 0.91 / -0.1%
fineweb_q04/duckdb:vortex-file-compressed 1696733504 / 1598702502 / +6.1% 1639888514 / 1635538903 / +0.3% 1.03 / 0.98 / +5.9%
fineweb_q05/duckdb:vortex-file-compressed 1578329122 / 1512386715 / +4.4% 1491755125 / 1599230795 / -6.7% 1.06 / 0.95 / +11.9%
fineweb_q06/duckdb:vortex-file-compressed 1630008562 / 1669375706 / -2.4% 1587654078 / 1688534843 / -6.0% 1.03 / 0.99 / +3.8%
fineweb_q07/duckdb:vortex-file-compressed 1536347825 / 1502242790 / +2.3% 1704980098 / 1575392010 / +8.2% 0.90 / 0.95 / -5.5%
fineweb_q08/duckdb:vortex-file-compressed 604149629 / 647977650 / -6.8% 643012930 / 827356243 / -22.3% 0.94 / 0.78 / +20.0%
duckdb / parquet / ns (0.694x ✅, 5↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 621967086 / 2886698869 / -78.5% 🟢 639431949 / 614536470 / +4.1% 0.97 / 4.70 / -79.3%
fineweb_q01/duckdb:parquet 2919637534 / 5324788280 / -45.2% 🟢 631117986 / 662407716 / -4.7% 4.63 / 8.04 / -42.5%
fineweb_q02/duckdb:parquet 2910247534 / 5342837064 / -45.5% 🟢 591329487 / 638308420 / -7.4% 4.92 / 8.37 / -41.2%
fineweb_q03/duckdb:parquet 5329246197 / 5373174522 / -0.8% 1251900890 / 1567278913 / -20.1% 4.26 / 3.43 / +24.2%
fineweb_q04/duckdb:parquet 5255715990 / 5302493132 / -0.9% 880796139 / 884363991 / -0.4% 5.97 / 6.00 / -0.5%
fineweb_q05/duckdb:parquet 5267216951 / 944876607 / +457.5% 🔴 816200414 / 1164145612 / -29.9% 6.45 / 0.81 / +695.1%
fineweb_q06/duckdb:parquet 3396708299 / 5351510618 / -36.5% 🟢 1407821160 / 1708882586 / -17.6% 2.41 / 3.13 / -23.0%
fineweb_q07/duckdb:parquet 889785341 / 5344693109 / -83.4% 🟢 959408475 / 1060625490 / -9.5% 0.93 / 5.04 / -81.6%
fineweb_q08/duckdb:parquet 5269873532 / 5282425290 / -0.2% 538041493 / 632078210 / -14.9% 9.79 / 8.36 / +17.2%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-2.4%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.997x ➖
Parquet (geomean): hot 1.008x ➖ · cold 1.013x ➖
Shifts: Parquet (control) +0.8% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 352619991 / 332103740 / +6.2% 478476439 / 463125575 / +3.3% 0.74 / 0.72 / +2.8%
tpch_q02/datafusion:vortex-file-compressed 99530505 / 98662431 / +0.9% 179847701 / 172710029 / +4.1% 0.55 / 0.57 / -3.1%
tpch_q03/datafusion:vortex-file-compressed 151233885 / 151000745 / +0.2% 288423637 / 292168329 / -1.3% 0.52 / 0.52 / +1.5%
tpch_q04/datafusion:vortex-file-compressed 65404373 / 64967413 / +0.7% 137537731 / 133641075 / +2.9% 0.48 / 0.49 / -2.2%
tpch_q05/datafusion:vortex-file-compressed 257562473 / 269707943 / -4.5% 454839213 / 414505819 / +9.7% 0.57 / 0.65 / -13.0%
tpch_q06/datafusion:vortex-file-compressed 24451293 / 24006589 / +1.9% 146406891 / 137639593 / +6.4% 0.17 / 0.17 / -4.2%
tpch_q07/datafusion:vortex-file-compressed 346572315 / 344954976 / +0.5% 468756975 / 497165987 / -5.7% 0.74 / 0.69 / +6.6%
tpch_q08/datafusion:vortex-file-compressed 281965855 / 271423508 / +3.9% 428322081 / 414558366 / +3.3% 0.66 / 0.65 / +0.5%
tpch_q09/datafusion:vortex-file-compressed 464649771 / 478476118 / -2.9% 636836522 / 607401926 / +4.8% 0.73 / 0.79 / -7.4%
tpch_q10/datafusion:vortex-file-compressed 167690843 / 166145134 / +0.9% 312638730 / 308679616 / +1.3% 0.54 / 0.54 / -0.3%
tpch_q11/datafusion:vortex-file-compressed 70602845 / 70663278 / -0.1% 129415758 / 130667699 / -1.0% 0.55 / 0.54 / +0.9%
tpch_q12/datafusion:vortex-file-compressed 80281460 / 80679861 / -0.5% 176197346 / 165576890 / +6.4% 0.46 / 0.49 / -6.5%
tpch_q13/datafusion:vortex-file-compressed 115147286 / 115083688 / +0.1% 179705990 / 191708930 / -6.3% 0.64 / 0.60 / +6.7%
tpch_q14/datafusion:vortex-file-compressed 40397156 / 41462834 / -2.6% 176873965 / 171798338 / +3.0% 0.23 / 0.24 / -5.4%
tpch_q15/datafusion:vortex-file-compressed 70359752 / 69000710 / +2.0% 204779451 / 194984372 / +5.0% 0.34 / 0.35 / -2.9%
tpch_q16/datafusion:vortex-file-compressed 65492384 / 64134432 / +2.1% 131891590 / 134283848 / -1.8% 0.50 / 0.48 / +4.0%
tpch_q17/datafusion:vortex-file-compressed 405859215 / 400419327 / +1.4% 526662355 / 504542883 / +4.4% 0.77 / 0.79 / -2.9%
tpch_q18/datafusion:vortex-file-compressed 623648500 / 616166904 / +1.2% 797022526 / 774025593 / +3.0% 0.78 / 0.80 / -1.7%
tpch_q19/datafusion:vortex-file-compressed 54319708 / 53084308 / +2.3% 173632935 / 177411494 / -2.1% 0.31 / 0.30 / +4.6%
tpch_q20/datafusion:vortex-file-compressed 129667809 / 131102782 / -1.1% 251135574 / 264109402 / -4.9% 0.52 / 0.50 / +4.0%
tpch_q21/datafusion:vortex-file-compressed 451023569 / 447138790 / +0.9% 578456457 / 571351909 / +1.2% 0.78 / 0.78 / -0.4%
tpch_q22/datafusion:vortex-file-compressed 39047348 / 39928503 / -2.2% 97703132 / 99772824 / -2.1% 0.40 / 0.40 / -0.1%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 322587734 / 320639309 / +0.6% 421235581 / 417858835 / +0.8% 0.77 / 0.77 / -0.2%
tpch_q02/datafusion:parquet 222411755 / 217029934 / +2.5% 300726426 / 301292518 / -0.2% 0.74 / 0.72 / +2.7%
tpch_q03/datafusion:parquet 225091126 / 225959133 / -0.4% 361406730 / 361734888 / -0.1% 0.62 / 0.62 / -0.3%
tpch_q04/datafusion:parquet 94616008 / 94109916 / +0.5% 189983157 / 194445129 / -2.3% 0.50 / 0.48 / +2.9%
tpch_q05/datafusion:parquet 356544051 / 353314404 / +0.9% 502555452 / 507368511 / -0.9% 0.71 / 0.70 / +1.9%
tpch_q06/datafusion:parquet 63981317 / 63138180 / +1.3% 170274048 / 168146737 / +1.3% 0.38 / 0.38 / +0.1%
tpch_q07/datafusion:parquet 489293595 / 489592422 / -0.1% 668790363 / 665072032 / +0.6% 0.73 / 0.74 / -0.6%
tpch_q08/datafusion:parquet 398411601 / 395441784 / +0.8% 569684414 / 567739813 / +0.3% 0.70 / 0.70 / +0.4%
tpch_q09/datafusion:parquet 655600166 / 659641385 / -0.6% 853105295 / 849476369 / +0.4% 0.77 / 0.78 / -1.0%
tpch_q10/datafusion:parquet 522904853 / 515180265 / +1.5% 692802386 / 683564483 / +1.4% 0.75 / 0.75 / +0.1%
tpch_q11/datafusion:parquet 138530276 / 141647477 / -2.2% 209690168 / 199235124 / +5.2% 0.66 / 0.71 / -7.1%
tpch_q12/datafusion:parquet 142591510 / 142735506 / -0.1% 260714624 / 257723090 / +1.2% 0.55 / 0.55 / -1.2%
tpch_q13/datafusion:parquet 342131911 / 342642155 / -0.1% 426197616 / 415464066 / +2.6% 0.80 / 0.82 / -2.7%
tpch_q14/datafusion:parquet 117316730 / 117318639 / -0.0% 248156755 / 246433556 / +0.7% 0.47 / 0.48 / -0.7%
tpch_q15/datafusion:parquet 177203996 / 177472197 / -0.2% 288378694 / 284855291 / +1.2% 0.61 / 0.62 / -1.4%
tpch_q16/datafusion:parquet 128570302 / 130299761 / -1.3% 203049085 / 206310332 / -1.6% 0.63 / 0.63 / +0.3%
tpch_q17/datafusion:parquet 489511379 / 489064932 / +0.1% 625057445 / 603951431 / +3.5% 0.78 / 0.81 / -3.3%
tpch_q18/datafusion:parquet 684520269 / 685774161 / -0.2% 866354719 / 844432395 / +2.6% 0.79 / 0.81 / -2.7%
tpch_q19/datafusion:parquet 186025116 / 186286768 / -0.1% 317085740 / 324528601 / -2.3% 0.59 / 0.57 / +2.2%
tpch_q20/datafusion:parquet 289796930 / 291265832 / -0.5% 434222225 / 421914909 / +2.9% 0.67 / 0.69 / -3.3%
tpch_q21/datafusion:parquet 526597932 / 546914192 / -3.7% 685340424 / 675261541 / +1.5% 0.77 / 0.81 / -5.1%
tpch_q22/datafusion:parquet 238770968 / 238728794 / +0.0% 291821701 / 295956447 / -1.4% 0.82 / 0.81 / +1.4%
duckdb / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 98318951 / 99169851 / -0.9% 183444067 / 202695782 / -9.5% 0.54 / 0.49 / +9.5%
tpch_q02/duckdb:vortex-file-compressed 68305093 / 66846969 / +2.2% 122005263 / 109481695 / +11.4% 🔴 0.56 / 0.61 / -8.3%
tpch_q03/duckdb:vortex-file-compressed 132457820 / 132983492 / -0.4% 239444960 / 239625652 / -0.1% 0.55 / 0.55 / -0.3%
tpch_q04/duckdb:vortex-file-compressed 176497343 / 170990368 / +3.2% 255155036 / 248134443 / +2.8% 0.69 / 0.69 / +0.4%
tpch_q05/duckdb:vortex-file-compressed 139754011 / 142082437 / -1.6% 236592670 / 270379172 / -12.5% 🟢 0.59 / 0.53 / +12.4%
tpch_q06/duckdb:vortex-file-compressed 37568516 / 37647381 / -0.2% 132877705 / 138723770 / -4.2% 0.28 / 0.27 / +4.2%
tpch_q07/duckdb:vortex-file-compressed 123670356 / 127952528 / -3.3% 268029624 / 266180929 / +0.7% 0.46 / 0.48 / -4.0%
tpch_q08/duckdb:vortex-file-compressed 174922390 / 177101576 / -1.2% 289272930 / 296127779 / -2.3% 0.60 / 0.60 / +1.1%
tpch_q09/duckdb:vortex-file-compressed 307650705 / 305779460 / +0.6% 443579545 / 427206523 / +3.8% 0.69 / 0.72 / -3.1%
tpch_q10/duckdb:vortex-file-compressed 216394820 / 224122751 / -3.4% 386673183 / 389053180 / -0.6% 0.56 / 0.58 / -2.9%
tpch_q11/duckdb:vortex-file-compressed 39664365 / 40106927 / -1.1% 95520098 / 99324418 / -3.8% 0.42 / 0.40 / +2.8%
tpch_q12/duckdb:vortex-file-compressed 108869855 / 110226288 / -1.2% 193165963 / 186156990 / +3.8% 0.56 / 0.59 / -4.8%
tpch_q13/duckdb:vortex-file-compressed 194262751 / 197635182 / -1.7% 295844619 / 297877017 / -0.7% 0.66 / 0.66 / -1.0%
tpch_q14/duckdb:vortex-file-compressed 57106846 / 55498059 / +2.9% 169226509 / 179913592 / -5.9% 0.34 / 0.31 / +9.4%
tpch_q15/duckdb:vortex-file-compressed 82233329 / 80979984 / +1.5% 189784716 / 190459536 / -0.4% 0.43 / 0.43 / +1.9%
tpch_q16/duckdb:vortex-file-compressed 85545694 / 85956520 / -0.5% 119233975 / 126708770 / -5.9% 0.72 / 0.68 / +5.8%
tpch_q17/duckdb:vortex-file-compressed 99903342 / 115293137 / -13.3% 🟢 195621294 / 245173493 / -20.2% 🟢 0.51 / 0.47 / +8.6%
tpch_q18/duckdb:vortex-file-compressed 274877097 / 271614386 / +1.2% 356630679 / 340111091 / +4.9% 0.77 / 0.80 / -3.5%
tpch_q19/duckdb:vortex-file-compressed 84935361 / 84810628 / +0.1% 231691195 / 224603806 / +3.2% 0.37 / 0.38 / -2.9%
tpch_q20/duckdb:vortex-file-compressed 142450915 / 139796755 / +1.9% 270843901 / 266842162 / +1.5% 0.53 / 0.52 / +0.4%
tpch_q21/duckdb:vortex-file-compressed 491644553 / 502025910 / -2.1% 559532516 / 571320475 / -2.1% 0.88 / 0.88 / -0.0%
tpch_q22/duckdb:vortex-file-compressed 71596566 / 71907751 / -0.4% 130100452 / 132266010 / -1.6% 0.55 / 0.54 / +1.2%
duckdb / parquet / ns (1.016x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 145136708 / 106736855 / +36.0% 🔴 190039728 / 165143833 / +15.1% 🔴 0.76 / 0.65 / +18.2%
tpch_q02/duckdb:parquet 100440025 / 99884681 / +0.6% 119269102 / 120037979 / -0.6% 0.84 / 0.83 / +1.2%
tpch_q03/duckdb:parquet 159151705 / 165428584 / -3.8% 228320950 / 227359369 / +0.4% 0.70 / 0.73 / -4.2%
tpch_q04/duckdb:parquet 119814586 / 118554480 / +1.1% 167753840 / 156972830 / +6.9% 0.71 / 0.76 / -5.4%
tpch_q05/duckdb:parquet 183280616 / 185409174 / -1.1% 261657190 / 260179491 / +0.6% 0.70 / 0.71 / -1.7%
tpch_q06/duckdb:parquet 59772679 / 56752265 / +5.3% 90888796 / 91349459 / -0.5% 0.66 / 0.62 / +5.9%
tpch_q07/duckdb:parquet 144220017 / 148978596 / -3.2% 228032953 / 221234065 / +3.1% 0.63 / 0.67 / -6.1%
tpch_q08/duckdb:parquet 218766461 / 216983304 / +0.8% 297941482 / 302781533 / -1.6% 0.73 / 0.72 / +2.5%
tpch_q09/duckdb:parquet 346092174 / 345712072 / +0.1% 428253268 / 428589383 / -0.1% 0.81 / 0.81 / +0.2%
tpch_q10/duckdb:parquet 657304251 / 651072973 / +1.0% 743743417 / 741654524 / +0.3% 0.88 / 0.88 / +0.7%
tpch_q11/duckdb:parquet 41323612 / 42006897 / -1.6% 54225654 / 54327604 / -0.2% 0.76 / 0.77 / -1.4%
tpch_q12/duckdb:parquet 119846195 / 121127552 / -1.1% 163499838 / 149763697 / +9.2% 0.73 / 0.81 / -9.4%
tpch_q13/duckdb:parquet 397271541 / 396073429 / +0.3% 429549104 / 425445562 / +1.0% 0.92 / 0.93 / -0.7%
tpch_q14/duckdb:parquet 152138172 / 152006324 / +0.1% 217924668 / 218083032 / -0.1% 0.70 / 0.70 / +0.2%
tpch_q15/duckdb:parquet 73641595 / 79788772 / -7.7% 120778181 / 122499247 / -1.4% 0.61 / 0.65 / -6.4%
tpch_q16/duckdb:parquet 156581365 / 159214322 / -1.7% 174269269 / 173981736 / +0.2% 0.90 / 0.92 / -1.8%
tpch_q17/duckdb:parquet 128151503 / 116447251 / +10.1% 🔴 195742486 / 199991424 / -2.1% 0.65 / 0.58 / +12.4%
tpch_q18/duckdb:parquet 297860090 / 286512338 / +4.0% 306062657 / 292674411 / +4.6% 0.97 / 0.98 / -0.6%
tpch_q19/duckdb:parquet 248831065 / 242835086 / +2.5% 333546000 / 329090577 / +1.4% 0.75 / 0.74 / +1.1%
tpch_q20/duckdb:parquet 195657701 / 199382257 / -1.9% 277127261 / 264156124 / +4.9% 0.71 / 0.75 / -6.5%
tpch_q21/duckdb:parquet 430725231 / 424367744 / +1.5% 476205072 / 476387668 / -0.0% 0.90 / 0.89 / +1.5%
tpch_q22/duckdb:parquet 336515077 / 336395994 / +0.0% 360516367 / 358688790 / +0.5% 0.93 / 0.94 / -0.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.943x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.994x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 12303807 / 15223831 / -19.2% 🟢 14695354 / 27659806 / -46.9% 🟢 0.84 / 0.55 / +52.1%
statpopgen_q01/duckdb:vortex-file-compressed 14569802 / 14192048 / +2.7% 22029790 / 22192443 / -0.7% 0.66 / 0.64 / +3.4%
statpopgen_q02/duckdb:vortex-file-compressed 608561330 / 696248282 / -12.6% 🟢 699051838 / 702816133 / -0.5% 0.87 / 0.99 / -12.1%
statpopgen_q03/duckdb:vortex-file-compressed 1641018406 / 1620737502 / +1.3% 1688872079 / 1950210924 / -13.4% 🟢 0.97 / 0.83 / +16.9%
statpopgen_q04/duckdb:vortex-file-compressed 1497315778 / 1621338784 / -7.6% 1310479960 / 1410678710 / -7.1% 1.14 / 1.15 / -0.6%
statpopgen_q05/duckdb:vortex-file-compressed 716701180 / 624013342 / +14.9% 🔴 999299667 / 656695130 / +52.2% 🔴 0.72 / 0.95 / -24.5%
statpopgen_q06/duckdb:vortex-file-compressed 1984267139 / 1815982146 / +9.3% 1781325749 / 1785807403 / -0.3% 1.11 / 1.02 / +9.5%
statpopgen_q07/duckdb:vortex-file-compressed 375831006 / 361619862 / +3.9% 437820831 / 448418807 / -2.4% 0.86 / 0.81 / +6.4%
statpopgen_q08/duckdb:vortex-file-compressed 400237266 / 395429906 / +1.2% 487469239 / 488199698 / -0.1% 0.82 / 0.81 / +1.4%
statpopgen_q09/duckdb:vortex-file-compressed 1082536331 / 1219216756 / -11.2% 🟢 1056862661 / 1330839979 / -20.6% 🟢 1.02 / 0.92 / +11.8%
statpopgen_q10/duckdb:vortex-file-compressed 3707555292 / 3165736862 / +17.1% 🔴 3151376388 / 2968992999 / +6.1% 1.18 / 1.07 / +10.3%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 375481632 / 376794168 / -0.3% 381777551 / 375824727 / +1.6% 0.98 / 1.00 / -1.9%
statpopgen_q01/duckdb:parquet 466675574 / 467609072 / -0.2% 470997612 / 469591532 / +0.3% 0.99 / 1.00 / -0.5%
statpopgen_q02/duckdb:parquet 773286330 / 776175076 / -0.4% 802048492 / 815411618 / -1.6% 0.96 / 0.95 / +1.3%
statpopgen_q03/duckdb:parquet 1055878498 / 1045777480 / +1.0% 1119537756 / 1097455541 / +2.0% 0.94 / 0.95 / -1.0%
statpopgen_q04/duckdb:parquet 1044948117 / 1045654114 / -0.1% 1091622820 / 1121815284 / -2.7% 0.96 / 0.93 / +2.7%
statpopgen_q05/duckdb:parquet 763438567 / 766735801 / -0.4% 817259935 / 820933422 / -0.4% 0.93 / 0.93 / +0.0%
statpopgen_q06/duckdb:parquet 1010373073 / 1017058379 / -0.7% 1072478713 / 1054452118 / +1.7% 0.94 / 0.96 / -2.3%
statpopgen_q07/duckdb:parquet 969830730 / 948418654 / +2.3% 1135191406 / 1063251990 / +6.8% 0.85 / 0.89 / -4.2%
statpopgen_q08/duckdb:parquet 957661512 / 964417619 / -0.7% 1104602819 / 1149502078 / -3.9% 0.87 / 0.84 / +3.3%
statpopgen_q09/duckdb:parquet 1026747827 / 996893955 / +3.0% 1087155357 / 1040529442 / +4.5% 0.94 / 0.96 / -1.4%
statpopgen_q10/duckdb:parquet 1659250415 / 1650566095 / +0.5% 1730195921 / 1693612395 / +2.2% 0.96 / 0.97 / -1.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-7.0%, low confidence)
Vortex (geomean): hot 0.954x ➖ · cold 0.991x ➖
Parquet (geomean): hot 0.988x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -1.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1889688 / 1882188 / +0.4% 38491839 / 38213390 / +0.7% 0.05 / 0.05 / -0.3%
clickbench_q01/datafusion:vortex-file-compressed 12372718 / 12774621 / -3.1% 60845001 / 60855433 / -0.0% 0.20 / 0.21 / -3.1%
clickbench_q02/datafusion:vortex-file-compressed 26104478 / 27121841 / -3.8% 69983353 / 72937375 / -4.1% 0.37 / 0.37 / +0.3%
clickbench_q03/datafusion:vortex-file-compressed 27311514 / 26888498 / +1.6% 95906434 / 93700542 / +2.4% 0.28 / 0.29 / -0.8%
clickbench_q04/datafusion:vortex-file-compressed 157376107 / 162770048 / -3.3% 231670561 / 233971896 / -1.0% 0.68 / 0.70 / -2.4%
clickbench_q05/datafusion:vortex-file-compressed 217665325 / 225776152 / -3.6% 296376882 / 296348166 / +0.0% 0.73 / 0.76 / -3.6%
clickbench_q06/datafusion:vortex-file-compressed 1858600 / 1875610 / -0.9% 38908892 / 39869892 / -2.4% 0.05 / 0.05 / +1.5%
clickbench_q07/datafusion:vortex-file-compressed 19406600 / 20022986 / -3.1% 63560570 / 63662883 / -0.2% 0.31 / 0.31 / -2.9%
clickbench_q08/datafusion:vortex-file-compressed 220947946 / 218257742 / +1.2% 307587474 / 303822161 / +1.2% 0.72 / 0.72 / -0.0%
clickbench_q09/datafusion:vortex-file-compressed 353195633 / 352754384 / +0.1% 432378271 / 418453470 / +3.3% 0.82 / 0.84 / -3.1%
clickbench_q10/datafusion:vortex-file-compressed 67932276 / 68052188 / -0.2% 130152444 / 132483878 / -1.8% 0.52 / 0.51 / +1.6%
clickbench_q11/datafusion:vortex-file-compressed 88873282 / 88833565 / +0.0% 151676852 / 147653474 / +2.7% 0.59 / 0.60 / -2.6%
clickbench_q12/datafusion:vortex-file-compressed 200326154 / 198056556 / +1.1% 284165018 / 294761404 / -3.6% 0.70 / 0.67 / +4.9%
clickbench_q13/datafusion:vortex-file-compressed 342235822 / 345509550 / -0.9% 448144782 / 452477187 / -1.0% 0.76 / 0.76 / +0.0%
clickbench_q14/datafusion:vortex-file-compressed 207013422 / 205370782 / +0.8% 292293360 / 294856948 / -0.9% 0.71 / 0.70 / +1.7%
clickbench_q15/datafusion:vortex-file-compressed 184014054 / 185390492 / -0.7% 265286214 / 265291736 / -0.0% 0.69 / 0.70 / -0.7%
clickbench_q16/datafusion:vortex-file-compressed 474895292 / 476853631 / -0.4% 583792901 / 573009490 / +1.9% 0.81 / 0.83 / -2.3%
clickbench_q17/datafusion:vortex-file-compressed 481761281 / 469727460 / +2.6% 573623760 / 584079831 / -1.8% 0.84 / 0.80 / +4.4%
clickbench_q18/datafusion:vortex-file-compressed 908020300 / 920503532 / -1.4% 1011388070 / 1047616722 / -3.5% 0.90 / 0.88 / +2.2%
clickbench_q19/datafusion:vortex-file-compressed 17900122 / 17088044 / +4.8% 85742087 / 86301518 / -0.6% 0.21 / 0.20 / +5.4%
clickbench_q20/datafusion:vortex-file-compressed 183897024 / 182452596 / +0.8% 381997234 / 382127675 / -0.0% 0.48 / 0.48 / +0.8%
clickbench_q21/datafusion:vortex-file-compressed 256589728 / 256965342 / -0.1% 493848800 / 462721642 / +6.7% 0.52 / 0.56 / -6.4%
clickbench_q22/datafusion:vortex-file-compressed 336595368 / 337068242 / -0.1% 618734798 / 613286082 / +0.9% 0.54 / 0.55 / -1.0%
clickbench_q23/datafusion:vortex-file-compressed 628160338 / 616617492 / +1.9% 940067008 / 921539709 / +2.0% 0.67 / 0.67 / -0.1%
clickbench_q24/datafusion:vortex-file-compressed 41843308 / 42715838 / -2.0% 117050574 / 113678892 / +3.0% 0.36 / 0.38 / -4.9%
clickbench_q25/datafusion:vortex-file-compressed 55405630 / 55231536 / +0.3% 121618626 / 119255272 / +2.0% 0.46 / 0.46 / -1.6%
clickbench_q26/datafusion:vortex-file-compressed 43086739 / 43186942 / -0.2% 115327905 / 115802984 / -0.4% 0.37 / 0.37 / +0.2%
clickbench_q27/datafusion:vortex-file-compressed 270387938 / 269315446 / +0.4% 449458508 / 460249396 / -2.3% 0.60 / 0.59 / +2.8%
clickbench_q28/datafusion:vortex-file-compressed 1459421744 / 1425171921 / +2.4% 1533903616 / 1507785922 / +1.7% 0.95 / 0.95 / +0.7%
clickbench_q29/datafusion:vortex-file-compressed 40539928 / 39444294 / +2.8% 90730837 / 91835254 / -1.2% 0.45 / 0.43 / +4.0%
clickbench_q30/datafusion:vortex-file-compressed 173435428 / 171205752 / +1.3% 244482669 / 251303434 / -2.7% 0.71 / 0.68 / +4.1%
clickbench_q31/datafusion:vortex-file-compressed 199032345 / 196612863 / +1.2% 319984687 / 329616139 / -2.9% 0.62 / 0.60 / +4.3%
clickbench_q32/datafusion:vortex-file-compressed 838458556 / 833434766 / +0.6% 952639277 / 949266885 / +0.4% 0.88 / 0.88 / +0.2%
clickbench_q33/datafusion:vortex-file-compressed 1004240272 / 1028094474 / -2.3% 1184892849 / 1188880858 / -0.3% 0.85 / 0.86 / -2.0%
clickbench_q34/datafusion:vortex-file-compressed 1004068979 / 1014022222 / -1.0% 1180215751 / 1172266031 / +0.7% 0.85 / 0.87 / -1.6%
clickbench_q35/datafusion:vortex-file-compressed 152481838 / 152984302 / -0.3% 218534658 / 222355821 / -1.7% 0.70 / 0.69 / +1.4%
clickbench_q36/datafusion:vortex-file-compressed 58865524 / 57560728 / +2.3% 113273980 / 115981353 / -2.3% 0.52 / 0.50 / +4.7%
clickbench_q37/datafusion:vortex-file-compressed 29728462 / 29234077 / +1.7% 78394140 / 77996974 / +0.5% 0.38 / 0.37 / +1.2%
clickbench_q38/datafusion:vortex-file-compressed 16486242 / 15524952 / +6.2% 66684039 / 66158979 / +0.8% 0.25 / 0.23 / +5.4%
clickbench_q39/datafusion:vortex-file-compressed 111877151 / 111949104 / -0.1% 182147388 / 182498558 / -0.2% 0.61 / 0.61 / +0.1%
clickbench_q40/datafusion:vortex-file-compressed 13454064 / 13103677 / +2.7% 61765527 / 59889812 / +3.1% 0.22 / 0.22 / -0.4%
clickbench_q41/datafusion:vortex-file-compressed 12822335 / 13130022 / -2.3% 62279348 / 59960818 / +3.9% 0.21 / 0.22 / -6.0%
clickbench_q42/datafusion:vortex-file-compressed 13540235 / 13834928 / -2.1% 61000003 / 60576090 / +0.7% 0.22 / 0.23 / -2.8%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1891532 / 2000624 / -5.5% 86388870 / 84893011 / +1.8% 0.02 / 0.02 / -7.1%
clickbench_q01/datafusion:parquet 17458712 / 17205676 / +1.5% 121014775 / 123133329 / -1.7% 0.14 / 0.14 / +3.2%
clickbench_q02/datafusion:parquet 31340712 / 30855164 / +1.6% 142609300 / 155627107 / -8.4% 0.22 / 0.20 / +10.8%
clickbench_q03/datafusion:parquet 26557314 / 27355390 / -2.9% 143903278 / 143856510 / +0.0% 0.18 / 0.19 / -2.9%
clickbench_q04/datafusion:parquet 171806706 / 173130479 / -0.8% 314621645 / 304128181 / +3.5% 0.55 / 0.57 / -4.1%
clickbench_q05/datafusion:parquet 239039259 / 238859512 / +0.1% 372864605 / 377963785 / -1.3% 0.64 / 0.63 / +1.4%
clickbench_q06/datafusion:parquet 1880944 / 1905054 / -1.3% 86860942 / 85218776 / +1.9% 0.02 / 0.02 / -3.1%
clickbench_q07/datafusion:parquet 17421775 / 18570080 / -6.2% 128438509 / 126679634 / +1.4% 0.14 / 0.15 / -7.5%
clickbench_q08/datafusion:parquet 225840306 / 228903820 / -1.3% 393570796 / 389162562 / +1.1% 0.57 / 0.59 / -2.4%
clickbench_q09/datafusion:parquet 359476606 / 358920520 / +0.2% 494585417 / 505728569 / -2.2% 0.73 / 0.71 / +2.4%
clickbench_q10/datafusion:parquet 73851491 / 74629019 / -1.0% 197956313 / 201152339 / -1.6% 0.37 / 0.37 / +0.6%
clickbench_q11/datafusion:parquet 89628832 / 90925054 / -1.4% 222220720 / 220904345 / +0.6% 0.40 / 0.41 / -2.0%
clickbench_q12/datafusion:parquet 240599031 / 239139118 / +0.6% 386870120 / 382519359 / +1.1% 0.62 / 0.63 / -0.5%
clickbench_q13/datafusion:parquet 394309868 / 400130986 / -1.5% 566367785 / 547313942 / +3.5% 0.70 / 0.73 / -4.8%
clickbench_q14/datafusion:parquet 252489804 / 254381672 / -0.7% 404941923 / 400417187 / +1.1% 0.62 / 0.64 / -1.9%
clickbench_q15/datafusion:parquet 192598110 / 195831424 / -1.7% 337964376 / 336379909 / +0.5% 0.57 / 0.58 / -2.1%
clickbench_q16/datafusion:parquet 487425663 / 476032043 / +2.4% 650426315 / 644556251 / +0.9% 0.75 / 0.74 / +1.5%
clickbench_q17/datafusion:parquet 478233724 / 475541290 / +0.6% 653456622 / 647081717 / +1.0% 0.73 / 0.73 / -0.4%
clickbench_q18/datafusion:parquet 913625594 / 917842096 / -0.5% 1098120448 / 1098375563 / -0.0% 0.83 / 0.84 / -0.4%
clickbench_q19/datafusion:parquet 22649972 / 23463204 / -3.5% 136489685 / 136214901 / +0.2% 0.17 / 0.17 / -3.7%
clickbench_q20/datafusion:parquet 446693980 / 450150899 / -0.8% 621090855 / 616677565 / +0.7% 0.72 / 0.73 / -1.5%
clickbench_q21/datafusion:parquet 481504328 / 483924012 / -0.5% 659010289 / 672115743 / -1.9% 0.73 / 0.72 / +1.5%
clickbench_q22/datafusion:parquet 644431516 / 636515730 / +1.2% 881281770 / 865789290 / +1.8% 0.73 / 0.74 / -0.5%
clickbench_q23/datafusion:parquet 2809631727 / 2837850135 / -1.0% 3238036913 / 3209353712 / +0.9% 0.87 / 0.88 / -1.9%
clickbench_q24/datafusion:parquet 48368805 / 49061044 / -1.4% 157503540 / 158221083 / -0.5% 0.31 / 0.31 / -1.0%
clickbench_q25/datafusion:parquet 89680504 / 88129686 / +1.8% 212546519 / 213316116 / -0.4% 0.42 / 0.41 / +2.1%
clickbench_q26/datafusion:parquet 49450708 / 49867451 / -0.8% 166558134 / 161192998 / +3.3% 0.30 / 0.31 / -4.0%
clickbench_q27/datafusion:parquet 512643847 / 517905198 / -1.0% 685129112 / 704945974 / -2.8% 0.75 / 0.73 / +1.8%
clickbench_q28/datafusion:parquet 1545262017 / 1545849992 / -0.0% 1650007150 / 1620833292 / +1.8% 0.94 / 0.95 / -1.8%
clickbench_q29/datafusion:parquet 40084036 / 40099198 / -0.0% 159976024 / 160231369 / -0.2% 0.25 / 0.25 / +0.1%
clickbench_q30/datafusion:parquet 232640512 / 232101836 / +0.2% 406327169 / 401471064 / +1.2% 0.57 / 0.58 / -1.0%
clickbench_q31/datafusion:parquet 274482033 / 265405942 / +3.4% 464245949 / 453565439 / +2.4% 0.59 / 0.59 / +1.0%
clickbench_q32/datafusion:parquet 850549993 / 842270735 / +1.0% 1042376872 / 1041752887 / +0.1% 0.82 / 0.81 / +0.9%
clickbench_q33/datafusion:parquet 1079341388 / 1086791822 / -0.7% 1293485341 / 1289498977 / +0.3% 0.83 / 0.84 / -1.0%
clickbench_q34/datafusion:parquet 1086672152 / 1085298768 / +0.1% 1280988070 / 1333833102 / -4.0% 0.85 / 0.81 / +4.3%
clickbench_q35/datafusion:parquet 163170814 / 162228396 / +0.6% 296149229 / 295048595 / +0.4% 0.55 / 0.55 / +0.2%
clickbench_q36/datafusion:parquet 107531924 / 108459044 / -0.9% 225630733 / 225213907 / +0.2% 0.48 / 0.48 / -1.0%
clickbench_q37/datafusion:parquet 49616829 / 48768874 / +1.7% 154989296 / 149952296 / +3.4% 0.32 / 0.33 / -1.6%
clickbench_q38/datafusion:parquet 66155846 / 65822870 / +0.5% 172767069 / 178598811 / -3.3% 0.38 / 0.37 / +3.9%
clickbench_q39/datafusion:parquet 201618488 / 202989543 / -0.7% 335999169 / 334932546 / +0.3% 0.60 / 0.61 / -1.0%
clickbench_q40/datafusion:parquet 28376428 / 26281272 / +8.0% 135451196 / 138247308 / -2.0% 0.21 / 0.19 / +10.2%
clickbench_q41/datafusion:parquet 26429593 / 26266097 / +0.6% 131775502 / 134589145 / -2.1% 0.20 / 0.20 / +2.8%
clickbench_q42/datafusion:parquet 26266394 / 26625131 / -1.3% 125307640 / 128773661 / -2.7% 0.21 / 0.21 / +1.4%
duckdb / vortex-file-compressed / ns (0.909x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2082722 / 12688852 / -83.6% 🟢 71577438 / 78526692 / -8.8% 0.03 / 0.16 / -82.0%
clickbench_q01/duckdb:vortex-file-compressed 19488176 / 18512702 / +5.3% 88370644 / 103914239 / -15.0% 🟢 0.22 / 0.18 / +23.8%
clickbench_q02/duckdb:vortex-file-compressed 22955942 / 23943790 / -4.1% 101377215 / 109770425 / -7.6% 0.23 / 0.22 / +3.8%
clickbench_q03/duckdb:vortex-file-compressed 35715374 / 32342416 / +10.4% 🔴 108559121 / 111576666 / -2.7% 0.33 / 0.29 / +13.5%
clickbench_q04/duckdb:vortex-file-compressed 133294192 / 132410024 / +0.7% 210602098 / 223752111 / -5.9% 0.63 / 0.59 / +7.0%
clickbench_q05/duckdb:vortex-file-compressed 154840328 / 156149590 / -0.8% 241724537 / 245779965 / -1.7% 0.64 / 0.64 / +0.8%
clickbench_q06/duckdb:vortex-file-compressed 2514706 / 20565063 / -87.8% 🟢 90700170 / 101394903 / -10.5% 🟢 0.03 / 0.20 / -86.3%
clickbench_q07/duckdb:vortex-file-compressed 22276652 / 23062257 / -3.4% 103123240 / 102171321 / +0.9% 0.22 / 0.23 / -4.3%
clickbench_q08/duckdb:vortex-file-compressed 172097274 / 173017237 / -0.5% 295420900 / 304217100 / -2.9% 0.58 / 0.57 / +2.4%
clickbench_q09/duckdb:vortex-file-compressed 214214068 / 212692670 / +0.7% 336167058 / 345809858 / -2.8% 0.64 / 0.62 / +3.6%
clickbench_q10/duckdb:vortex-file-compressed 74534403 / 73745388 / +1.1% 177324065 / 185792398 / -4.6% 0.42 / 0.40 / +5.9%
clickbench_q11/duckdb:vortex-file-compressed 97039040 / 91944357 / +5.5% 198330153 / 205986146 / -3.7% 0.49 / 0.45 / +9.6%
clickbench_q12/duckdb:vortex-file-compressed 179991432 / 176240622 / +2.1% 288149894 / 296361147 / -2.8% 0.62 / 0.59 / +5.0%
clickbench_q13/duckdb:vortex-file-compressed 328742548 / 324255297 / +1.4% 450593544 / 461732720 / -2.4% 0.73 / 0.70 / +3.9%
clickbench_q14/duckdb:vortex-file-compressed 194659693 / 196827222 / -1.1% 296883993 / 304323903 / -2.4% 0.66 / 0.65 / +1.4%
clickbench_q15/duckdb:vortex-file-compressed 185648016 / 185743332 / -0.1% 298930627 / 296462144 / +0.8% 0.62 / 0.63 / -0.9%
clickbench_q16/duckdb:vortex-file-compressed 378114446 / 381573354 / -0.9% 484196772 / 497034659 / -2.6% 0.78 / 0.77 / +1.7%
clickbench_q17/duckdb:vortex-file-compressed 377360878 / 373282498 / +1.1% 481143614 / 490645899 / -1.9% 0.78 / 0.76 / +3.1%
clickbench_q18/duckdb:vortex-file-compressed 740643256 / 742590934 / -0.3% 876619962 / 877915760 / -0.1% 0.84 / 0.85 / -0.1%
clickbench_q19/duckdb:vortex-file-compressed 26156981 / 27343179 / -4.3% 111124789 / 107561095 / +3.3% 0.24 / 0.25 / -7.4%
clickbench_q20/duckdb:vortex-file-compressed 245757406 / 243436231 / +1.0% 435131192 / 447339069 / -2.7% 0.56 / 0.54 / +3.8%
clickbench_q21/duckdb:vortex-file-compressed 370124020 / 368192442 / +0.5% 653878825 / 644655343 / +1.4% 0.57 / 0.57 / -0.9%
clickbench_q22/duckdb:vortex-file-compressed 558287331 / 558898142 / -0.1% 965593034 / 970460193 / -0.5% 0.58 / 0.58 / +0.4%
clickbench_q23/duckdb:vortex-file-compressed 123425524 / 125277308 / -1.5% 239549009 / 243932093 / -1.8% 0.52 / 0.51 / +0.3%
clickbench_q24/duckdb:vortex-file-compressed 37266064 / 38741118 / -3.8% 97685046 / 95908973 / +1.9% 0.38 / 0.40 / -5.6%
clickbench_q25/duckdb:vortex-file-compressed 60857552 / 63807506 / -4.6% 140896474 / 143248881 / -1.6% 0.43 / 0.45 / -3.0%
clickbench_q26/duckdb:vortex-file-compressed 36603624 / 32941880 / +11.1% 🔴 92074454 / 93920791 / -2.0% 0.40 / 0.35 / +13.3%
clickbench_q27/duckdb:vortex-file-compressed 247961202 / 242179972 / +2.4% 525552516 / 522337518 / +0.6% 0.47 / 0.46 / +1.8%
clickbench_q28/duckdb:vortex-file-compressed 1156165508 / 1282611446 / -9.9% 1423311821 / 1509170492 / -5.7% 0.81 / 0.85 / -4.4%
clickbench_q29/duckdb:vortex-file-compressed 30184018 / 30991252 / -2.6% 115247469 / 117085949 / -1.6% 0.26 / 0.26 / -1.1%
clickbench_q30/duckdb:vortex-file-compressed 173354044 / 172433006 / +0.5% 289241336 / 288763370 / +0.2% 0.60 / 0.60 / +0.4%
clickbench_q31/duckdb:vortex-file-compressed 304874419 / 321471398 / -5.2% 469188813 / 510550013 / -8.1% 0.65 / 0.63 / +3.2%
clickbench_q32/duckdb:vortex-file-compressed 920678838 / 930693383 / -1.1% 1053677618 / 1076272168 / -2.1% 0.87 / 0.86 / +1.0%
clickbench_q33/duckdb:vortex-file-compressed 1048683874 / 1061171977 / -1.2% 1298291206 / 1289968534 / +0.6% 0.81 / 0.82 / -1.8%
clickbench_q34/duckdb:vortex-file-compressed 1072572144 / 1083527178 / -1.0% 1380276659 / 1338642637 / +3.1% 0.78 / 0.81 / -4.0%
clickbench_q35/duckdb:vortex-file-compressed 208675788 / 212445054 / -1.8% 284595193 / 288634642 / -1.4% 0.73 / 0.74 / -0.4%
clickbench_q36/duckdb:vortex-file-compressed 30438495 / 29236775 / +4.1% 111435910 / 120017327 / -7.2% 0.27 / 0.24 / +12.1%
clickbench_q37/duckdb:vortex-file-compressed 19069701 / 21092774 / -9.6% 75971098 / 70680852 / +7.5% 0.25 / 0.30 / -15.9%
clickbench_q38/duckdb:vortex-file-compressed 22237976 / 24025350 / -7.4% 97664819 / 119630497 / -18.4% 🟢 0.23 / 0.20 / +13.4%
clickbench_q39/duckdb:vortex-file-compressed 46899746 / 46973900 / -0.2% 134499694 / 127292108 / +5.7% 0.35 / 0.37 / -5.5%
clickbench_q40/duckdb:vortex-file-compressed 16787300 / 16006056 / +4.9% 85900141 / 75059865 / +14.4% 🔴 0.20 / 0.21 / -8.4%
clickbench_q41/duckdb:vortex-file-compressed 18851764 / 18177124 / +3.7% 85254331 / 78850241 / +8.1% 0.22 / 0.23 / -4.1%
clickbench_q42/duckdb:vortex-file-compressed 18895762 / 19834942 / -4.7% 84384711 / 77721936 / +8.6% 0.22 / 0.26 / -12.3%
duckdb / parquet / ns (0.978x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 15139728 / 16554109 / -8.5% 41655307 / 41000304 / +1.6% 0.36 / 0.40 / -10.0%
clickbench_q01/duckdb:parquet 17120886 / 18005950 / -4.9% 38218031 / 36468110 / +4.8% 0.45 / 0.49 / -9.3%
clickbench_q02/duckdb:parquet 24823958 / 25445336 / -2.4% 61123530 / 58225631 / +5.0% 0.41 / 0.44 / -7.1%
clickbench_q03/duckdb:parquet 30467973 / 29563088 / +3.1% 90452567 / 88282964 / +2.5% 0.34 / 0.33 / +0.6%
clickbench_q04/duckdb:parquet 131129250 / 134500312 / -2.5% 177112657 / 179802895 / -1.5% 0.74 / 0.75 / -1.0%
clickbench_q05/duckdb:parquet 196033202 / 195825670 / +0.1% 261187402 / 267146845 / -2.2% 0.75 / 0.73 / +2.4%
clickbench_q06/duckdb:parquet 23646682 / 26876885 / -12.0% 🟢 47804266 / 47813188 / -0.0% 0.49 / 0.56 / -12.0%
clickbench_q07/duckdb:parquet 17979856 / 19508878 / -7.8% 46755355 / 41483096 / +12.7% 🔴 0.38 / 0.47 / -18.2%
clickbench_q08/duckdb:parquet 162600198 / 162620468 / -0.0% 250838762 / 254304097 / -1.4% 0.65 / 0.64 / +1.4%
clickbench_q09/duckdb:parquet 226493252 / 227466944 / -0.4% 303023981 / 314859115 / -3.8% 0.75 / 0.72 / +3.5%
clickbench_q10/duckdb:parquet 63642760 / 63640920 / +0.0% 118153599 / 118313400 / -0.1% 0.54 / 0.54 / +0.1%
clickbench_q11/duckdb:parquet 70913532 / 71231783 / -0.4% 135898701 / 140712679 / -3.4% 0.52 / 0.51 / +3.1%
clickbench_q12/duckdb:parquet 176315303 / 175189689 / +0.6% 276715885 / 276037047 / +0.2% 0.64 / 0.63 / +0.4%
clickbench_q13/duckdb:parquet 309778486 / 315525252 / -1.8% 427675901 / 432675559 / -1.2% 0.72 / 0.73 / -0.7%
clickbench_q14/duckdb:parquet 198091978 / 193447578 / +2.4% 278634407 / 300067739 / -7.1% 0.71 / 0.64 / +10.3%
clickbench_q15/duckdb:parquet 185057294 / 187773020 / -1.4% 229840935 / 229872455 / -0.0% 0.81 / 0.82 / -1.4%
clickbench_q16/duckdb:parquet 350138677 / 355712656 / -1.6% 467001354 / 471360921 / -0.9% 0.75 / 0.75 / -0.6%
clickbench_q17/duckdb:parquet 354909095 / 373693406 / -5.0% 464757198 / 468124874 / -0.7% 0.76 / 0.80 / -4.3%
clickbench_q18/duckdb:parquet 682261254 / 690468568 / -1.2% 877820759 / 895162833 / -1.9% 0.78 / 0.77 / +0.8%
clickbench_q19/duckdb:parquet 21633531 / 24179800 / -10.5% 🟢 66903976 / 66345360 / +0.8% 0.32 / 0.36 / -11.3%
clickbench_q20/duckdb:parquet 257162655 / 267458398 / -3.8% 458609323 / 471792583 / -2.8% 0.56 / 0.57 / -1.1%
clickbench_q21/duckdb:parquet 325475780 / 327323242 / -0.6% 600688778 / 621309959 / -3.3% 0.54 / 0.53 / +2.8%
clickbench_q22/duckdb:parquet 466256331 / 484370842 / -3.7% 787317542 / 779219213 / +1.0% 0.59 / 0.62 / -4.7%
clickbench_q23/duckdb:parquet 252348415 / 255456586 / -1.2% 308901281 / 311126962 / -0.7% 0.82 / 0.82 / -0.5%
clickbench_q24/duckdb:parquet 73625630 / 79318668 / -7.2% 125572440 / 124288020 / +1.0% 0.59 / 0.64 / -8.1%
clickbench_q25/duckdb:parquet 75170468 / 75992338 / -1.1% 177743895 / 176541387 / +0.7% 0.42 / 0.43 / -1.8%
clickbench_q26/duckdb:parquet 54111910 / 54655897 / -1.0% 91728683 / 102406325 / -10.4% 🟢 0.59 / 0.53 / +10.5%
clickbench_q27/duckdb:parquet 277655921 / 282456942 / -1.7% 544565021 / 530152435 / +2.7% 0.51 / 0.53 / -4.3%
clickbench_q28/duckdb:parquet 1659149636 / 1711806170 / -3.1% 2201694322 / 2183031922 / +0.9% 0.75 / 0.78 / -3.9%
clickbench_q29/duckdb:parquet 26486246 / 28307046 / -6.4% 60092601 / 56057009 / +7.2% 0.44 / 0.50 / -12.7%
clickbench_q30/duckdb:parquet 176934340 / 177947054 / -0.6% 335746521 / 329670740 / +1.8% 0.53 / 0.54 / -2.4%
clickbench_q31/duckdb:parquet 310396008 / 314258111 / -1.2% 580200404 / 586925317 / -1.1% 0.53 / 0.54 / -0.1%
clickbench_q32/duckdb:parquet 889090408 / 890186556 / -0.1% 1035754179 / 1030686890 / +0.5% 0.86 / 0.86 / -0.6%
clickbench_q33/duckdb:parquet 789447320 / 799989252 / -1.3% 1079982782 / 950949904 / +13.6% 🔴 0.73 / 0.84 / -13.1%
clickbench_q34/duckdb:parquet 809154768 / 803582974 / +0.7% 1105984982 / 983462060 / +12.5% 🔴 0.73 / 0.82 / -10.5%
clickbench_q35/duckdb:parquet 207724277 / 208502504 / -0.4% 236578483 / 253270499 / -6.6% 0.88 / 0.82 / +6.7%
clickbench_q36/duckdb:parquet 49100986 / 49507615 / -0.8% 73541851 / 71401515 / +3.0% 0.67 / 0.69 / -3.7%
clickbench_q37/duckdb:parquet 38407453 / 37716694 / +1.8% 59876915 / 59373235 / +0.8% 0.64 / 0.64 / +1.0%
clickbench_q38/duckdb:parquet 39600370 / 38008877 / +4.2% 62914065 / 63865555 / -1.5% 0.63 / 0.60 / +5.8%
clickbench_q39/duckdb:parquet 87940568 / 91118384 / -3.5% 104734816 / 108628050 / -3.6% 0.84 / 0.84 / +0.1%
clickbench_q40/duckdb:parquet 20701612 / 20404615 / +1.5% 44613873 / 44050611 / +1.3% 0.46 / 0.46 / +0.2%
clickbench_q41/duckdb:parquet 21448418 / 20846247 / +2.9% 43776040 / 41554648 / +5.3% 0.49 / 0.50 / -2.3%
clickbench_q42/duckdb:parquet 22037160 / 24298099 / -9.3% 48161849 / 45231523 / +6.5% 0.46 / 0.54 / -14.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 00b8cabd vs base ee1ac252
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-2.1%, environment too noisy confidence) · DuckDB No clear signal (+3.7%, environment too noisy confidence)
Vortex (geomean): hot 0.966x ➖ · cold 0.949x ➖
Parquet (geomean): hot 0.959x ➖ · cold 0.941x ➖
Shifts: Parquet (control) -4.1% · Median polish -4.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.937x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 259491942 / 235114358 / +10.4% 620669670 / 787310549 / -21.2% 0.42 / 0.30 / +40.0%
tpch_q02/datafusion:vortex-file-compressed 496421093 / 427020614 / +16.3% 835884243 / 848897330 / -1.5% 0.59 / 0.50 / +18.1%
tpch_q03/datafusion:vortex-file-compressed 321963175 / 428560703 / -24.9% 896533680 / 1101000127 / -18.6% 0.36 / 0.39 / -7.7%
tpch_q04/datafusion:vortex-file-compressed 165217553 / 167179571 / -1.2% 381730647 / 391710330 / -2.5% 0.43 / 0.43 / +1.4%
tpch_q05/datafusion:vortex-file-compressed 323455539 / 354270555 / -8.7% 596040657 / 599750731 / -0.6% 0.54 / 0.59 / -8.1%
tpch_q06/datafusion:vortex-file-compressed 301669864 / 265004987 / +13.8% 401315044 / 459606620 / -12.7% 0.75 / 0.58 / +30.4%
tpch_q07/datafusion:vortex-file-compressed 333628744 / 434938835 / -23.3% 522581116 / 622374020 / -16.0% 0.64 / 0.70 / -8.6%
tpch_q08/datafusion:vortex-file-compressed 542768494 / 576250773 / -5.8% 778037401 / 692433941 / +12.4% 0.70 / 0.83 / -16.2%
tpch_q09/datafusion:vortex-file-compressed 474266911 / 451456486 / +5.1% 890215924 / 547745443 / +62.5% 🔴 0.53 / 0.82 / -35.4%
tpch_q10/datafusion:vortex-file-compressed 339409873 / 357823440 / -5.1% 491926594 / 511989821 / -3.9% 0.69 / 0.70 / -1.3%
tpch_q11/datafusion:vortex-file-compressed 265710759 / 310245884 / -14.4% 491901474 / 449572251 / +9.4% 0.54 / 0.69 / -21.7%
tpch_q12/datafusion:vortex-file-compressed 365752298 / 345177664 / +6.0% 497720514 / 1108666943 / -55.1% 🟢 0.73 / 0.31 / +136.0%
tpch_q13/datafusion:vortex-file-compressed 104475913 / 128967442 / -19.0% 317642753 / 464561689 / -31.6% 🟢 0.33 / 0.28 / +18.5%
tpch_q14/datafusion:vortex-file-compressed 173820261 / 191164623 / -9.1% 326131520 / 384991066 / -15.3% 0.53 / 0.50 / +7.3%
tpch_q15/datafusion:vortex-file-compressed 281285515 / 336567234 / -16.4% 484389897 / 691824148 / -30.0% 0.58 / 0.49 / +19.4%
tpch_q16/datafusion:vortex-file-compressed 250149360 / 209399839 / +19.5% 406154964 / 376238860 / +8.0% 0.62 / 0.56 / +10.7%
tpch_q17/datafusion:vortex-file-compressed 331829039 / 395330506 / -16.1% 508417601 / 470074439 / +8.2% 0.65 / 0.84 / -22.4%
tpch_q18/datafusion:vortex-file-compressed 220494836 / 257350016 / -14.3% 408344655 / 452928999 / -9.8% 0.54 / 0.57 / -5.0%
tpch_q19/datafusion:vortex-file-compressed 327553260 / 352838017 / -7.2% 498574746 / 524662572 / -5.0% 0.66 / 0.67 / -2.3%
tpch_q20/datafusion:vortex-file-compressed 397488444 / 399267113 / -0.4% 556720843 / 534413874 / +4.2% 0.71 / 0.75 / -4.4%
tpch_q21/datafusion:vortex-file-compressed 452298550 / 470773085 / -3.9% 638936404 / 724980054 / -11.9% 0.71 / 0.65 / +9.0%
tpch_q22/datafusion:vortex-file-compressed 139704241 / 177610000 / -21.3% 339878041 / 397365062 / -14.5% 0.41 / 0.45 / -8.0%
datafusion / parquet / ns (0.957x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 213319427 / 210223856 / +1.5% 508497229 / 469507186 / +8.3% 0.42 / 0.45 / -6.3%
tpch_q02/datafusion:parquet 269491270 / 298202555 / -9.6% 519313012 / 575983469 / -9.8% 0.52 / 0.52 / +0.2%
tpch_q03/datafusion:parquet 287188639 / 331974523 / -13.5% 729852243 / 759095524 / -3.9% 0.39 / 0.44 / -10.0%
tpch_q04/datafusion:parquet 168568796 / 153004926 / +10.2% 418758488 / 357857772 / +17.0% 0.40 / 0.43 / -5.9%
tpch_q05/datafusion:parquet 359135187 / 411240922 / -12.7% 487905496 / 741408643 / -34.2% 🟢 0.74 / 0.55 / +32.7%
tpch_q06/datafusion:parquet 133364619 / 134506148 / -0.8% 297946070 / 307524120 / -3.1% 0.45 / 0.44 / +2.3%
tpch_q07/datafusion:parquet 369088423 / 461105976 / -20.0% 484027231 / 538317473 / -10.1% 0.76 / 0.86 / -11.0%
tpch_q08/datafusion:parquet 436362339 / 523387975 / -16.6% 955509950 / 916248883 / +4.3% 0.46 / 0.57 / -20.1%
tpch_q09/datafusion:parquet 471375418 / 478412984 / -1.5% 668787756 / 675859574 / -1.0% 0.70 / 0.71 / -0.4%
tpch_q10/datafusion:parquet 394123137 / 417244066 / -5.5% 533027951 / 583180663 / -8.6% 0.74 / 0.72 / +3.3%
tpch_q11/datafusion:parquet 340837460 / 298128308 / +14.3% 510552648 / 500324645 / +2.0% 0.67 / 0.60 / +12.0%
tpch_q12/datafusion:parquet 203508026 / 192447774 / +5.7% 470552826 / 394174758 / +19.4% 0.43 / 0.49 / -11.4%
tpch_q13/datafusion:parquet 452804530 / 457390521 / -1.0% 594175236 / 724258679 / -18.0% 0.76 / 0.63 / +20.7%
tpch_q14/datafusion:parquet 167054116 / 197637623 / -15.5% 307971135 / 331386002 / -7.1% 0.54 / 0.60 / -9.0%
tpch_q15/datafusion:parquet 268822951 / 323861202 / -17.0% 453245139 / 534339030 / -15.2% 0.59 / 0.61 / -2.1%
tpch_q16/datafusion:parquet 147773428 / 118845969 / +24.3% 401417761 / 336693494 / +19.2% 0.37 / 0.35 / +4.3%
tpch_q17/datafusion:parquet 328373650 / 335941261 / -2.3% 430966676 / 442694007 / -2.6% 0.76 / 0.76 / +0.4%
tpch_q18/datafusion:parquet 472494341 / 492707991 / -4.1% 602868428 / 631098257 / -4.5% 0.78 / 0.78 / +0.4%
tpch_q19/datafusion:parquet 192243067 / 178048538 / +8.0% 315885751 / 331806024 / -4.8% 0.61 / 0.54 / +13.4%
tpch_q20/datafusion:parquet 266103834 / 282038981 / -5.6% 503798630 / 527074840 / -4.4% 0.53 / 0.54 / -1.3%
tpch_q21/datafusion:parquet 409285203 / 398010415 / +2.8% 547859157 / 548183365 / -0.1% 0.75 / 0.73 / +2.9%
tpch_q22/datafusion:parquet 208114024 / 265843523 / -21.7% 418919021 / 452334948 / -7.4% 0.50 / 0.59 / -15.5%
duckdb / vortex-file-compressed / ns (0.996x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 204074502 / 221276344 / -7.8% 262420233 / 314623506 / -16.6% 0.78 / 0.70 / +10.6%
tpch_q02/duckdb:vortex-file-compressed 429695624 / 416376141 / +3.2% 498930497 / 544278258 / -8.3% 0.86 / 0.77 / +12.6%
tpch_q03/duckdb:vortex-file-compressed 410237540 / 409277172 / +0.2% 522733456 / 471889324 / +10.8% 0.78 / 0.87 / -9.5%
tpch_q04/duckdb:vortex-file-compressed 243285616 / 286301215 / -15.0% 319181750 / 320637045 / -0.5% 0.76 / 0.89 / -14.6%
tpch_q05/duckdb:vortex-file-compressed 379597355 / 416194090 / -8.8% 424111604 / 533991271 / -20.6% 0.90 / 0.78 / +14.8%
tpch_q06/duckdb:vortex-file-compressed 286715432 / 288665212 / -0.7% 289673568 / 341012262 / -15.1% 0.99 / 0.85 / +16.9%
tpch_q07/duckdb:vortex-file-compressed 427009520 / 420705121 / +1.5% 473709056 / 475180346 / -0.3% 0.90 / 0.89 / +1.8%
tpch_q08/duckdb:vortex-file-compressed 542266361 / 546636728 / -0.8% 606794139 / 592337607 / +2.4% 0.89 / 0.92 / -3.2%
tpch_q09/duckdb:vortex-file-compressed 496046222 / 471364200 / +5.2% 507081005 / 547056157 / -7.3% 0.98 / 0.86 / +13.5%
tpch_q10/duckdb:vortex-file-compressed 1175199557 / 434155188 / +170.7% 🔴 1002839794 / 552785396 / +81.4% 🔴 1.17 / 0.79 / +49.2%
tpch_q11/duckdb:vortex-file-compressed 161942010 / 183206188 / -11.6% 191504585 / 204642738 / -6.4% 0.85 / 0.90 / -5.5%
tpch_q12/duckdb:vortex-file-compressed 448414621 / 361712798 / +24.0% 422191013 / 518680159 / -18.6% 1.06 / 0.70 / +52.3%
tpch_q13/duckdb:vortex-file-compressed 305361747 / 308579774 / -1.0% 340723159 / 432379344 / -21.2% 0.90 / 0.71 / +25.6%
tpch_q14/duckdb:vortex-file-compressed 227658353 / 232283511 / -2.0% 317145266 / 311527975 / +1.8% 0.72 / 0.75 / -3.7%
tpch_q15/duckdb:vortex-file-compressed 147440511 / 166345516 / -11.4% 223666397 / 275427248 / -18.8% 0.66 / 0.60 / +9.1%
tpch_q16/duckdb:vortex-file-compressed 201826684 / 198897565 / +1.5% 245541460 / 237279102 / +3.5% 0.82 / 0.84 / -1.9%
tpch_q17/duckdb:vortex-file-compressed 364750445 / 406030407 / -10.2% 421636708 / 526759607 / -20.0% 0.87 / 0.77 / +12.2%
tpch_q18/duckdb:vortex-file-compressed 287266639 / 340029763 / -15.5% 569598847 / 458944604 / +24.1% 0.50 / 0.74 / -31.9%
tpch_q19/duckdb:vortex-file-compressed 331805487 / 335437007 / -1.1% 445552974 / 377791906 / +17.9% 0.74 / 0.89 / -16.1%
tpch_q20/duckdb:vortex-file-compressed 363038931 / 525986413 / -31.0% 🟢 400041891 / 475408873 / -15.9% 0.91 / 1.11 / -18.0%
tpch_q21/duckdb:vortex-file-compressed 566464313 / 661697625 / -14.4% 901854757 / 731038150 / +23.4% 0.63 / 0.91 / -30.6%
tpch_q22/duckdb:vortex-file-compressed 120874951 / 116842439 / +3.5% 217672123 / 166599778 / +30.7% 🔴 0.56 / 0.70 / -20.8%
duckdb / parquet / ns (0.961x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 333194607 / 343669724 / -3.0% 334743035 / 426103258 / -21.4% 1.00 / 0.81 / +23.4%
tpch_q02/duckdb:parquet 697073598 / 710118553 / -1.8% 696286177 / 715632103 / -2.7% 1.00 / 0.99 / +0.9%
tpch_q03/duckdb:parquet 761427459 / 826459395 / -7.9% 966698044 / 1128998537 / -14.4% 0.79 / 0.73 / +7.6%
tpch_q04/duckdb:parquet 472433502 / 505134556 / -6.5% 445425612 / 562495097 / -20.8% 1.06 / 0.90 / +18.1%
tpch_q05/duckdb:parquet 902378994 / 1016260512 / -11.2% 969868777 / 1110194577 / -12.6% 0.93 / 0.92 / +1.6%
tpch_q06/duckdb:parquet 336676149 / 331357128 / +1.6% 338082979 / 311581074 / +8.5% 1.00 / 1.06 / -6.4%
tpch_q07/duckdb:parquet 891698785 / 990592472 / -10.0% 916621408 / 1012619287 / -9.5% 0.97 / 0.98 / -0.6%
tpch_q08/duckdb:parquet 1065978157 / 1183914544 / -10.0% 1095586775 / 1072414219 / +2.2% 0.97 / 1.10 / -11.9%
tpch_q09/duckdb:parquet 1043233254 / 1058013868 / -1.4% 1117671941 / 1104876039 / +1.2% 0.93 / 0.96 / -2.5%
tpch_q10/duckdb:parquet 992119232 / 1086910776 / -8.7% 1083769720 / 1177044514 / -7.9% 0.92 / 0.92 / -0.9%
tpch_q11/duckdb:parquet 454084552 / 461797844 / -1.7% 444601585 / 511835502 / -13.1% 1.02 / 0.90 / +13.2%
tpch_q12/duckdb:parquet 517608898 / 514089297 / +0.7% 544434301 / 605643861 / -10.1% 0.95 / 0.85 / +12.0%
tpch_q13/duckdb:parquet 849762725 / 886448416 / -4.1% 912277482 / 1017760991 / -10.4% 0.93 / 0.87 / +6.9%
tpch_q14/duckdb:parquet 576693902 / 493551281 / +16.8% 566876389 / 517380707 / +9.6% 1.02 / 0.95 / +6.6%
tpch_q15/duckdb:parquet 372359816 / 371902818 / +0.1% 384209238 / 356106116 / +7.9% 0.97 / 1.04 / -7.2%
tpch_q16/duckdb:parquet 489690539 / 535872601 / -8.6% 482985710 / 593931442 / -18.7% 1.01 / 0.90 / +12.4%
tpch_q17/duckdb:parquet 497423281 / 508637894 / -2.2% 529822918 / 529151663 / +0.1% 0.94 / 0.96 / -2.3%
tpch_q18/duckdb:parquet 669710952 / 685746911 / -2.3% 755959662 / 744405479 / +1.6% 0.89 / 0.92 / -3.8%
tpch_q19/duckdb:parquet 557673108 / 576010520 / -3.2% 651174355 / 645295409 / +0.9% 0.86 / 0.89 / -4.1%
tpch_q20/duckdb:parquet 835782711 / 855113748 / -2.3% 856298783 / 913966557 / -6.3% 0.98 / 0.94 / +4.3%
tpch_q21/duckdb:parquet 730639665 / 764108630 / -4.4% 781299669 / 1359317875 / -42.5% 🟢 0.94 / 0.56 / +66.4%
tpch_q22/duckdb:parquet 452645037 / 515039509 / -12.1% 451563967 / 444892549 / +1.5% 1.00 / 1.16 / -13.4%

myrrc added 2 commits August 26, 2026 12:12
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc marked this pull request as ready for review August 26, 2026 11:22
@myrrc
myrrc enabled auto-merge (squash) August 26, 2026 11:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

duckdb add table_function_get_partition_stats_t to the vortex extension

1 participant