Skip to content

Commit

Permalink
ci: Fix bench-pr-comment.yml (#354)
Browse files Browse the repository at this point in the history
  • Loading branch information
@samuelburnham
samuelburnham authored Feb 29, 2024
1 parent bb2b233 commit 28ab1e6
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions .github/workflows/bench-pr-comment.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,11 @@ concurrency:
jobs:
benchmark:
name: Comparative PR benchmark comment
if:
github.event.issue.pull_request
&& github.event.issue.state == 'open'
&& (contains(github.event.comment.body, '!benchmark') || contains(github.event.comment.body, '!gpu-benchmark'))
&& (github.event.comment.author_association == 'MEMBER' || github.event.comment.author_association == 'OWNER')
uses: lurk-lab/ci-workflows/.github/workflows/bench-pr-comment.yml@main
with:
default-runner: "self-hosted,gpu-bench"
Expand Down

1 comment on commit 28ab1e6

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmarks

Table of Contents

Overview

This benchmark report shows the Arecibo GPU benchmarks.
NVIDIA L4
Intel(R) Xeon(R) CPU @ 2.20GHz
32 vCPUs
125 GB RAM
Workflow run: https://github.com/lurk-lab/arecibo/actions/runs/8103483488

Benchmark Results

RecursiveSNARK-NIVC-2

ref=bb2b233 ref=28ab1e6
Prove-NumCons-6540 44.19 ms (✅ 1.00x) 44.14 ms (✅ 1.00x faster)
Verify-NumCons-6540 34.32 ms (✅ 1.00x) 34.11 ms (✅ 1.01x faster)
Prove-NumCons-1028888 317.12 ms (✅ 1.00x) 319.42 ms (✅ 1.01x slower)
Verify-NumCons-1028888 250.27 ms (✅ 1.00x) 249.72 ms (✅ 1.00x faster)

CompressedSNARK-NIVC-Commitments-2

ref=bb2b233 ref=28ab1e6
Prove-NumCons-6540 10.74 s (✅ 1.00x) 10.70 s (✅ 1.00x faster)
Verify-NumCons-6540 50.55 ms (✅ 1.00x) 50.53 ms (✅ 1.00x faster)
Prove-NumCons-1028888 52.80 s (✅ 1.00x) 53.97 s (✅ 1.02x slower)
Verify-NumCons-1028888 50.58 ms (✅ 1.00x) 50.82 ms (✅ 1.00x slower)

Made with criterion-table

Please sign in to comment.