Skip to content

Commit

Permalink
Removing automatic issue creation, as we don't look at them and I'm t…
Browse files Browse the repository at this point in the history
…ired of getting the emails.

Reenabling actual benchmark running as part of smoke test.
  • Loading branch information
wpietri committed Oct 20, 2024
1 parent a6f5d63 commit 72cf56e
Showing 1 changed file with 10 additions and 21 deletions.
31 changes: 10 additions & 21 deletions .github/workflows/scheduled-smoke-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,14 +3,12 @@ name: Smoke test
on:
# regular runs
schedule:
# Every day at 08:00 UTC
- cron: '0 0,8,16 * * *'
- cron: '0,6,12,18 * * *'
# allow button click
workflow_dispatch:

permissions:
contents: read
issues: write

jobs:
test:
Expand Down Expand Up @@ -83,16 +81,15 @@ jobs:
source .venv/bin/activate
pytest --expensive-tests
# TODO Disabled pending Modelbench#509
# - name: Test standard run
# run: |
# source .venv/bin/activate
# modelbench benchmark --debug -m 1
#
# - name: Test v1 run
# run: |
# source .venv/bin/activate
# modelbench benchmark -m 1 --benchmark GeneralPurposeAiChatBenchmarkV1
- name: Test v0.5 run
run: |
source .venv/bin/activate
modelbench benchmark -m 1 -v 0.5
- name: Test v1.0 run
run: |
source .venv/bin/activate
modelbench benchmark -m 1 -v 1.0
- name: Ensure the artifact published on Pypi still works as expected
run: |
Expand All @@ -105,14 +102,6 @@ jobs:
poetry install --no-root
poetry run modelgauge list-tests
- uses: JasonEtco/create-an-issue@v2
if: failure()
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
RUN_ID: ${{ github.run_id }}
with:
filename: .github/failed-scheduled-issue.md

- name: Discord notification
if: failure()
env:
Expand Down

0 comments on commit 72cf56e

Please sign in to comment.