Skip to content

Commit

Permalink
check the logs of controller and events
Browse files Browse the repository at this point in the history
Signed-off-by: helenxie-bit <helenxiehz@gmail.com>
  • Loading branch information
helenxie-bit committed Sep 17, 2024
1 parent 7ea7e43 commit 25d99b1
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 1 deletion.
2 changes: 2 additions & 0 deletions .github/workflows/e2e-test-tune-api.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -68,10 +68,12 @@ jobs:
- name: Fetch Experiment Pod Logs
if: always() # Run this step even if previous steps fail
run: |
kubectl get pods -n default
POD_NAME=$(kubectl get pods -n default --no-headers -o custom-columns=":metadata.name" | grep tune-example-2)
echo "Fetching logs for pod: $POD_NAME"
kubectl describe pod $POD_NAME -n default
kubectl logs $POD_NAME -n default
kubectl get events -n default | grep "tune-example-2"
strategy:
fail-fast: false
Expand Down
3 changes: 2 additions & 1 deletion test/e2e/v1beta1/scripts/gh-actions/run-e2e-tune-api.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
from verify import verify_experiment_results

# Experiment timeout is 40 min.
EXPERIMENT_TIMEOUT = 60 * 40
EXPERIMENT_TIMEOUT = 60 * 15

# The default logging config.
logging.basicConfig(level=logging.INFO)
Expand Down Expand Up @@ -197,6 +197,7 @@ def run_e2e_experiment_create_by_tune_with_external_model(
logging.info("---------------------------------------------------------------")
logging.info(f"E2E is failed for Experiment created by tune: {exp_namespace}/{exp_name}-2")
get_experiment_pods_logs(katib_client, f"{exp_name}-2", exp_namespace)
get_experiment_pods_logs(katib_client, "katib-controller", "kubeflow")
raise e
finally:
# Delete the Experiment.
Expand Down

0 comments on commit 25d99b1

Please sign in to comment.