-
Notifications
You must be signed in to change notification settings - Fork 441
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature/Example for training KFP v1 #2118
Commits on Jul 18, 2023
-
Adds a first draft of a kfpv1-metricscollector
Closesly modelled after the tfevent-metricscollector. Currently not yet working, as there are issues that the arguments from the `injector_webhoook` are somehow not passed. Addresses: kubeflow#2019
votti committedJul 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 03fa850 - Browse repository at this point
Copy the full SHA 03fa850View commit details -
The TrialName can be parse from the pod name. This seems currently a good way to get the trial name. For more discussion see: kubeflow#2109
Configuration menu - View commit details
-
Copy full SHA for 8918473 - Browse repository at this point
Copy the full SHA 8918473View commit details -
Adds example for tuning a kfp v1 pipeline with Katib
This example illustrates how a full kfp pipeline can be tuned using Katib. It is based on a metrics collector to collect kubeflow pipeline metrics (kubeflow#2019). This is used as a Custom Collector. Addresses: kubeflow#1914, kubeflow#2019
Configuration menu - View commit details
-
Copy full SHA for fd53d85 - Browse repository at this point
Copy the full SHA fd53d85View commit details -
Adds python < 3.11 compatiblity
Before the notebook only worked with Python 3.11. Now it is also tested with 3.10 Also the experiment/run name is extended with a timestamp for easier reruns.
Configuration menu - View commit details
-
Copy full SHA for e9a0051 - Browse repository at this point
Copy the full SHA e9a0051View commit details -
Add histogram equalization before rescaling
Otherwise the image was binarized, leading to an artifically bad performance.
Configuration menu - View commit details
-
Copy full SHA for 17123d6 - Browse repository at this point
Copy the full SHA 17123d6View commit details -
And remove an old comment
Configuration menu - View commit details
-
Copy full SHA for 4f19db8 - Browse repository at this point
Copy the full SHA 4f19db8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9f83b0f - Browse repository at this point
Copy the full SHA 9f83b0fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 61e77ea - Browse repository at this point
Copy the full SHA 61e77eaView commit details -
Co-authored-by: axel7083 <42176370+axel7083@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 88c20c3 - Browse repository at this point
Copy the full SHA 88c20c3View commit details -
Move KFP V1 metrics collector docker files to v1 subfolder
As per suggestion
Configuration menu - View commit details
-
Copy full SHA for 904d07d - Browse repository at this point
Copy the full SHA 904d07dView commit details -
Support loading of folder of metrics collector files
As suggested in the PR review, the generic case where multiple KFP pipeline metrics files would be present in the output folder is supported. Note that in the current KFP v1 implementation always only one data file is present.
Configuration menu - View commit details
-
Copy full SHA for 31655dd - Browse repository at this point
Copy the full SHA 31655ddView commit details -
Move kfpv1 metricscollector in v1 subfolder
As per suggestion this should make it easier to handle the v2 metrics collector in the future as well
Configuration menu - View commit details
-
Copy full SHA for c458541 - Browse repository at this point
Copy the full SHA c458541View commit details -
Configuration menu - View commit details
-
Copy full SHA for cee9970 - Browse repository at this point
Copy the full SHA cee9970View commit details -
Add dependencies for KFPv1 e2e testing
This installs Kubeflow pipelines (KFP) if selected to do so in order to run e2e tests where Katib and KFP interact.
Vito Zanotelli committedJul 18, 2023 Configuration menu - View commit details
-
Copy full SHA for f7e697b - Browse repository at this point
Copy the full SHA f7e697bView commit details -
TMP: changes to run tests locally
This commit should be removed later
Vito Zanotelli committedJul 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 36ed372 - Browse repository at this point
Copy the full SHA 36ed372View commit details -
Add missing ClusterRole update
These permissions are required such that the katib-controller can launch argo workflows.
Vito Zanotelli committedJul 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 15c4a4b - Browse repository at this point
Copy the full SHA 15c4a4bView commit details -
Remove accidentally included
self
Vito Zanotelli committedJul 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 741059f - Browse repository at this point
Copy the full SHA 741059fView commit details -
Rename paramater to more meaningful name
Vito Zanotelli committedJul 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 7d33b7b - Browse repository at this point
Copy the full SHA 7d33b7bView commit details
Commits on Jul 20, 2023
-
Extend example notebook with simple example for e2e tests
This adds a dummy e2e example that can be used to test the main functionality.
Vito Zanotelli committedJul 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 35df815 - Browse repository at this point
Copy the full SHA 35df815View commit details -
Revert "TMP: changes to run tests locally"
This reverts commit 36ed372.
Vito Zanotelli committedJul 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 0504085 - Browse repository at this point
Copy the full SHA 0504085View commit details -
Adds spec of a simple kfp1+katib experiment spec
This could be used for e2e testing
Vito Zanotelli committedJul 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 4cddd3e - Browse repository at this point
Copy the full SHA 4cddd3eView commit details
Commits on Jul 21, 2023
-
Update psutil version to fix Docker build error
Vito Zanotelli committedJul 21, 2023 Configuration menu - View commit details
-
Copy full SHA for 6a0bdd3 - Browse repository at this point
Copy the full SHA 6a0bdd3View commit details
Commits on Sep 12, 2023
-
Move kubeflow installation after katib
Otherwise the patching of the `katib-controller` cluster role would not work.
pre-commit fix Vito Zanotelli committedSep 12, 2023 Configuration menu - View commit details
-
Copy full SHA for 182b787 - Browse repository at this point
Copy the full SHA 182b787View commit details -
This enables the user to set th version of the KFP version which should be useful to use this script to install KFP v1 and v2 without additional parameters.
pre-commit fix Vito Zanotelli committedSep 12, 2023 Configuration menu - View commit details
-
Copy full SHA for 9fc7c02 - Browse repository at this point
Copy the full SHA 9fc7c02View commit details -
This is required for kubeflow pipelines as I found no easy way to install kubeflow pipelines into the `default` workspace that was previously the hardcoded one. Now the namespace can be passed as a parameter.
pre-commit fix Vito Zanotelli committedSep 12, 2023 Configuration menu - View commit details
-
Copy full SHA for 579546c - Browse repository at this point
Copy the full SHA 579546cView commit details
Commits on Oct 21, 2023
-
This action should now run the kubeflow pipeline v1 e2e example. This required the extension of the `template-e2e-test` to include parameters to a) install kfp b) select the `kubeflow` namespace (instead of default) to run the tests with.
pre-commit fix Vito Zanotelli committedOct 21, 2023 Configuration menu - View commit details
-
Copy full SHA for 582a6a7 - Browse repository at this point
Copy the full SHA 582a6a7View commit details