From b64c8e17969c99b5c07342005186d8d6dc08e591 Mon Sep 17 00:00:00 2001 From: dhruvesht Date: Thu, 30 Jan 2020 11:23:54 -0800 Subject: [PATCH] TFX 0.21.0 Release PiperOrigin-RevId: 292388239 --- README.md | 1 + RELEASE.md | 35 +++++++++---------- tfx/dependencies.py | 2 +- .../testdata/test_dockerfile | 2 +- tfx/version.py | 2 +- 5 files changed, 20 insertions(+), 22 deletions(-) diff --git a/README.md b/README.md index aefbcbef9d..fd8f5c618d 100644 --- a/README.md +++ b/README.md @@ -59,6 +59,7 @@ but other *untested* combinations may also work. tfx | tensorflow | tensorflow-data-validation | tensorflow-model-analysis | tensorflow-metadata | tensorflow-transform | ml-metadata | apache-beam[gcp] | pyarrow | tfx-bsl | ----------------------------------------------------------------------------------- | ------------------- | -------------------------- | ------------------------- | ------------------- | -------------------- | ----------- | -----------------| ------- | ------- | [GitHub master](https://github.com/tensorflow/tfx/blob/master/RELEASE.md) | nightly (1.x / 2.1) | 0.21.0 | 0.21.0 | 0.21.0 | 0.21.0 | 0.21.0 | 2.17.0 | 0.15.0 | 0.21.0 | +0.21.0 | 1.15.0 / 2.1 | 0.21.0 | 0.21.1 | 0.21.0 | 0.21.0 | 0.21.0 | 2.17.0 | 0.15.0 | 0.21.0 | 0.15.0 | 1.15.0 / 2.0.0 | 0.15.0 | 0.15.2 | 0.15.0 | 0.15.0 | 0.15.0 | 2.16.0 | 0.14.0 | 0.15.1 | 0.14.0 | 1.14.0 | 0.14.1 | 0.14.0 | 0.14.0 | 0.14.0 | 0.14.0 | 2.14.0 | 0.14.0 | n/a | 0.13.0 | 1.13.1 | 0.13.1 | 0.13.2 | 0.13.0 | 0.13.0 | 0.13.2 | 2.12.0 | n/a | n/a | diff --git a/RELEASE.md b/RELEASE.md index 5cfd42ef94..b6594cc43d 100644 --- a/RELEASE.md +++ b/RELEASE.md @@ -14,7 +14,7 @@ ## Documentation updates -# Version 0.21.0 (not yet released; still in development) +# Version 0.21.0 ## Major Features and Improvements @@ -39,12 +39,8 @@ * Artifact type-specific properties can be defined through overriding the `PROPERTIES` dictionary of a `types.artifact.Artifact` subclass. * Added new example of chicago_taxi_pipeline on Google Cloud Bigquery ML. -* Added support for an hparams artifact as an input to Trainer in - preparation for tuner support. * Added support for multi-core processing in the Flink and Spark Chicago Taxi PortableRunner example. -* Changed `BaseComponentLauncher` to require the user to pass in an ML - Metadata connection object instead of a ML Metadata connection config. * Added a metadata adapter in Kubeflow to support logging the Argo pod ID as an execution property. * Added a prototype Tuner component and an end-to-end iris example. @@ -55,6 +51,8 @@ `template`. ## Bug fixes and other changes +* Added support for an hparams artifact as an input to Trainer in + preparation for tuner support. * Refactored common dependencies in the TFX dockerfile to a base image to improve the reliability of image building process. * Fixes missing Tensorboard link in KubeflowDagRunner. @@ -92,6 +90,8 @@ publishing. * Added pipeline level context and component run level context. * Included test data for examples/chicago_taxi_pipeline in package. +* Changed `BaseComponentLauncher` to require the user to pass in an ML + Metadata connection object instead of a ML Metadata connection config. * Capped version of Tensorflow runtime used in Google Cloud integration to 1.15. * Updated Chicago Taxi example dependencies to Beam 2.17.0, Flink 1.9.1, Spark @@ -99,33 +99,30 @@ * Fixed an issue where `build_ephemeral_package()` used an incorrect path to locate the `tfx` directory. * The ImporterNode now allows specification of general artifact properties. +* Added 'tfx_executor', 'tfx_version' and 'tfx_py_version' labels for CAIP, + BQML and Dataflow jobs submitted from TFX components. ### Deprecations ## Breaking changes -* Artifact type name strings to the `types.artifact.Artifact` and - `types.channel.Channel` classes are no longer supported; usage here should - be replaced with references to the artifact subclasses defined in - `types.standard_artfacts.*` or to custom subclasses of - `types.artifact.Artifact`. + +### For pipeline authors * Standard artifact TYPE_NAME strings were reconciled to match their class names in `types.standard_artifacts`. * The "split" property on multiple artifacts has been replaced with the JSON-encoded "split_names" property on a single grouped artifact. -* When custom executors are created for the ExampleGen, Pusher and Trainer - components, instead of accessing entries in `input_dict` and `output_dict` - with hard-coded string keys (e.g. `'model'`, `'examples'`, etc.), these - executors should use the new `*_KEY` properties defined in the base - executor's module file (e.g. `MODEL_KEY`, `EXAMPLES_KEY`, etc.). * The execution caching mechanism was changed to rely on ML Metadata pipeline context. Existing cached executions will not be reused when running on this version of TFX for the first time. -* Added 'tfx_executor', 'tfx_version' and 'tfx_py_version' labels for CAIP, - BQML and Dataflow jobs submitted from TFX components. - -### For pipeline authors +* The "split" property on multiple artifacts has been replaced with the + JSON-encoded "split_names" property on a single grouped artifact. ### For component authors +* Artifact type name strings to the `types.artifact.Artifact` and + `types.channel.Channel` classes are no longer supported; usage here should + be replaced with references to the artifact subclasses defined in + `types.standard_artfacts.*` or to custom subclasses of + `types.artifact.Artifact`. ## Documentation updates diff --git a/tfx/dependencies.py b/tfx/dependencies.py index 44370d753f..160bf4cf6e 100644 --- a/tfx/dependencies.py +++ b/tfx/dependencies.py @@ -37,7 +37,7 @@ def make_required_install_packages(): 'six>=1.10,<2', 'tensorflow>=1.15,<3', 'tensorflow-data-validation>=0.21,<0.22', - 'tensorflow-model-analysis>=0.21,<0.22', + 'tensorflow-model-analysis>=0.21.1,<0.22', 'tensorflow-serving-api>=1.15,<3', 'tensorflow-transform>=0.21,<0.22', 'tfx-bsl>=0.21,<0.22', diff --git a/tfx/tools/cli/container_builder/testdata/test_dockerfile b/tfx/tools/cli/container_builder/testdata/test_dockerfile index 341f2cfdcc..3fedc49acc 100644 --- a/tfx/tools/cli/container_builder/testdata/test_dockerfile +++ b/tfx/tools/cli/container_builder/testdata/test_dockerfile @@ -1,4 +1,4 @@ -FROM tensorflow/tfx:0.21.0.dev +FROM tensorflow/tfx:0.22.0.dev WORKDIR /pipeline COPY ./ ./ ENV PYTHONPATH="/pipeline:${PYTHONPATH}" \ No newline at end of file diff --git a/tfx/version.py b/tfx/version.py index b076c71543..51aa7feedd 100644 --- a/tfx/version.py +++ b/tfx/version.py @@ -15,4 +15,4 @@ """Contains the version string of TFX.""" # Note that setup.py uses this version. -__version__ = '0.21.0.dev' +__version__ = '0.22.0.dev'