Releases: DeepRec-AI/serving
Releases · DeepRec-AI/serving
r1.15.5-deeprec2310
Major Features and Improvements
Build
- Upgrade DeepRec version to r1.15.5-deeprec2310.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2306
Major Features and Improvements
Features and Improvements
- Fix aarch64 gcc11 build failure.
- Fix build break which caused by patch file.
- Update Serving README.md.
Build
- Upgrade DeepRec version to r1.15.5-deeprec2306.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2304
Major Features and Improvements
Features and Improvements
- Add flag for device_placement_optimization.
- Enable INFERENCE_MODE=1 in serving.
Build
- Upgrade DeepRec version to r1.15.5-deeprec2304.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2302
Major Features and Improvements
Features and Improvements
- Support user setup cpusets for each session_group.
- Support session_group to use multiple GPUs.
- Support to collect timeline in Serving.
- Set graph signature to speed up getting executor in session.
Build
- Upgrade DeepRec version to r1.15.5-deeprec2302.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2212u1
Major Features and Improvements
Build
- Upgrade DeepRec version to r1.15.5-deeprec2212u1.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2212
Major Features and Improvements
SessionGroup
- Support GetModelMetadata request in session_group.
- Support multi-model deployment in SessionGroup.
Build
- Upgrade DeepRec version to r1.15.5-deeprec2212.
- Upgrade base docker images based on ubuntu20.04 and python3.8.10.
More details of features: [https://deeprec.rtfd.io](https://deeprec.rtfd.io]%28url%29/)
r1.15.5-deeprec2210
Major Features and Improvements
BugFix
- Fix warmup failed bug when use session_group.
Build
- Upgrade DeepRec version to r1.15.5-deeprec2210.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2208u1
Major Features and Improvements
Build
- Upgrade DeepRec version to r1.15.5-deeprec2208u1.
BugFix
- Fix warmup failed bug when use session_group.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2208
Major Features and Improvements
Performance Improvements
- Support GPU multi-stream in SessionGroup.
- Support independent inter thread pool for each session in SessionGroup. (commit in DeepRec)
- Support multi-tiered Embedding. (commit in DeepRec)
- Support immutable EmbeddingVariable. (commit in DeepRec)
Build
- Upgrade DeepRec version to r1.15.5-deeprec2208.
- Upgrade base GPU docker image, support cuda11.6.
More details of features: https://deeprec.rtfd.io
r1.15.5-deeprec2206u1
Major Features and Improvements
Build
- Upgrade DeepRec version to r1.15.5-deeprec2206u1.
BugFix
- Add boost and AWS dependency to avoid build error.
More details of features: https://deeprec.rtfd.io