Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fix: check for tokenizer eos_token in ModelInfo response (IBM#93)
Use consistent logic to determine the eos_token_id in ModelInfo as it is in other functions by falling back to the tokenizer's `eos_token_id` attribute if the model config does not have an `eos_token_id`. Fixes the behavior for a model that does not have an eos_token_id in the model config Resolves IBM#91 Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
- Loading branch information