Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi Context #90

Merged
merged 13 commits into from
Aug 17, 2023
Merged

Multi Context #90

merged 13 commits into from
Aug 17, 2023

Commits on Aug 13, 2023

  1. WIP demonstrating changes to support multi-context. You can see this … 

    …in use in `TalkToYourself`, along with notes on what still needs improving.

The biggest single change is renaming `LLamaModel` to `LLamaContext`
    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    f3511e3 View commit details
    Browse the repository at this point in the history

  2. Using the right context for Bob

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    f31bdf6 View commit details
    Browse the repository at this point in the history

  3. Fixed mirostat/mirostate

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    fda7e1c View commit details
    Browse the repository at this point in the history

  4. Added a higher level LLamaWeights wrapper around `SafeLlamaModelHan… 

    …dle`
    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    e2fe08a View commit details
    Browse the repository at this point in the history

  5. - Apply LoRA in LLamaWeights.LoadFromFile 

     - Sanity checking that weights are not disposed when creating a context from them
 - Further simplified `Utils.InitLLamaContextFromModelParams`
    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    20bdc2e View commit details
    Browse the repository at this point in the history

  6. Marked old LLamaContext constructor obsolete

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    4d741d2 View commit details
    Browse the repository at this point in the history

  7. - Cleaned up disposal in LLamaContext 

     - sealed some classes not intended to be extended
    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    d0a7a8f View commit details
    Browse the repository at this point in the history

  8. Renamed EmbeddingCount to EmbeddingSize

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    479ff57 View commit details
    Browse the repository at this point in the history

  9. Renamed EmbeddingCount to EmbeddingSize in higher level class

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    f5a2609 View commit details
    Browse the repository at this point in the history

  10. Added some additional basic tests

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    1b35be2 View commit details
    Browse the repository at this point in the history

  11. Temporarily added a Console.WriteLine into the test, to print the e… 

    …mbedding vector for "cat" in CI
    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    6473f8d View commit details
    Browse the repository at this point in the history

  12. Removed Console.WriteLine

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    aeb7943 View commit details
    Browse the repository at this point in the history

  13. Removed embedding test, moved to another PR

    @martindevans
    martindevans committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    76d991f View commit details
    Browse the repository at this point in the history