Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multiple context layers per model #76

Closed
wants to merge 39 commits into from
Closed

Multiple context layers per model #76

wants to merge 39 commits into from

Commits on Jul 28, 2023

  1. Move response generation from Hub to Service

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    e7c1295 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into Multi_Context

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    ecc8499 View commit details
    Browse the repository at this point in the history

  3. Rename LLamaModel to LLamaModelContext

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    faacd26 View commit details
    Browse the repository at this point in the history

  4. Separate Model and Context

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    fba0527 View commit details
    Browse the repository at this point in the history

  5. Add simple model cache to allow simple, multiple context

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    db94e4e View commit details
    Browse the repository at this point in the history

  6. Apply Lora to cached model

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    695b17a View commit details
    Browse the repository at this point in the history

  7. Remove model cache, should be at a higher level

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    a95e69b View commit details
    Browse the repository at this point in the history

  8. Move model cache to higher level, typo

    @saddam213
    saddam213 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    6cc0e3d View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. Added GH action for some simple CI

    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    20c7b27 View commit details
    Browse the repository at this point in the history

  2. fixed capitalisation

    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    4ddb37f View commit details
    Browse the repository at this point in the history

  3. Added queue fix, so that CI can pass

    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    de0551e View commit details
    Browse the repository at this point in the history

  4. - moved dotnet version into matrix 

     - using 6.0.x instead of 7.0.x
    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    c37dc85 View commit details
    Browse the repository at this point in the history

  5. Always installing both 6 and 7

    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    85c7537 View commit details
    Browse the repository at this point in the history

  6. Cleaned up installing multiple dotnets

    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    68fa27e View commit details
    Browse the repository at this point in the history

  7. Fixed yaml syntax

    @martindevans
    martindevans committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    0591897 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2023

  1. Improved formatting of response

    @saddam213
    saddam213 committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    c62141b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/SciSharp/LLamaSharp

    @saddam213
    saddam213 committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    13c015b View commit details
    Browse the repository at this point in the history

  3. - Added a folder with a 7B Llama2 model, automatically downloaded fro… 

    …m huggingface. This can be used for unit tests.

 - Caching that folder, so CI only has to download it once.
    @martindevans
    martindevans committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    8b42d06 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Update ModelParams

    @saddam213
    saddam213 committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    5bab47b View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Merge branch 'master' into Web_Interface_Settings

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    286bd82 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SplitModelContext

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    85b7e60 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'github_actions' of https://github.com/martindevans/LLam… 

    …aSharp
    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    22cdd0f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into SplitModelContext

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    47f33fc View commit details
    Browse the repository at this point in the history

  5. Merge branch 'SplitModelContext' into Web_Interface_Settings

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    05ea664 View commit details
    Browse the repository at this point in the history

  6. Inject ModelCacheService

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    60f5ca5 View commit details
    Browse the repository at this point in the history

  7. LLamaModel to track LLamaModelContext instances

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    b8bb5ae View commit details
    Browse the repository at this point in the history

  8. Async ModelCacheService

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    362812e View commit details
    Browse the repository at this point in the history

  9. Fix incorrect docs

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    87fdd45 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'SplitModelContext' into Web_Interface_Settings

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    c310400 View commit details
    Browse the repository at this point in the history

  11. Create sessions with live parameters

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    fc5bd43 View commit details
    Browse the repository at this point in the history

  12. ModelParams & InferenceParams abstractions

    @saddam213
    saddam213 committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    b94d6a6 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Simplify Web interface

    @saddam213
    saddam213 committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    ed47e37 View commit details
    Browse the repository at this point in the history

  2. Update README, quick tidy up

    @saddam213
    saddam213 committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0f8c541 View commit details
    Browse the repository at this point in the history

  3. Add Web UI to README

    @saddam213
    saddam213 committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    b3168b8 View commit details
    Browse the repository at this point in the history

  4. Update CPU and CUDA_12 binaries

    @saddam213
    saddam213 committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    c3a25fc View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2023

  1. Merge branch 'master' of https://github.com/SciSharp/LLamaSharp 

    # Conflicts:
#	LLama/Common/InferenceParams.cs
#	LLama/LLamaExecutorBase.cs
#	LLama/LLamaInstructExecutor.cs
#	LLama/LLamaInteractExecutor.cs
#	LLama/LLamaModel.cs
    @saddam213
    saddam213 committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    864f2f7 View commit details
    Browse the repository at this point in the history

  2. Update README example to new implementation

    @saddam213
    saddam213 committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    c0235eb View commit details
    Browse the repository at this point in the history

  3. Latest linux binary

    @saddam213
    saddam213 committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    bca736f View commit details
    Browse the repository at this point in the history

  4. Manually marshal tensor_split for cross platform support

    @saddam213
    saddam213 committed Aug 5, 2023
    Configuration menu
    Copy the full SHA
    2b5efa0 View commit details
    Browse the repository at this point in the history