From 4c80b40870780c2b34ce2dfe3694a9216fb1fb16 Mon Sep 17 00:00:00 2001 From: Yaohui Liu Date: Wed, 25 Oct 2023 01:45:54 +0800 Subject: [PATCH] docs: update the readme. --- README.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index ed099a138..01274c479 100644 --- a/README.md +++ b/README.md @@ -8,6 +8,8 @@ [![LLamaSharp Badge](https://img.shields.io/nuget/v/LLamaSharp.Backend.Cpu?label=LLamaSharp.Backend.Cpu)](https://www.nuget.org/packages/LLamaSharp.Backend.Cpu) [![LLamaSharp Badge](https://img.shields.io/nuget/v/LLamaSharp.Backend.Cuda11?label=LLamaSharp.Backend.Cuda11)](https://www.nuget.org/packages/LLamaSharp.Backend.Cuda11) [![LLamaSharp Badge](https://img.shields.io/nuget/v/LLamaSharp.Backend.Cuda12?label=LLamaSharp.Backend.Cuda12)](https://www.nuget.org/packages/LLamaSharp.Backend.Cuda12) +[![LLamaSharp Badge](https://img.shields.io/nuget/v/LLamaSharp.Backend.MacMetal?label=LLamaSharp.Backend.MacMetal)](https://www.nuget.org/packages/LLamaSharp.Backend.MacMetal) +[![LLamaSharp Badge](https://img.shields.io/nuget/v/LLamaSharp.semantic-kernel?label=LLamaSharp.semantic-kernel)](https://www.nuget.org/packages/LLamaSharp.semantic-kernel) **The C#/.NET binding of [llama.cpp](https://github.com/ggerganov/llama.cpp). It provides APIs to inference the LLaMa Models and deploy it on local environment. It works on @@ -35,10 +37,10 @@ PM> Install-Package LLamaSharp Then, search and install one of the following backends: ``` -LLamaSharp.Backend.Cpu # cpu for windows, linux and mac +LLamaSharp.Backend.Cpu # cpu for windows, linux and mac (mac metal is also supported) LLamaSharp.Backend.Cuda11 # cuda11 for windows and linux LLamaSharp.Backend.Cuda12 # cuda12 for windows and linux -LLamaSharp.Backend.MacMetal # metal for mac +LLamaSharp.Backend.MacMetal # special for using mac metal ``` If you would like to use it with [microsoft semantic-kernel](https://github.com/microsoft/semantic-kernel), please search and install the following package: @@ -162,6 +164,8 @@ Since we are in short of hands, if you're familiar with ASP.NET core, we'll appr ✅ Quantization +✅ Grammar + ✅ State saving and loading ⚠️ BotSharp Integration