Skip to content

Commit

Permalink
Merge branch 'nomic-ai:main' into main
Browse files Browse the repository at this point in the history
  • Loading branch information
abdulrahman305 authored Sep 6, 2023
2 parents 1400c06 + b6e38d6 commit a04306e
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 3 deletions.
9 changes: 9 additions & 0 deletions gpt4all-bindings/python/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,15 @@ output = model.generate("The capital of France is ", max_tokens=3)
print(output)
```


GPU Usage
```python
from gpt4all import GPT4All
model = GPT4All("orca-mini-3b.ggmlv3.q4_0.bin", device='gpu') # device='amd', device='intel'
output = model.generate("The capital of France is ", max_tokens=3)
print(output)
```

## Troubleshooting a Local Build
- If you're on Windows and have compiled with a MinGW toolchain, you might run into an error like:
```
Expand Down
6 changes: 3 additions & 3 deletions gpt4all-bindings/python/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -61,10 +61,10 @@ def copy_prebuilt_C_lib(src_dir, dest_dir, dest_build_dir):

setup(
name=package_name,
version="1.0.8",
version="1.0.9",
description="Python bindings for GPT4All",
author="Richard Guo",
author_email="richard@nomic.ai",
author="Nomic and the Open Source Community",
author_email="support@nomic.ai",
url="https://pypi.org/project/gpt4all/",
classifiers = [
"Programming Language :: Python :: 3",
Expand Down

0 comments on commit a04306e

Please sign in to comment.