🩺 FAST MEDICAL Chatbot

Get Answers in Seconds

This repository contains a medical chatbot powered by the Medical-Llama3-8B model. The chatbot is designed to assist users with medical queries using a conversational retrieval chain.

Features

• Utilizes the Medical-Llama3-8B model for medical information.
• Incorporates document embeddings and a vector store for improved information retrieval.
• Provides a user-friendly interface with Gradio.
• Customizable model parameters through the Gradio interface.

Setup

Prerequisites

• Python 3.7 or higher
• CUDA-compatible GPU (for running the model efficiently)

Installation

1. Clone the repository:

   git clone https://github.com/EchoSingh/medical-chatbot.git
   cd medical-chatbot

2. Install the required packages:

   pip install -r requirements.txt

3. Install the bitsandbytes, transformers, and accelerate packages:

   pip install --upgrade bitsandbytes transformers accelerate -i https://pypi.org/simple/

Using the Model

`Biomistral'.

Usage

1. Run the Jupyter cell code.

2. Open the provided link to access the Gradio interface.

Example Usage

Here's an example of how to use the chatbot:

• Type your question in the provided textbox.
• Adjust the parameters like Max New Tokens, Temperature, and Context Length as needed.
• Get the response from the chatbot displayed in a scrollable box.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgments

• The Biomistral
• Gradio for providing a user-friendly interface for machine learning models