Deploy a chatbot with Huggingface Inference API

This repository contains the code to deploy a Mistral-based chatbot using Docker Compose and Huggingface Inference API.

Technological stack

As shown in the figure below the following frameworks have been used in this project:

git clone https://github.com/robertanto/local-chatbot-ui.git
cd local-chatbot-ui

Create a Huggingface API token as shown here and insert it in the docker-compose.yaml file.
Run the containers

docker compose up -d

You can interact with the chatbot at http://localhost:7860/.

Name	Name	Last commit message	Last commit date
Latest commit History 3 Commits
GradioUI	GradioUI
HFInferenceAPI	HFInferenceAPI
assets	assets
.gitignore	.gitignore
README.md	README.md
docker-compose.yaml	docker-compose.yaml