You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
what do I do after install the open assistant from git hub? #3676
The docs detail how you can setup and start backend on your local PC
Create a venv
Clone the repo and install the required libraries as guided in the backend readme file
Make sure you have postgres and redis running
Start the backend server using the script inside the backend directory
( Again, instructions in the readme file of the backend directory)
Check documentation in your local machine at localhost:8080/docs
The docs detail how you can setup and start backend on your local PC
Create a venv Clone the repo and install the required libraries as guided in the backend readme file Make sure you have postgres and redis running Start the backend server using the script inside the backend directory ( Again, instructions in the readme file of the backend directory)
Check documentation in your local machine at localhost:8080/docs
So I just follow the instruction on the redme in the backend?
If you want to run models locally I recommend https://gpt4all.io/
Its for language models that are optimized for consumer hardware and it is easy to use.
Activity
drShivashankar commentedon Aug 31, 2023
What do you want to work on?
Backend
Inference or
Frontend
CT1800098 commentedon Aug 31, 2023
what is the differece between them?
CT1800098 commentedon Aug 31, 2023
I sort of want to do what the web version does
drShivashankar commentedon Aug 31, 2023
The docs detail how you can setup and start backend on your local PC
Create a venv
Clone the repo and install the required libraries as guided in the backend readme file
Make sure you have postgres and redis running
Start the backend server using the script inside the backend directory
( Again, instructions in the readme file of the backend directory)
Check documentation in your local machine at localhost:8080/docs
CT1800098 commentedon Aug 31, 2023
stefangrotz commentedon Aug 31, 2023
A small remark: unless you have a very powerful GPU you will be only able to run the website locally, but not the chat (=Inference).
drShivashankar commentedon Aug 31, 2023
Backend is to work on the open assistant web backend
Front is to improve the UI for the same web
Inference is to work on the LLMs
CT1800098 commentedon Aug 31, 2023
how many VRM do I need?
CT1800098 commentedon Aug 31, 2023
what is LLM?
drShivashankar commentedon Aug 31, 2023
The chat itself
Large language models
They have so many parameters you need more hardware like @stefangrotz said
CT1800098 commentedon Aug 31, 2023
how many VRM do I need to run?
stefangrotz commentedon Aug 31, 2023
For the 70b model you'll need 48GB VRAM.
If you want to run models locally I recommend https://gpt4all.io/
Its for language models that are optimized for consumer hardware and it is easy to use.
CT1800098 commentedon Aug 31, 2023
is it censored or uncensored?