22 Commits

Author SHA1 Message Date
Juan Calderon-Perez
12ec7b7f42
Support for DragonflyDB (#598) 2023-08-06 22:54:42 -04:00
Juan Calderon-Perez
b1fb7009e7
Updates to README.md (#414) 2023-06-11 16:36:28 -04:00
Nathan Sarrazin
e512011470
Use python bindings, integrate with LangChain and get rid of MongoDB (#148)
* integrate langchain
get rid of mongodb
use llama-cpp-python bindings

* fixed most chat endpoints except posting questions

* Working post endpoint !

* everything works except streaming

* current state

* streaming as is

* got rid of langchain wrapper for calling llm, went back to using bindings directly

* working streaming

* sort chats by time

* cleaned up styling and added back loading indicator

* Add persistence support to redis

* fixed tooltips

* fixed default prompts

* added link to api docs (closes How to use the api #155 )
2023-04-23 23:42:20 +02:00
Juan Calderon-Perez
6801ef86d2
Bug fixes and improvements (#202)
* Bug fixes and improvements

* Simplify Dockerfile

* Update docker-compose.yml

* Update llama.cpp tag
2023-04-21 18:30:31 -04:00
Nathan Sarrazin
293a23e487
Proper dev & deployment images. Converts front-end to SPA. (#84)
* begin work on dev environment

* more work on dev image

* working dev + prod images with SPA front-end

* reworked dockerfile

* make CI point to the right action

* Improvements to github actions (#79)

* Improvements to github actions

* Change username to repo owner username

* Add fix for login into ghcr (#81)

* Update bug_report.yml

* added dev instructions to readme

* reduced number of steps in dockerfile

---------

Co-authored-by: Juan Calderon-Perez <835733+gaby@users.noreply.github.com>
2023-03-27 16:44:20 +02:00
Nathan Sarrazin
d697059122
Move everything into a single dockerfile (#57)
* initial work on linting & templates

* moved everyone into a nice dockerfile

* move everyone into a single dockerfile

* update sample .env file

* got rid of .env file

* rename db volume to avoid confusion and conflicts with previous version

* added bug report template
2023-03-25 11:55:01 +01:00
Maël Acier
26054f41d1
Move nginx proxy to vite (#51) 2023-03-24 19:45:05 +01:00
Nathan Sarrazin
ba2661a3eb Remove an exposed port that wasn't supposed to be exposed 2023-03-23 22:47:24 +01:00
Nathan Sarrazin
aa257db1e7
make nginx more resilient so you can start the api without the webapp (#37) 2023-03-23 21:48:16 +01:00
Nathan Sarrazin
2a615c70db Move the weightts to their own volume 2023-03-23 19:07:18 +01:00
Nathan Sarrazin
943dcf818f fix versions throughout the app 2023-03-23 18:41:16 +01:00
Nathan Sarrazin
a1cc66a1ca Make it easier to get started 2023-03-22 18:15:51 +01:00
Nathan Sarrazin
b824261bbb Changed mongodb to be compatible with apple silicon 2023-03-22 15:33:17 +01:00
Nathan Sarrazin
a0b1f939d7 cleaned up config stuff & readme 2023-03-21 16:57:34 +01:00
Nathan Sarrazin
a13eeadaed Latest changes:
- Added nginx, api & web app on the same port now.
- Allowed CSR, through sveltekit, with a hook for redirecting server side api requests.
- Implemented menu to  pass model parameters on start page.
- Added a loading indicator while the model is computing
2023-03-21 07:11:00 +01:00
Nathan Sarrazin
4dfa4c92c0 Added localtime volume 2023-03-21 00:11:41 +01:00
Nathan Sarrazin
15e921fb7a Used recent llama.cpp version :
- Added convert script, thanks to @eiz, will catch unconverted .bin files and convert them on startup.
- Switched back to main branch of llama.cpp
- Got rid of code to handle magic.dat
2023-03-20 17:45:47 +01:00
Nathan Sarrazin
afde8eca25 Made ports configurable 2023-03-19 19:49:21 +01:00
Nathan Sarrazin
523d0f82a2 Added a basic sveltekit + tailwind project in the project 2023-03-19 19:43:09 +01:00
Nathan Sarrazin
aabddab986 Added a proper db to store chats, as well as API endpoints 2023-03-19 18:13:27 +01:00
Nathan Sarrazin
286d8f988f renamed weights to models 2023-03-19 12:16:07 +01:00
Nathan Sarrazin
2ae699b0c6 basic working version 2023-03-19 12:09:15 +01:00