Commit History

remove doublons from pkg list
be3d296

Luigi commited on

merge packages.txt content into dockerfile then make it also use reuirements.txt
35aa7f2

Luigi commited on

add pkg-config
fc5d28f

Luigi commited on

update dockerfile
7875635

Luigi commited on

back to base on hf spaces official image
9b52ba8

Luigi commited on

update dockerfile
47daff0

Luigi commited on

update dockerfile and app.py
957ece1

Luigi commited on

add workaround in ensure_weights to deal with persmission error
08f659b

Luigi commited on

2nd fix
4b95538

Luigi commited on

fix pernission error
f7d60e0

Luigi commited on

update dockerfile for llama cpp python build
b09681e

Luigi commited on

update dockerfile
0b421c7

Luigi commited on

update dockerfile
44456ef

Luigi commited on

switch base image
1f5e5bf

Luigi commited on

update dockerfile
ac3191a

Luigi commited on

update dockerfile
ebab252

Luigi commited on

Update README.md
c725424
verified

Luigi commited on

add dockerfile
29d31e5

Luigi commited on

Add executable postBuild hook
06475ce

Luigi commited on

debug: force source build of llama-cpp-python
5867880

Luigi commited on

specify a openblas llama cpp build
02e777b

Luigi commited on

reduce n_ctx to 512
1aba000

Luigi commited on

fix imencode call
cc08312

Luigi commited on

default to smallest model with q8 prcision, enable verbose mode, disable reset clip
65efb90

Luigi commited on

fix imencode
3be8e88

Luigi commited on

reduce jpg quality for smaller image footprint
4e5fc85

Luigi commited on

show llama cpp version
9069c3e

Luigi commited on

inject verbose message to debug window
69c8775

Luigi commited on

add vebose mode switch
2881733

Luigi commited on

increase n_ctx to 8192
4decc4b

Luigi commited on

add ui component to allow user enabl or disable reset_clip per frame
5462ff3

Luigi commited on

add debug to show which weight files we’re using this run
a459bee

Luigi commited on

use all cpu cores
be5c239

Luigi commited on

show cpu count in debug message
b56b6ec

Luigi commited on

add q2_k precsion weights
07f3263

Luigi commited on

add rich debug message and dedicated display ui
34cd1e5

Luigi commited on

apply in-memory encoding instead of temp files
45c2159

Luigi commited on

avoid memory leak
238a95a

Luigi commited on

use more thread for inference
bd12f6b

Luigi commited on

remove interval ui doublon
bdd1478

Luigi commited on

bugifx on ui about model selection
e1ad065

Luigi commited on

increase interval default to 3s
c9c43a8

Luigi commited on

1. add more models,
5c50991

Luigi commited on

reduce ctx and max tokens for performance
76a0b57

Luigi commited on

minor update then add todos
65b3c3a

Luigi commited on

resize frame to 384 x384 resolution
c1d8038

Luigi commited on

add debug messages
36dacc6

Luigi commited on

Update README.md
d05da82
verified

Luigi commited on

Update README.md
5234d12
verified

Luigi commited on

switch to gradio implementation as streamlit + webrtc requires turn server
970f416

Luigi commited on