Back

Building customer support ai ! is this good idea or not ?

You can't reduce the gpt api cost by any chance, it is set by companies who make api. you can't do anything about it

as i am an ai student we host and qunatize variouss models ! smaller models can be used to reduce overall cost 100x

like you are talking about open source models. then it is possible. my mistake then

yup ! you can get more into it by searching quantizing gwen llama etc llama.cpp etc