જોડાવા બોટ કાવ્ય માતાનો જીવનસાથી અને સંલગ્ન કાર્યક્રમ અને આધાર આપે છે અમારા મફત ઓપન પ્લેટફોર્મ
Self, AIML, and scripting

implementation of local LLM on local install of Bot Libre Community Edition.

દ્વારા invzame પોસ્ટ May 29 2023, 14:50

I have a local install of CE installed on docker. Its running great with no issues. My question is, in SELF, is there any way I can integrate a locally running LLM running on PyTorch to my bot? Another idea I had was to also try and make an inference API call on one of the pretrained models on huggingface and I haven't been able to get that to work either. I'm new to self and I'm kind of scratching my head with this problem. 


by admin posted May 30 2023, 8:18
You will need to create a web API to expose your Python API such as using the Flask Python web server.
You can then call the web API from Self.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 628, today: 2, week: 6, month: 10

ને: 47685232
પોસ્ટ: May 29 2023, 14:50
જવાબો: 1
જોવાઈ: 655, આજે: 1, સપ્તાહ: 5, મહિને: 11
0 0 0.0/5