#%env/templates/metas.template%# #%env/templates/header.template%# #%env/templates/submenuIndexImport.template%#

LLM Selection

Here you can pick models from a LLM model provider to select them as production model. In the "Production Models" - Matrix you can then assign each selected model a function inside YaCy

Install your local LLM provider! You need either a local ollama or LM Studio instance running on your local host or inside the intranet.

Provider
Select a LLM Provider
  This makes a preset to the Hoststub value
Hoststub
  you can probably leave this to the default value
API Key
  (not required for Ollama or LMStudio)
Max Token
  You must set the Context Length in the LLM provider to fit to your selected max token; in Ollama you find a Context Length slider in the settings
 
Production Models #{productionmodels}# #{/productionmodels}#
ProviderModelhoststubAPI KeyMax TokenAnswersChatTranslationQ/A-GenerationClassificationShortenerVisionActions
#[model]##[type]##[size]##[apikey]##[max_token]##[answers]##[chat]##[translation]##[qageneration]##[classification]##[shortener]##[vision]#
#%env/templates/footer.template%#