LLM Selection

Here you can pick models from a LLM model service to select them as production model. In the "Production Models" - Matrix you can then assign each selected model a function inside YaCy

Install your local LLM service! You need either a local ollama or LM Studio instance running on your local host or inside the intranet.

Production Models

#{productionmodels}# #{/productionmodels}#

service	model	hoststub	api_key	max_tokens	search-answers This model creates answers for search requests	chat This model is used in the chat interface and as default for the RAG proxy	translation This model can be used to make translations of the web UI	classification This model is used to classify prompts to find out what they demand	search-query This model produces search queries to YaCy search from prompts in RAG or chat	qa-pairs This model can be used to produce query-answer pairs which enhance search from chat prompts	tldr-shortener This model is used to make summaries from web content	tooling	vision	Actions
#[service]#	#[model]#	#[hoststub]#	#[api_key]#	#[max_tokens]#