allow to set arbitrary models
We now initialize a model configuration even if we have no info in model.json using some default values for the token limits.
Models can implement the loadUnkonwModelI
allow to set arbitrary models
We now initialize a model configuration even if we have no info in model.json using some default values for the token limits.
Models can implement the loadUnkonwModelInfo() method to fetch the info from an API if such a thing exist. Implemented for gemini and ollama currently.
show more ...
|