| #
7be8078e |
| 15-Apr-2025 |
Andreas Gohr <andi@splitbrain.org> |
allow models to have a zero token limit
This allows for configuring completely unknown models. For these models no token limit is known and we will simply do not apply any. Instead we trust that the
allow models to have a zero token limit
This allows for configuring completely unknown models. For these models no token limit is known and we will simply do not apply any. Instead we trust that the model will be either large enough to handle our input or at least throw useful error messages.
show more ...
|
| #
4dd0657e |
| 06-Feb-2025 |
Andreas Gohr <andi@splitbrain.org> |
allow to set arbitrary models
We now initialize a model configuration even if we have no info in model.json using some default values for the token limits.
Models can implement the loadUnkonwModelI
allow to set arbitrary models
We now initialize a model configuration even if we have no info in model.json using some default values for the token limits.
Models can implement the loadUnkonwModelInfo() method to fetch the info from an API if such a thing exist. Implemented for gemini and ollama currently.
show more ...
|
| #
b446155b |
| 27-Mar-2024 |
Andreas Gohr <andi@splitbrain.org> |
fix info output on used models
|
| #
2071dced |
| 21-Mar-2024 |
Andreas Gohr <andi@splitbrain.org> |
automatic stylefixes
|
| #
dce0dee5 |
| 19-Mar-2024 |
Andreas Gohr <andi@splitbrain.org> |
move model configuration into json files
This removes the use of individual classes for each model in favor of more general client classes that only get a model name passed. The meta info about pric
move model configuration into json files
This removes the use of individual classes for each model in favor of more general client classes that only get a model name passed. The meta info about price and token limits is configured in a json file
show more ...
|
| #
34a1c478 |
| 19-Mar-2024 |
Andreas Gohr <andi@splitbrain.org> |
more refactoring on chat and embed model support
* differentiate between input and output tokens * make use of much larger input contexts
|
| #
d02b7935 |
| 18-Mar-2024 |
Andreas Gohr <andi@splitbrain.org> |
first tries with Anthropic
|
| #
4373d2bf |
| 18-Mar-2024 |
Andreas Gohr <andi@splitbrain.org> |
stricter interface inheritance
This ensures we have the apropriate methods when a class does not inherit from AbstractModel.
|