Version upped

Fix chunksize calculation

Version upped

make fullpagecontext a numeric setting

You now can define how many pages should be sent, regardless of the
number of matching chunks.
Pages are still identified via the chunks, so this number can't

make fullpagecontext a numeric setting

You now can define how many pages should be sent, regardless of the
number of matching chunks.
Pages are still identified via the chunks, so this number can't be
larger than the chunks.

show more ...

Version upped

Update Gemini model configurations

Updated model configurations to include new Gemini versions and removed outdated ones.

Version upped

avoid deleting non-existant chunks. fixes #46

Version upped

fix interface handling with generic model

Version upped

make ollama auth optional

fix double intro message. fixes #44

connectedCallback may run multiple times, because the component is
readded to the dom when the section edit initializes.

Version upped

upped version

add tests for text splitting

make overlap a class member for easier testing

Agents: make clearer how to run tests

added an AGENTS.md file for LLM based work

split sentences by token, not bytes. handle UTF-8

move text splitting into it's own class

Some enhancements on the subsentence splitting

When a sentence is longer than a chunk, it should be split forcefully in
smaller parts - these parts should NOT be the size of a full chunk since
we st

Some enhancements on the subsentence splitting

When a sentence is longer than a chunk, it should be split forcefully in
smaller parts - these parts should NOT be the size of a full chunk since
we still want to do some overlap with previous and following texts. I
chose to split into a quarter of a chunk.

This also ensures that whitespace is kept for the split sentences,
because they may be joined with follow up texts.

show more ...

Squashed commit of the following:

commit 4e0adf2a8d810e55db6d37ccc87c76d95ddcfd8d
Author: Henry <henry.krupp@gmail.com>
Date: Mon Feb 3 22:04:17 2025 +0100

Updated splitLongSentence()

commit

Squashed commit of the following:

commit 4e0adf2a8d810e55db6d37ccc87c76d95ddcfd8d
Author: Henry <henry.krupp@gmail.com>
Date: Mon Feb 3 22:04:17 2025 +0100

Updated splitLongSentence()

commit 9883844f1db6df9e11051c4c7b034e68baaca0be
Author: Henry <henry.krupp@gmail.com>
Date: Mon Feb 3 22:03:25 2025 +0100

Updated splitLongSentence()

commit 6f737f6fe4da25fa438211d5c00605c2df9c81ba
Author: Henry <henry.krupp@gmail.com>
Date: Mon Feb 3 21:43:16 2025 +0100

array_unshift($sentences, ...$this->splitLongSentence($sentence, $tiktok));

commit 21966eab02f87f632e82ad0055f9bc2aadb92053
Author: Henry <henry.krupp@gmail.com>
Date: Mon Feb 3 21:23:40 2025 +0100

Updated splitIntoChunks method

Push split sentences to the front of the queue with array_unshift($sentences, ...$this->splitLongSentence($sentence, $tiktok));

show more ...

added French Translations

upped version