updated model lists

This adds a CLI tool to fetch some model data from @BerriAI/litellm

Version upped

monkey patching vanderlee/php-sentence#/27

Version upped

added claude 3.5 sonnet model

auto codestyle cleanup

Use custom renderer when creating embeddings

Rendering makes plugin output available and and handles includes. It
might also help with #15.
The renderer uses markdown like output since all LLMs seem

Use custom renderer when creating embeddings

Rendering makes plugin output available and and handles includes. It
might also help with #15.
The renderer uses markdown like output since all LLMs seem to be very
familiar with it's syntax. This might help them to understand the
document structure better.
This also adds a breadcrumb trail at the top of each chunk which might
help with contextulization as well.

show more ...

Version upped

do not use synthetic submit event on enter

This didn't work correctly for some reason in Firefox. Instead we
directly call the submit handler

Version upped

gracefully handle render errors

plugins may act up during text rendering, this should not abort the
whole indexing. Instead we fall back to the page source

init ACLs in CLI

When using the text renderer, we might execute syntax plugins that check
ACLs. We don't have a user when running the CLI but we want to index
everything an anonymous user would be a

init ACLs in CLI

When using the text renderer, we might execute syntax plugins that check
ACLs. We don't have a user when running the CLI but we want to index
everything an anonymous user would be able to see. For that the ACLs
need to be loaded.

show more ...

Version upped

focus the user question instead of scrolling to the end

Version upped

added gpt-4o

Version upped

added support for groq

Version upped

Added support for reka.ai

added open-mixtral-8x22b

Version upped

gpt-4-turbo is no longer in preview

Version upped

rebuild the index when the embedding model changed