• GBU_28
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    1 month ago

    The proper framework does, with data store, indexing and access functions.

    The cutting edge work is absolutely using LLMs in post-rag pipelines.

    Consumer grade chat interfaces def do not do this.

    Edit if you worry about topics like context window, sentence splitting or source extraction, you aren’t using a best in class framework any more.