Hello, I’m currently using GPT4All on Debian, I was wondering, how do you get the AI to do whatever you want? I’m using the Nous Hermes 2 Mistral DPO model.

  • @liliumstar@lemmy.dbzer0.com
    link
    fedilink
    English
    163 months ago

    You generally want to use a model which has been fine tuned to work around the inbuilt censorship. There are plenty available on huggingface currently. It’s not a perfect solution, but works well enough for what it is.

    I would suggest using the llama.cpp backend with a frontend of your choosing.

  • @PerogiBoi@lemmy.ca
    link
    fedilink
    123 months ago

    You need to download and run an unrestricted model. Take a look at thebloke models (there’s an uncensored 13b vicuna and wizard model).

    Even with uncensored models, you sometimes need to pre-prompt it to answer certain queries as it talks about “ethics” and “morality”.

  • @thantik@lemmy.world
    link
    fedilink
    English
    13 months ago

    So long as you don’t feed it a prompt that attempts to guard-rail it, it should do whatever you want pretty much out-of-the-box.