Leaderboard scores often can be a bit misleading since there are other factors to consider.
- Censorship: Is the model censored?
- Verbosity: How concise is the output?
- Intelligence: Does the model know what it is talking about?
- Hallucination: How much does the model makes up facts?
- Domain Knowledge: What specialization a model has.
- Size: Best models for 70b, 30b, 7b respectively.
And much more! What models do you use and would recommend to everyone?
The model that has caught my attention the most personally is the original 65b Llama. It seems genuine and truly has a personality. Everyone should chat with the original non-fine tuned version if they can get a chance. It’s an experience that is quite unique within the sea of “As an AI language model” openai tunes.
You must log in or register to comment.
I’ve been very partial lately to anything ORCA tuned, i’m not sure if it’s placebo but it always feels like they’re just that much smarter and have a bit more ability to think things through
for instance, I have a character in oobabooga, and in its description/pre-prompt I told it to ask questions about what it doesn’t know with “It only answers questions it knows the answer to, choosing to ask for additional context when information is unclear.” and anything that’s tuned on orca is 10x more likely to actually consider what it doesn’t know and ask for context rather than hallucinating information
lately I’ve been playing with Dolphin which is llama 1 based, and it’s an absolute pleasure https://huggingface.co/ehartford/dolphin-llama-13b
Uncensored WizardLM 33B has been quite helpful for some general quick tech help
I didn’t try out many models but Vicuna has been the best one so far
Wizard-Vicuna-30B-Uncensoredworks pretty well for most purposes. It feels the smartest of all I’ve tried. Even when it hallucinates, it gives enough to refine the google query on some obscure topic. As usual, hallucinations are also easily counteracted by light non-argumentative gaslighting.It isn’t very new though. What’s the current SOTA for universal models of similar size? (both foundation and chat-tuned)
What kind of prompt (format) do you use when chatting to something like the original base LLaMA?
I thought the original LLaMa was not particularly good for conversational-format interaction as it is not instruction fine-tuned? I thought its mode of operation is always “continue the provided text” (so for example instead of saying “please write an article about…” you would have to write the title and opening paragraph of an article and then it would continue the article).
I thought its mode of operation is always “continue the provided text”
I haven’t played with trying to use it for conversation like stuff so I can’t say anything about whether it’s “particularly good” or not. However, “continue the provided text” doesn’t preclude conversational stuff. If you give it enough of an example of the “conversation”, even non-conversation tuned models will complete it. They’ll write both sides of the conversation if you let them, but you can use stuff like reverse prompts to return control what it’s your “turn”.
I’d guess the chat tuned models are kind of more aimed at question/answer and specifically providing accurate and helpful answers rather than just dialog in general as well.
