12/24/2023: Dolphin Mixtral 8x7b is wild
Eric Hartford's Dolphin fine-tune of Mistral's Mixtral 8x7b gains traction in AI communities for its uncensored outputs, prompting discussion on hardware compatibility and local model hosting.
Mistral models are recognized for being uncensored, and Eric Hartford's Dolphin series applies uncensoring fine-tunes to these models, gaining popularity on Discord and Reddit. The LM Studio Discord community discusses various topics including hardware compatibility, especially GPU performance with Nvidia preferred, fine-tuning and training models, and troubleshooting issues with LM Studio's local model hosting capabilities.
Integration efforts with GPT Pilot and a beta release for ROCm integration are underway. Users also explore the use of Autogen for group chat features and share resources like the Ollama NexusRaven library. Discussions highlight challenges with running LM Studio on different operating systems, model performance issues, and external tools like Google Gemini and ChatGLM3 compilation.
- news.smol.ai12/24/2023: Dolphin Mixtral 8x7b is wildprimary