All tags
Topic: "hardware-compatibility"
12/29/2023: TinyLlama on the way
tinyllama-1.1b openai hugging-face gpu-optimization model-deployment discord-bots embedding-models inference-server hardware-compatibility model-performance beta-testing autogen context-window
The Nous/Axolotl community is pretraining a 1.1B model on 3 trillion tokens, showing promising results on HellaSwag for a small 1B model. The LM Studio Discord discussions cover extensive GPU-related issues, Discord bot integration with the OpenAI API, and hardware limitations affecting model usage. Community members also discuss server hosting for embeddings and LLMs, propose updates for Discord channels to improve model development collaboration, and address a gibberish problem in beta releases. The Autogen tool's installation and operational challenges are also clarified by users.
12/24/2023: Dolphin Mixtral 8x7b is wild
dolphin glm3 chatglm3-ggml mistral-ai ollama google openai fine-tuning hardware-compatibility gpu-inference local-model-hosting model-integration rocm-integration performance-issues autogen linux model-training eric-hartford
Mistral models are recognized for being uncensored, and Eric Hartford's Dolphin series applies uncensoring fine-tunes to these models, gaining popularity on Discord and Reddit. The LM Studio Discord community discusses various topics including hardware compatibility, especially GPU performance with Nvidia preferred, fine-tuning and training models, and troubleshooting issues with LM Studio's local model hosting capabilities. Integration efforts with GPT Pilot and a beta release for ROCm integration are underway. Users also explore the use of Autogen for group chat features and share resources like the Ollama NexusRaven library. Discussions highlight challenges with running LM Studio on different operating systems, model performance issues, and external tools like Google Gemini and ChatGLM3 compilation.