Skip to content

Musings on AI

Musings on AI

  • Home
    • Home
    • 2024
    • April
    • 21
Mac Oobabooga

Text Generation Web UI(llama.cpp)

Dracones April 21, 2024

In this post I’ll be walking through setting up Text Generation Web UI for inference on GGUF models using llama.cpp for Mac. Future posts will go deeper into optimizing Text…

Recent Posts

  • Adventures in Training: Axolotl
  • Llama 3 on Web UI
  • The Case for Mac: Power Usage
  • Text Generation Web UI(llama.cpp)
  • Mac for a Linux Nerd

Recent Comments

No comments to show.

Musings on AI