iOS app for chatting with private self hosted language models such as Llama2

by iOS Example

Enchanted

Enchanted is open source, Ollama compatible, elegant iOS/iPad mobile app for chatting with privately hosted models such as Llama 2, Mistral, Vicuna, Starling and more. It’s essentially ChatGPT app UI that connects to your private Ollama models. You can download Enchanted from the App Store or build yourself from scratch.

App Store

While app is being approved by Apple you can use Testflight beta invite link here.

Demo

Features

  • Supports latest Ollama Chat API
  • Conversation history included in the API calls
  • Dark/Light mode
  • Conversation history is stored on your device
  • Markdown support (nicely displays tables/lists/code blocks)

Comming soon

  • Voice prompts
  • Image attachments for prompts
  • Download new models from mobile
  • Manage your conversations (delete/rename)

Usage instructions

Enchanted requires Ollama v0.1.14 or later.

Case 1. You run Ollama server with public access

  1. Download Enchanted app from the App Store.
  2. In App Setings specify your server endpoint.

You’re done! Make a prompt.

Case 2. You run Ollama on your computer

Video instructions here

  1. Start Ollama server and download models for usage.

  2. Install ngrok forward your Ollama server to make it accessible publicly

    ngrok http 11434

  3. Copy “Forwarding” URL that will look something like https://b377-82-132-216-51.ngrok-free.app. Your Ollama server API is now accessible through this temporary URL.

  4. Download Enchanted app from the App Store.

  5. In App Setings specify your server endpoint.

    You’re done! Make a prompt.

Contact

For any questions please do not hesitate to contact me at augustinas@subj.org

GitHub

View Github