exploring making a local novel ai story writer
feeling-lucky-gemma-2025-12-30_03-49-41.10mb.webm
novel-ai-gemma-12b-2025-12-30_04-04-40.10mb.webm
novel-ai-ministral-14b-2025-12-30_04-14-14.10mb.webm
I had chatgpt code up the front end and wrap up the code into structured outputs after seeing the original thread for the idea
DougDoug makes interesting and entertaining videos, a series I like is his AI invasion Series with twitch chat. For reference here is a playlist of the series To make the series possible, he uses NovelAI. I wanted to make an app that you can run locally so that you can switch out models and not > worry about updates.
These are some experiments and prompts I made with chatgpt
To run the exploration notebook, make sure to install python with UV and ollama. When building your environment, make sure to install the dependencies (ollama, openai, etc) from the pyproject.toml file
With your dependencies installed, run
uv run marimo run 03-app/app.py