This talk will explore local-first and self-hosted implementations of LLMs, agent harnesses, Obsidian knowledge bases, and self-hosted apps and services. We will explore a preliminary and experimental framework consisting of Hermes, self-hosted LLMs, various self-hosted applications which the agent can read and write to. Such applications include Actual (personal finance), Umami (web analytics), Postiz (social media post scheduling), and Cal.com (booking platform).

We will also explore how local-first PKM (Personal Knowledge Management) tools like Obsidian can integrate with self-hosted agent frameworks, so that people can share private information with self-hosted LLMs (rather than LLMs hosted by big tech companies) with dramatically less risk for exploitation of personal data.