Looking for an offline AI model with automatic data integration for your knowledge base?

Hello everyone,

I'm looking for a solution to run a local AI model on my Mac (M3 Pro, 36 GB RAM) . The goal is for the AI ​​to automatically access a local knowledge base or a defined folder without me having to manually upload data each time I use it.

My main goal is:

  • Offline use : The AI ​​must run completely locally (no cloud or online services).
  • Automatic data integration : I want to be able to specify folders with files (e.g. Markdown, text, code snippets, workflows) that the AI ​​automatically accesses without having to insert them into the chat each time.
  • Ease of use : A chat interface would be ideal for asking questions, to which the AI ​​would answer based on the knowledge base.
  • Flexibility : It should be possible to regularly add new data, which the AI ​​will automatically index and use for future queries.

I've already installed LM Studio with Mistral 7B , but haven't found a way to seamlessly integrate a knowledge base/my knowledge base. Does anyone know of any tools, extensions, or workflows that enable this automatic linking to local data? Alternatively, I'd be open to other offline models or frameworks that offer this functionality.

Thank you very much for your help! 😊

(2 votes)
Loading...

Similar Posts

Subscribe
Notify of
1 Answer
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
EinTyppie
2 months ago

I think is perfect for you https://github.com/open-webui/open-webui