I can now use a local RAG and LLM to work with text contained in a json file. Just been playing with a blog of mine and twitter archive
code - github.com/adamproct… twitch demo - www.twitch.tv/videos/21… longer post - soon sources added to code base - soon
@adamprocter am I correct in understanding that you are eventually trying to query your own post content using a model running locally? Or train a model on your content?
@alpower yes just running queries. Did some tests with my twitter archive made into json, need to work out prompts / user input and need to add in ability to edit those parameters in terminal at least