You’re conflating me asking how to use these tools with you who’s misusing them. I see you still don’t accept what you’re doing is wrong. But go you.

Please be very careful. The python code it’ll spit out will most likely be outdated, not work as well as it should (the code isn’t “thought out” as if a human did it.

If you want to learn, dive it, set yourself tasks, get stuck, and f around.

Yeah shell scripts are one of those things that you never remember how to do something and have to always look it up!

Some questions and because you don’t actually understand, also, the answers.

• what does the LLM understand the context of, (other user’s data owned by Twitch)
• How is the LLM fed that data? (You store it and feed it to the LLM)
• Do you use Twitch’s data and its users data through an AI without their consent? (Most likely, yes)
• Do you have consent from the users to store ‘facts’ about them (You’re pissy, so obviously not)
• Are you then storing that processed data? (Yes, you are, written to a file)
• Is the purpose this data processing commercial (Yes, it is, designed to increase viewer count for the user of this system - and before you retort “OMG it helps twitch too”… Uhm no, Twitch has the viewers if not watching him, watching someone else)

I mean yeah, it’s a use case, but own up to the fact that you’re wrong. Or be pissy. I don’t care.

No, what is it? How do I try it?

Surely none of that uses a small LLM <= 3B?

But won’t this be a mish-mash of different docker containers and projects creating an installation, dependency, upgrade nightmare?

Try the beta on the github repo, and use a smaller model!

I agree. it looks nice, explains the models fairly well, hides away the model settings nicely, and even recommends some initial models to get started that have low requirements. I like the concept of plugins but haven’t found a way to e.g. run python code it creates yet and display the output in the window

I’ve discovered jan.ai which is far faster than GPT4All, and visually a little nicer.

EDIT: After using it for an hour or so, it seems to crash all the time, I keep on having to reset it, and currently am facing it freezing for no reason.