I run this one. https://ollama.com/library/deepseek-r1:32b-qwen-distill-q4_K_M with this frontend https://github.com/open-webui/open-webui on single rtx 3090 hardware 64gb ram. It works quite well for what I wanted it to do. I wanted to connect 2x 3090 cards with slurm to run 70b models but haven’t found time to do it.
I believe you can run 30B models on single used rtx 3090 24GB at least I run 32B deepseek-r1 on it using ollama. Just make sure you have enought ram > 24GB.
If you want to use supercomputer software, setup SLURM scheduler on those machines. There are many tutorials how to do distributed gpu computing with slurm. I have it on my todo list.
https://github.com/SchedMD/slurm
https://slurm.schedmd.com/
Technically they stole from themselves because they didn’t transfer ownership from Bethesda to Microsoft. Those are still separate entities.
I love how corporations anounce: we stole something and call it AI.
Someone put 69 to research and then to article. Nice trolling.
I imagine a simulator game where company makes lawsuits and owners are crying because their games are less successfull than competition. That would be funny game.
So drug dealing methods are now copyright protected ? Because they are in game. xD
I only use foobar2000 and soulseek
Yeah desktop apps era is back baby. Fuck you cloud.
Maybe we go back to p2p, public key encryption and desktop apps. ipfs can store all the data in the distributed manner and gov can pay citizens for keeping data as a tax exception. But who I am to question building big corporations over and over again.
Does all EV require travel destination for battery preconditioning ? If so EV have kind of spying as a feature.
The problem is that those companies are monopolies and can raise prices indefinitely to pursue this shitty dream because they got governments in their pockets. Because gov are cloud / microsoft software dependent - literally every country is on this planet - maybe except China / North Korea and Russia. They can like raise prices 10 times in next 10 years and don’t give a fuck. Spend 1 trillion on AI and say we’re near over and over again and literally nobody can stop them right now.
Wait until you find out that Saudi Arabia have a big stake in Disney, Facebook and OpenAI.
We need to annect Austria, Czechoslovak Republic and Poland otherwise China will do it first.
Hail Hydra
Yes it’s fairy simple, basically you draw random things and think about what you want to write about, then the person who needs to read it just go back in time and reads your mind from that period using your paper card. People do it all the time, it’s called Art. Go to museum and you find plenty of those.
…without users. Just bots dating with bots.