As AI companies rave about how their products are revolutionizing productivity, Senator Bernie Sanders wants the tech industry to put its money where its automated mouth is.
A while back when one of the popular models came out it blew all the others away in benchmark tests. That got my coworker and boss super excited, we started coming up with different ways AI can help us. Thankfully as I pointed out, our software is proprietary and super secret, and all it took was a couple Google searches to find out a lot of those companies leak data like crazy and AI will just tell other people your secrets if they ask in the right way. So we needed to run our LLMs locally, but for that we’d need some beefy specs. I did the research, wrote a neovim and sublime plugin to integrate our local LLMs in a ‘copilot’ kind of way. My boss ordered my coworker and I whatever the new macbooks are with 128gb of memory to fit our lovely AI models, bought me a desktop tower and a few GPUs. Then I went on a 3 month paternity leave, came back and have heard nothing about AI since aside that my coworker switched to vs code to try and use continue but got frustrated, switched back to sublime and doesn’t use AI anymore.
So yeah, AI got me 2 new maxed out spec machines and 2 weeks of fuck around time writing plugins that were not nearly as complex as everyone thought, just because AI was involved.
For real though, I’ve tried quite a few times but 9/10 it fails me and I end up spending more time messing around with prompts than it would’ve taken me to do the thing. Occasionally when I have a mile long error message or something super obscure I’ll pass it to ollama and it seems to do well with wittling it down for me, that’s about it.
I think your missing something big here.
A while back when one of the popular models came out it blew all the others away in benchmark tests. That got my coworker and boss super excited, we started coming up with different ways AI can help us. Thankfully as I pointed out, our software is proprietary and super secret, and all it took was a couple Google searches to find out a lot of those companies leak data like crazy and AI will just tell other people your secrets if they ask in the right way. So we needed to run our LLMs locally, but for that we’d need some beefy specs. I did the research, wrote a neovim and sublime plugin to integrate our local LLMs in a ‘copilot’ kind of way. My boss ordered my coworker and I whatever the new macbooks are with 128gb of memory to fit our lovely AI models, bought me a desktop tower and a few GPUs. Then I went on a 3 month paternity leave, came back and have heard nothing about AI since aside that my coworker switched to vs code to try and use continue but got frustrated, switched back to sublime and doesn’t use AI anymore.
So yeah, AI got me 2 new maxed out spec machines and 2 weeks of fuck around time writing plugins that were not nearly as complex as everyone thought, just because AI was involved.
For real though, I’ve tried quite a few times but 9/10 it fails me and I end up spending more time messing around with prompts than it would’ve taken me to do the thing. Occasionally when I have a mile long error message or something super obscure I’ll pass it to ollama and it seems to do well with wittling it down for me, that’s about it.