I recently decided to bite the bullet and get into AI and specifically LLMs. Fuck corporate assholes and data hungry companies so I got some second hand GPUs and made a $800 rig that can run 32b models at very usable speeds. I started playing with it and decided to use pycharm with continue and a local ollama to have my own copilot.
I must say, this is the future. Not in the sense that soon we will all be prompt engineers (lol) but assuming that LLMs don’t reach a point of true intelligence and continue to be fancier and fancier regurgitation machines, this is like having an instant StackOverflow in your IDE. I don’t even bother with complex and unique ideas with it since it really seems that once you reach that area it becomes useless. Basically my programming flow has always started with writing down my rough idea of what I want to do and how I plan on doing it. Now I just feed that to the LLM and it gives me code that is like 90% accurate and I just do a code review, fix mistakes or weird logic and from there as I expand my code I use the LLM as a replacement for online searching. Need syntax help or basic library context? LLM got you covered. Need a function that does something basic or well known? LLM! It’s kind of like having an infinite boilerplate library that can custom fit your needs. I think that the reason it works so well for me is that I really only let it handle the basics, anything that I need to think through I do myself.
I doubt we will ever go back from this.
You must log in or register to comment.
That’s a very popular opinion for people that don’t know what the fuck they’re doing.
There’s a lot more people trying out new things who would never code before AI was there.
And they still don’t, because they lack the fundamentals.
Yeah well that’s why it’s here and not on reddit XD
Also, my point is that I know what I’m doing, that is why I was so skeptical of it, but it really is a good tool to have.
Did you try it?
I know what I’m doing
I don’t believe you
Did you try it?
Yes I did.
- Writing code isn’t actually the majority of software engineering unlike what naive people believe.
- Most of the code I write isn’t boilerplate for new projects because I actually work on real software that people use.
- It’s not faster to review code written by a moron (artificial or otherwise) than to just fucking write it.
Okay then. I agree on 1, writing code is just part of it. Most of it is the logic, research, and knowledge. I had challenges that were like 90% research and logic and only the last 10% are the actual coding.
2, sure, I often did too, but not all jobs or projects are like that and plenty of highly skilled programmers are working daily on new code.
3, debate-able, but as I have done it I can say that the code is pretty readable and accurate. My review can be much faster than writing it from scratch. Just like reading a page from a book is faster than writing one, even if you already know exactly what you will write.
I don’t think your opinion as expressed is rare as much as it is people not liking/wanting the options that are currently out there as they are.
If they were all open source and/or free of corporate manipulation, there’s big swaths of objectors that would be okay to enthusiastic about it.
If they were fully capable rather than being a mishmash of levels of readiness, another swath would either support or cease to object.
And, you’d also see increased support if the system underlying everything was more supportive of the people that are going to have to shift jobs when the models are fully capable rather than the varying stages of capability.
Eventually, it’s going to be the dominant tool for almost all use cases, and there’s nothing wrong with a tool reducing the need for humans to do grunt work. It’s all the knock on effects that are the problem, not the fact.
If you don’t write code than you are not coding
I am writing code. By chars written I’m probably doing 40% of the work. By the heart of my programs (the complex part) I’m probably doing 95% of my code.
So in essence you use your local LLM to create AI slop because it’s not useful for anything more complex? And it’s just for advance spell checking/intellisense?
You really didn’t had to buy that rig to know that, you know?
