So, this should be a fun one to jump in. Basic background on my usage currently:
- Obviously I have been involved with this project for a LONG time, only rarely submitting code as a user more than anything.
- I also teach sound design and engineering at a university along with my full time job (Production Management) and my consulting business I run with a couple of employees. (Yes I have little free time)
I have started really experimenting with LLMs about 6 months ago, maybe less. I started looking at code generation in LLMs about 3 months ago. This came about when I realized, I had multiple ideas that would help me teach better, or rather help my students be able to explore and learn better, but I had no time to be able to implement it with the limited coding knowledge and experience I have (See above list of what I do).
What came of this, was generating an ear training piece of software, that I could tune to meet my specific needs, including integration (To a limited extent) with the LMS used by the university to sync grades and students etc. and assign tasks to complete. This came after trying a couple of different paths to accomplish this. I had a budget I was willing to spend on this, but it wasn’t enough to hire a developer to assist me with the programming, and explaining some of my DSP requirements doesn’t mean that a random developer would understand it well, and even the initial quotes I got for completing this task would likely be far lower than the actual cost.
Instead I started vibe coding the tool and within a month had a workable version of it I deployed to my students. I have remained under budget, but not by much, of what I had to complete this tool, which my budget was in the 4 digit range, to complete a v1 (Technically I am working on v0.8 right now) with plans already developing for a v2 of the tool. Vibe Coding allowed me to create the tool for the betterment of my students and for my own use of time in the future, that would not otherwise exist.
That being said, I HAVE had to closely monitor it. It is not that this is a major time saver entirely, and while it did cost less money than hiring the developer, so technically saved money, my time is obviously worth something as well, and I may or may not have had to spend as much time overseeing it as I would a developer, so debatable how much savings there is overall.
I do think there is value here. I think the points about the environmental impact are 100% accurate and need to be addressed, but I also do believe that the environmental impact, while directly attributable to the growth of data centers especially, is a larger issue than just LLMs, it just happens they are the driving force currently, but I also suspect there will be another force to drive it if LLMs didn’t exist. Remember, data centers have existed for decades now, and have been growing in that entire amount of time, not at the speed lately, and the stupidity I have seen with some projects, but they definitely did. So I agree with a previous poster that the issue here is more than just ‘LLM’ and a societal and economic situation that LLMs happens to be the foremost driver of currently.
It is also worth noting that when people talk about the environmental impact, they are talking in particular about the development of new models, more so than the use of current models, which have vastly different power requirements. There is also a lot of misinformation about data centers and environmental impacts, which there is a VERY real environmental impact happening, and an economic impact in my area, but some of the reason I see people throwing out aren’t actually accurate or are very specific edge cases. All of these issues NEED to be addressed, but that addressing needs to happen at a governmental level as well.
I am in favor of finding a way to incorporate this technology in a reasonable way. I think this discussion is the beginning of it and overall I trust Paul and Robin both to weigh things out carefully before moving forward. I am not sure about the legal ramifications yet, and doing this in a way that keeps the code able to be licensed properly as open source is important. In fact I think this is even more examples of why open source development can be so important, and is bringing the strength of this to a larger and more direct impact for people. I do believe LLMs are going to exist for some time, I also do believe there is a huge bubble around that industry that will pop at some point, but I do believe LLMs are changing the way we work in similar ways to what computers did back in the 80s and 90s and we need to be able to adapt.
I am sure there is a huge amount of thoughts on this topic that i haven’t spoken to yet. But short version I am in favor of the approach Paul and Robin seem to be taking.