It takes a lot of energy to train the models in the first place, but very little once you have them. I run mixture of agents on my laptop, and it outperforms anything openai has released on pretty much every benchmark, maybe even every benchmark. I run it quite a bit and have noticed no change in my electricity bill. I imagine inference on gpt4 must almost be very efficient, if not, they should just switch to piping people open sourced llms run through MoA.
Other than having to scroll down an extra 3 centimeters to see your Google results, have you actually been inconvenienced by ai being used somewhere? All this outrageous about terrible ai getting in the way all the time is hilarious because it is absolutely manufactured by people who are obsessed with complaining and then parroted by people incapable of thinking for themselves. Nobody’s actually living worse lives because a few companies are trying out new tech. The fact of the matter is that there are obnoxious karens online, just like in real life.
You seem like someone who is probably self-righteous, obnoxious, and annoying to be around in real life, just like you are online.