The large language models behind AI chatbots are developing so rapidly that after eight months, a model only needs half the computing power to hit the same benchmark score - which is much faster than the rate at which computer chips improve
The large language models behind AI chatbots are developing so rapidly that after eight months, a model only needs half the computing power to hit the same benchmark score - which is much faster than the rate at which computer chips improve
That is… Odd. (It’s also paywalled.)
If they are referring to exponential increases in speed, similar to Moore’s law, I would suspect there would be some improvement over time but… Comparing transistor density to the speed improvement of an ANN is bizarre, TBH.
Training methods may be improving? That could be a thing. An ANN uses fairly basic math but it needs to be computed en masse. That is dependent on processors, so that makes for an even weirder comparison.