This is a most excellent place for technology news and articles.
I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
Why are you assuming that software improvements don't include less resource utilization?
I thought it was clear that's what I was implying.
And I'm asking why you think that.
China's models have gotten significantly less resource intensive based on updating the software.
I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
Why are you assuming that software improvements don't include less resource utilization?
I thought it was clear that's what I was implying.
And I'm asking why you think that.
China's models have gotten significantly less resource intensive based on updating the software.