>When looking at the advancements in GPUs these days, where are the improvements coming from?
A considerable chunk of it is process improvements. Take a look at the chart at http://wccftech.com/nvidia-pascal-gpu-analysis/ that's about halfway down. nVidia's current generation GPUs are at 16nm. For comparison, Intel is at 14nm for their processors (though their 14nm process is better than most other chipmakers 14nm process) and hopes to start delivering 10nm this year, a year or so later than planned. So nVidia has a couple more process bumps to go, whenever they become affordable, and then they hit the wall like everyone else and have to focus mainly on architectural improvements for further performance gain.
A considerable chunk of it is process improvements. Take a look at the chart at http://wccftech.com/nvidia-pascal-gpu-analysis/ that's about halfway down. nVidia's current generation GPUs are at 16nm. For comparison, Intel is at 14nm for their processors (though their 14nm process is better than most other chipmakers 14nm process) and hopes to start delivering 10nm this year, a year or so later than planned. So nVidia has a couple more process bumps to go, whenever they become affordable, and then they hit the wall like everyone else and have to focus mainly on architectural improvements for further performance gain.