There is indeed a lot more to do. While there is clearly diminishing returns, secondary rays for instance are computationally very difficult, and contribute significantly to the final perception of the scene. While we're able to take all sorts of shortcuts for special instances a general and global solution is still an unsolved problem.