Tapping the bar which displays the time and battery life at the top of the screen will quickly scroll you top of most content on the iPhone, Contacts App and Safari included.
Or you can tap anywhere on the alphabet bar and swipe up. You can scroll through the alphabet like that as well, no need to tap exactly the right letter.
