When it comes down to it, that's just an excuse. If you think being a recruiter would appeal to you, then do it. It's cheesy to say that you can do anything you can put your mind to, but there truly is no one holding you back other than yourself.

I think the whole recruiter/agent idea for young professionals makes a hell of a lot of sense, and I'd be happy to be one of your early clients :)