I'm surprised no one's mentioned the utility "stow". It lets you install things to their own /usr/local-style hierarchy and will symlink all the files for you. That way you can easily remove something after you've deleted the source directory.