Knowing that someone was the target of investigation/spying-on of one particular person would be very damaging to the credibility of a person. It doesn't matter if you don't tell the public why, the mere fact of telling the public that they were spied on is enough to damage someone's carrer & life.

It's debatable whether this falls under "privacy" or general "right not be slandered" etc.