It says that use of pseudonyms was introduced in 2005, after an official was tracked down by a constituent she'd been in contact with and threatened at her home address.
But the practice didn't come to light until Wednesday, when the country's Channel 4 News exposed one such official as being imaginary.
Downing Street said it was now looking in to an alternative to using pseudonyms in its letters to the public.