The Times-Picayune reports 33-year-old Edward Alan Lucas, of Picayune, Miss., was booked Tuesday with one count of misdemeanor theft.
Capt. George Bonnett says clerks at the office said Lucas was acting suspiciously, walking up and down the area in front of the records division counter, while they were pulling the file he requested.
After he left the building, he says the clerks noticed three pens were missing.
Bonnett says detectives questioned Lucas and he admitted to stealing the pens.
It was unclear whether Lucas has an attorney.