The FBI in 2009 seized the note from Heritage Auction Galleries, three years after collector Richard Goodkin consigned it for sale. A Kennedy relative told agents that the family never gave away or sold the note.
Goodkin on Thursday told The Dallas Morning News that he hasn't decided whether to continue his ownership claim.
A Kennedy family member didn't immediately comment.
President John F. Kennedy was assassinated in Dallas in 1963.