Houston police told ABC13 they received the initial call of a drowning near the Japanese Garden around 10:30 a.m.
Moments after police arrived, they recovered the body at McGovern Lake.
Police say someone noticed something floating in the pond and later realized it was a body and immediately called 911. Investigators believe the man is in his 20s or 30s.
A preliminary investigation showed there are no visible signs of trauma or foul play.
Police said they don't believe the man was homeless because he was well-dressed and had on jewelry. The man may have been in the water for some time, police added.
Anyone with information in this case is urged to contact the HPD Homicide Division at 713-308-3600.
Follow Mycah Hatfield on Facebook and Twitter.