It happened around 8:20pm Friday on East 43rd Street not far from North Main.
Police say the men got into a fight with an acquaintance outside a home. That person pulled out a gun and started shooting.
Both men were shot and a stray bullet even hit a wrecker's truck, but the driver wasn't hurt.
According to police, the gunman fled the scene and one of the victims ran into a store, covered in blood and asking for help.
He survived and was taken to a nearby hospital, officials say.
The other victim, 26, died at the hospital.
Police are now questioning the surviving victim for more information on the suspect.