The decision places Harris County in line with 251 of 254 Texas counties that do not take part in the program.
The program allowed ICE to deputize local law officers to perform certain federal immigration enforcement functions in jails.
RELATED: Former Harris County Sheriff to renew controversial federal immigration
Sheriff Gonzalez's decision will free at least $675,000 in the sheriff's budget.
The process to begin termination of the Harris County Sheriff's Office participation in this voluntary program will begin immediately.