The "Chalice Quilt", Williams explained, was made at Mimosa Hall Plantation in East Texas by enslaved members of his family in the 1860s.
It has been displayed at the American Museum and Gardens in Britain since 1983.
SEE ALSO: A Black cowboy fulfills quest to sleep in ancestor's plantation cabin
Williams is now continuing to push for the piece of history and cultural heritage to be returned to Texas.
"This quilt also has a religious significant undertone because it was also used as a roadmap for travelers and slaves traveling along the Underground Railroad and that is a very cultural significant heritage piece that needs to be brought back to Texas so everybody can be educated from it," Williams said.
Williams said their hope, when they get it back, is to eventually put it in the Martin Luther King Jr. memorial in Washington D.C.
For more news updates, follow Courtney Carpenter on Facebook, Twitter and Instagram.