At an early age, the Fisher family was converted to the Church of Jesus Christ of Latter-day Saints and William was baptized at the age of eight in 1848. On April 8, 1854, the family left Liverpool, England to move west to Utah. They landed in New Orleans, Louisiana on May 29.
After taking steamboats up the Mississippi and the Missouri rivers, they met in Kansas City, Nebraska Territory, and began their journey to the West in the Robert L. Campbell Company, leaving on July 18, 1854 and arriving in the Salt Lake Valley on Oct 31.
In April of 1860-1861, William worked for the Pony Express sending mail from Salt Lake City to parts of Nevada along with his brother-in-law Howard R. Egan. The Fisher family moved to Richmond sometime between 1864-1866.