At the age of 11, the Fifield family was converted to the Church of Jesus Christ of Latter-day Saints and moved to Nauvoo, Illinois in 1841 to live among the Saints. While in Nauvoo, the family opened a Gun Smith shop.
Before the Fifield family moved west, Matthew's father joined the Mormon Battalion and left Matthew and his younger brother in Nauvoo in 1846. They lived in Nauvoo until they joined the Brigham Young Company of 1848 and left on June 5. While on the trek west, Matthew's father was returning east and they reunited on the Great Plans. They arrived in the Salt Lake Valley on Sep 24.
The Fifield family first settled in Mill Creek, Utah before moving to Ogden, Utah. Matthew married Almira Jane Gibson on April 5, 1852 in Salt Lake City, Utah. Soon after, the Fifield family fled to southern Utah in 1857 to flee from Johnston's army in the Utah War. After the conflict, the Fifield family moved back to Ogden where Almira died in 1860. The Fifield family moved to Richmond soon after where his brother-in-law Henry E. Gibson had settled.