Little is known about Thomas's early life, other than that he lived in Mersea, Ontario for many years. While there, he married Mary Amelia Fulmer in 1833. They had nine children together, with three being born in Canada.
Thomas and Mary raised their home centered around the religious beliefs of Christianity. In 1837, Missionaries of the Church of Jesus Christ of Latter-day Saints paid a visit to the Whittle family, and they were baptized that same year. Between 1837 and 1840, the Whittle family moved from Mersea to Quincy, Illinois, and then moved to Nauvoo, Illinois, between 1840 and 1843, to be closer to the Church.
After the assassination of Church President Joseph Smith, the Whittle family joined the other Saints to move out to the Rocky Mountains. The family was a part of the Zera Pulsipher Company. They arrived in Salt Lake City in 1848.
After his return to Utah, the Whittle family moved to Harriman. While there, he entered into the practice of polygamy and married Mary Jane Butterfield Aug 7, 1855. Afterward, the Whittle family moved to Grantsville, Utah for just a short time.
In 1860, the Whittle family moved to Richmond and was part of the Richmond Fort.