The early history of James is unknown other than he worked in a mine. James was converted to the Church of Jesus Christ of Latter-day Saints on Nov 24, 1850. Soon after, he began his journey to move to the United States in 1853 boarding the Elvira Owen in Liverpool, England. They landed in New Orleans, Louisiana.

The company that James joined is unknown, but he arrived in Utah in 1853 settling in Grantsville. While there, he helped to build a fort to protect themselves from angry Native Americans. While there, James was able to purchase land and raise sheep.

In 1864, the Durney family moved to Richmond, first moving his second wife the same year, then his first in the summer of the same year.