The first railroad in the Columbia River Basin was built along the river in 1851. Little more than a cart on rails, it was a portage tramway on the Washington side of the Columbia River Gorge around The Cascades rapids.
http://www.gatheringthestories.org/2014/12/12/the-first-railroad-in-the-columbia-river-basin