The community, originally called Farr's Mill, had a sawmill, water mill, gristmill, and cotton gin. It was on the military road used by Confederate troops during the Civil War and was also on a stage route running from Alexandria, Louisiana, to Beaumont, Texas. A post office opened in Farrsville in 1875. By 1884 the community had a population of 150.