During World War II, the Tiptonville Women’s Club sought to create a positive and engaging activity for women and children while the men were away fighting. They started a "Little Free Library," a take-a-book, leave-a-book setup, hosted in one of the members’ homes.

After the war, the club approached the city about establishing a public library. However, the city dismissed the idea, claiming it was an unnecessary expense in the aftermath of the war. Undeterred, the women took matters into their own hands. They applied for grants, one member donated land, and they successfully built the library in 1940.

Initially, the library consisted of just two front rooms—what is now the entrance and the area where the circulation desk is located. The closet behind the circulation desk was originally a bathroom. The Tennessee Room was also part of the original layout.

In 2000, the Women’s Club secured a rural development grant to expand the library. This addition included the children’s room, a modern bathroom, a kitchenette, and the front conference room. While much of the back area was updated with sheetrock, the hallway and conference room still showcase one original brick wall, a charming nod to the library’s history.