Browne was the daughter of Mary Taylor Lee and Lawrence Johnson Lee without siblings, but unfortunately Browne's mother passed away when she was just two years old. Instead her father, a railway postal clerk, and stepmother, Lottie Lee, a school teacher raised her.