Even the best-behaved feline buddies can develop this obnoxious tendency, which is extremely annoying when a cat prefers to soil inappropriate locations outside the litter box . Occasionally, this issue may be a sign of a developing medical condition, however, the litter box is typically to blame in most cases.