Each blueprint works this way.
This is probably what is happening.
A possible solution is the following: open your character's Blueprint (BP).
You also need to add it to "End Overlap" event.