Hybrid Neurosymbolic Techniques for Non-Markovian Reinforcement Learning