Learning to read between the lines