From Instruction to Interaction