It appears as if Skyward is not honoring the dates of previously scheduled conferences. There is an open ticket to try to resolve the issue, but the instructions below are the recommended work around.
1) From the Selected Conference Times area, click the Deselect link next to the teacher you wish to see.
2) You can then click the Select Time link from the available time slots for that particular teacher under the All Conferences area.