Oui is a 'yes' answer to an affirmative question, while si is a 'yes' to a negative question.
Non is a one-word negative answer to a yes / no question; pas, by itself, negates part of a sentence:
Rien (nothing), personne (no one), and jamais (never) may be used in one-word answers: