We are using the FER2013 dataset from Kaggle's Facial Expression Recognition challenge. The data consist of 48x48 pixel grayscale images of faces labeled with 7 emotions. The training set consists of about 29k examples. You can see here that there are some emotions with much less data than others such as disgust.