Big Learning for Little Learners