RNN(Recurrent Neural Network)

RNN進化路線

word2vec(CBOW, skip-gram) → Embedding/Negative Sampling → RNN → ゲート付きRNN(LSTM, GRU) → seq2seq → Attention → Transformer