We also provide some other ideas to extend our research with other SOTA models
After DPCNN and codebert output vector, continue training with a DNN.
It can be a 2stage process, first stage training embedding, second stage training dnn. The target loss function can be chosen by your idea.
You can also just treat the DNN as a fine-tuning process.