The International Journal of Fuzzy Logic and Intelligent Systems

eISSN 2093-744X
pISSN 1598-2645

Hyper-parameter settings

Hyper-ParameterValue
max_seq_length40
learning_rate0.00001
weight_decay0.01
warmup_ratio0.2
max_grad_norm1.0
num_train_epochs8,13
train_batch_size16,32
fp16true
manual_seed128
International Journal of Fuzzy Logic and Intelligent Systems 2022;22:401~413 https://doi.org/10.5391/IJFIS.2022.22.4.401
© IJFIS
© 2020. The Korean Institute of Intelligent Systems. / Powered by INFOrang Co., Ltd