Pytorch common optimizer

Adadelta

Adagrad

Adam

AdamW

SparseAdam

Adamax

ASGD

SGD

RAdam

Rprop

RMSprop

Optimizer

NAdam

LBFGS