Optimizers

SGD(*args, **kwargs)	SGD optimizer.
Momentum(*args, **kwargs)	Momentum optimizer.
MomentumNesterov(*args, **kwargs)	MomentumNesterov optimizer.
Adagrad(*args, **kwargs)	Adagrad optimizer.
Adadelta(*args, **kwargs)	Adadelta optimizer.
RMSProp(*args, **kwargs)	RMSProp optimizer.
Adam(*args, **kwargs)	Adam optimizer.
Constant(*args, **kwargs)	Constant scheduler.
ExponentialDecay(*args, **kwargs)	ExponentialDecay scheduler.
InverseTimeDecay(*args, **kwargs)	InverseTimeDecay scheduler.
PolynomialDecay(*args, **kwargs)	PolynomialDecay scheduler.
PiecewiseConstant(*args, **kwargs)	PiecewiseConstant scheduler.