hypll.optim.sgd

Classes

RiemannianSGD

class hypll.optim.sgd.RiemannianSGD

__init__(params: Iterable[ManifoldParameter | ManifoldTensor], lr: float, momentum: float = 0, dampening: float = 0, weight_decay: float = 0, nesterov: bool = False) → None

step() → None

Performs a single optimization step (parameter update).

Parameters:

closure (Callable) – A closure that reevaluates the model and returns the loss. Optional for most optimizers.

Note

Unless otherwise specified, this function should not modify the .grad field of the parameters.