eVision Python API
Loading...
Searching...
No Matches
eVision.EasyDeepLearning.EDeepLearningLearningRateType Class Reference

The type of learning rate indicates how the learning rate changes during training. More...

Inheritance diagram for eVision.EasyDeepLearning.EDeepLearningLearningRateType:
Collaboration diagram for eVision.EasyDeepLearning.EDeepLearningLearningRateType:

Static Public Attributes

int Standard = 0
 The learning rate is reduced after each training iterations where the training error has not significantly changed.
int Fixed = 1
 The learning rate value remains fixed with the value given as parameter during the training.
int Custom = 2
 The learning rate is set for each iterations at the corresponding value in the vector of parameters.
int Decay = 3
 The learning rate is reduced by a factor after each iterations until a minimum.
int WarmRestart = 4
 The learning rate goes from maxLr to minLr during the n-th period of periodN iterations.

Detailed Description

The type of learning rate indicates how the learning rate changes during training.

Member Data Documentation

◆ Custom

int eVision.EasyDeepLearning.EDeepLearningLearningRateType.Custom = 2
static

The learning rate is set for each iterations at the corresponding value in the vector of parameters.

Parameters: [lr0, lr1, ..., lrN]. The last learning rate in the parameters will be used when the number of training iterations is bigger than the vector of parameters.

◆ Decay

int eVision.EasyDeepLearning.EDeepLearningLearningRateType.Decay = 3
static

The learning rate is reduced by a factor after each iterations until a minimum.

Parameters: [Start learning rate, Minimum learning rate, Decay factor]

◆ Fixed

int eVision.EasyDeepLearning.EDeepLearningLearningRateType.Fixed = 1
static

The learning rate value remains fixed with the value given as parameter during the training.

Parameters= [lr]

◆ Standard

int eVision.EasyDeepLearning.EDeepLearningLearningRateType.Standard = 0
static

The learning rate is reduced after each training iterations where the training error has not significantly changed.

Parameters: None

◆ WarmRestart

int eVision.EasyDeepLearning.EDeepLearningLearningRateType.WarmRestart = 4
static

The learning rate goes from maxLr to minLr during the n-th period of periodN iterations.

The length of the first period is given by the parameter period0 and is multiplied by the factor f after each period. Thus, periodN = f^n * period0.

Parameters: [minMr, maxLr, period0, f]