Changes learning rate description (#1546)

* Fixes learning rate and momentum definitions

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update algorithms.md

* Makes epsilon, beta1, beta2 and decayRate definitions uniform

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Changes learning rate description

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
This commit is contained in:
kolchfa-aws 2022-10-12 16:46:34 -04:00 committed by GitHub
parent 15c76088fe
commit 5f8d2fae09
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions

View File

@ -65,7 +65,7 @@ Linear regression maps the linear relationship between inputs and outputs. In ML
Parameter | Type | Description | Default Value
:--- |:--- | :--- | :---
learningRate | Double | The gradient descent step size at each iteration when moving toward a minimum of a loss function or optimal value. | 0.01
learningRate | Double | The initial step size used in an iterative optimization algorithm. | 0.01
momentumFactor | Double | The extra weight factors that accelerate the rate at which the weight is adjusted. This helps move the minimization routine out of local minima. | 0
epsilon | Double | The value for stabilizing gradient inversion. | 1.00E-06
beta1 | Double | The exponential decay rates for the moment estimates. | 0.9
@ -413,7 +413,7 @@ A classification algorithm, logistic regression models the probability of a disc
| Parameter | Type | Description | Default Value |
|---|---|---|---|
| learningRate | Double | The gradient descent step size at each iteration when moving toward a minimum of a loss function or optimal value | 1 |
| learningRate | Double | The initial step size used in an iterative optimization algorithm. | 1 |
| momentumFactor | Double | The extra weight factors that accelerate the rate at which the weight is adjusted. This helps move the minimization routine out of local minima. | 0 |
| epsilon | Double | The value for stabilizing gradient inversion. | 0.1 |
| beta1 | Double | The exponential decay rates for the moment estimates. | 0.9 |