ONE - On-device Neural Engine
All Data Structures Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Modules Pages
optimizer.adam.Adam Class Reference
Collaboration diagram for optimizer.adam.Adam:

Public Member Functions

 __init__ (self, learning_rate=0.001, beta1=0.9, beta2=0.999, epsilon=1e-7)
 

Data Fields

 beta1
 
 beta2
 
 epsilon
 
- Data Fields inherited from optimizer.optimizer.Optimizer
 learning_rate
 
 nums_trainable_ops
 

Detailed Description

Adam optimizer.

Definition at line 4 of file adam.py.

Constructor & Destructor Documentation

◆ __init__()

optimizer.adam.Adam.__init__ (   self,
  learning_rate = 0.001,
  beta1 = 0.9,
  beta2 = 0.999,
  epsilon = 1e-7 
)
Initialize the Adam optimizer.
Args:
    learning_rate (float): The learning rate for optimization.
    beta1 (float): Exponential decay rate for the first moment estimates.
    beta2 (float): Exponential decay rate for the second moment estimates.
    epsilon (float): Small constant to prevent division by zero.

Reimplemented from optimizer.optimizer.Optimizer.

Definition at line 8 of file adam.py.

8 def __init__(self, learning_rate=0.001, beta1=0.9, beta2=0.999, epsilon=1e-7):
9 """
10 Initialize the Adam optimizer.
11 Args:
12 learning_rate (float): The learning rate for optimization.
13 beta1 (float): Exponential decay rate for the first moment estimates.
14 beta2 (float): Exponential decay rate for the second moment estimates.
15 epsilon (float): Small constant to prevent division by zero.
16 """
17 super().__init__(learning_rate)
18 self.beta1 = beta1
19 self.beta2 = beta2
20 self.epsilon = epsilon

References optimizer.adam.Adam.__init__().

Referenced by optimizer.adam.Adam.__init__().

Field Documentation

◆ beta1

optimizer.adam.Adam.beta1

Definition at line 18 of file adam.py.

◆ beta2

optimizer.adam.Adam.beta2

Definition at line 19 of file adam.py.

◆ epsilon

optimizer.adam.Adam.epsilon

Definition at line 20 of file adam.py.


The documentation for this class was generated from the following file: