Skip to content

← deep_learning package

AdditiveNoiseStep

Chainable step that adds Gaussian noise to the gradients.

This can improve convergence and mitigate overfitting in some deep networks. Version 0.2.0

Ports/Properties

gradients

Gradients to be transformed.

verbose name
Gradients
default value
None
port type
DataPort
value type
object (can be None)
data direction
INOUT

weights

Optional current weights.

verbose name
Weights
default value
None
port type
DataPort
value type
object (can be None)
data direction
IN

state

Explicit state of the node.

verbose name
State
default value
None
port type
DataPort
value type
object (can be None)
data direction
INOUT

eta

Initial variance for the Gaussian noise added to gradients.

verbose name
Eta
default value
0.01
port type
FloatPort
value type
float (can be None)

gamma

A parameter controlling the annealing of noise over time, the variance decays according to (1+t)^-gamma.

verbose name
Gamma
default value
0.55
port type
FloatPort
value type
float (can be None)

seed

A seed for the pseudo-random number generation.

verbose name
Seed
default value
12345
port type
IntPort
value type
int (can be None)

set_breakpoint

Set a breakpoint on this node. If this is enabled, your debugger (if one is attached) will trigger a breakpoint.

verbose name
Set Breakpoint (Debug Only)
default value
False
port type
BoolPort
value type
bool (can be None)

metadata

User-definable meta-data associated with the node. Usually reserved for technical purposes.

verbose name
Metadata
default value
{}
port type
DictPort
value type
dict (can be None)