GClasses
GClasses::GActivationRectifiedLinear Class Reference

The activation function for rectified linear units (ReLU). More...

#include <GActivation.h>

Inheritance diagram for GClasses::GActivationRectifiedLinear:
GClasses::GActivationFunction

Public Member Functions

virtual double center ()
 Returns 50.0. More...
 
virtual GActivationFunctionclone ()
 See the comment for GActivationFunction::clone. More...
 
virtual double derivative (double x)
 The derivative of the activation function. More...
 
virtual double halfRange ()
 Returns 50.0. More...
 
virtual double identityBias ()
 Returns 1.0. More...
 
virtual double identityDiag ()
 Returns 1.0. More...
 
virtual double inverse (double y)
 The inverse of the activation function. (This function may throw an exception if the activation function cannot be inverted.) More...
 
virtual const char * name () const
 Returns the name of this activation function. More...
 
virtual double squash (double x)
 The activation function. More...
 
- Public Member Functions inherited from GClasses::GActivationFunction
 GActivationFunction ()
 
virtual ~GActivationFunction ()
 
virtual double derivativeOfNet (double net, double activation)
 This computes the derivative of the net value. (Sometimes, such as with GActivationLogistic, it is more efficient to compute this from the activation value, so both are provided.) More...
 
GDomNodeserialize (GDom *pDoc) const
 Serialize this object. More...
 

Additional Inherited Members

- Static Public Member Functions inherited from GClasses::GActivationFunction
static GActivationFunctiondeserialize (GDomNode *pNode)
 Deserialize this object. More...
 

Detailed Description

The activation function for rectified linear units (ReLU).

Member Function Documentation

virtual double GClasses::GActivationRectifiedLinear::center ( )
inlinevirtual

Returns 50.0.

Implements GClasses::GActivationFunction.

virtual GActivationFunction* GClasses::GActivationRectifiedLinear::clone ( )
inlinevirtual
virtual double GClasses::GActivationRectifiedLinear::derivative ( double  x)
inlinevirtual

The derivative of the activation function.

Implements GClasses::GActivationFunction.

virtual double GClasses::GActivationRectifiedLinear::halfRange ( )
inlinevirtual

Returns 50.0.

Implements GClasses::GActivationFunction.

virtual double GClasses::GActivationRectifiedLinear::identityBias ( )
inlinevirtual

Returns 1.0.

Implements GClasses::GActivationFunction.

virtual double GClasses::GActivationRectifiedLinear::identityDiag ( )
inlinevirtual

Returns 1.0.

Implements GClasses::GActivationFunction.

virtual double GClasses::GActivationRectifiedLinear::inverse ( double  y)
inlinevirtual

The inverse of the activation function. (This function may throw an exception if the activation function cannot be inverted.)

Implements GClasses::GActivationFunction.

virtual const char* GClasses::GActivationRectifiedLinear::name ( ) const
inlinevirtual

Returns the name of this activation function.

Implements GClasses::GActivationFunction.

virtual double GClasses::GActivationRectifiedLinear::squash ( double  x)
inlinevirtual

The activation function.

Implements GClasses::GActivationFunction.