nuroko.module

Class Sparsifier

java.lang.Object

nuroko.module.AComponent

nuroko.module.Sparsifier

All Implemented Interfaces:

Cloneable, Iterable<IComponent>, IComponent, IFunction<mikera.vectorz.AVector,mikera.vectorz.AVector>, IInput, IInputOutput, IInputState, IModule, IOutput, IOutputState, IParameterised, ISynthesiser, IThinker, ITrainable

public class Sparsifier
extends AComponent

Field Summary

Fields

Modifier and Type	Field and Description
protected mikera.vectorz.Vector	input
protected mikera.vectorz.Vector	inputGradient
protected mikera.vectorz.Vector	output
protected mikera.vectorz.Vector	outputGradient

Constructor Summary

Constructors

Constructor and Description
Sparsifier(int length, double targetMean, double weight)
Sparsifier(int length, double targetMean, double weight, double meanLearnRate)

Method Summary

Methods

Modifier and Type	Method and Description
Sparsifier	clone() Creates a clone of a module, including a deep copy of any mutable state.
List<IComponent>	getComponents()
mikera.vectorz.AVector	getGradient() Return an AVector referencing the accumulated gradient in this model
mikera.vectorz.Vector	getInput()
mikera.vectorz.Vector	getInputGradient()
IInputState	getInputState()
mikera.vectorz.Vector	getOutput()
mikera.vectorz.Vector	getOutputGradient()
mikera.vectorz.AVector	getParameters() Return an AVector referring to the parameters in the model.
boolean	hasDifferentTrainingThinking()
void	setInput(mikera.vectorz.AVector input)
void	thinkInternal() Thinks within the scope of the component.
void	trainGradientInternal(double factor) Abstract method for training gradients.

Methods inherited from class nuroko.module.AComponent

applyConstraints, applyConstraintsInternal, generate, generate, getComponent, getConstraints, getDefaultLossFunction, getDownStack, getInputLength, getLearnFactor, getModules, getOutputLength, getParameterLength, getUpStack, initRandom, isStochastic, isSynthesiser, iterator, setConstraint, setLearnFactor, setOutput, think, think, thinkInternalTraining, topComponent, train, train, trainSynth, trainSynth

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

input

protected final mikera.vectorz.Vector input

inputGradient

protected final mikera.vectorz.Vector inputGradient

output

protected final mikera.vectorz.Vector output

outputGradient

protected final mikera.vectorz.Vector outputGradient

Constructor Detail

Sparsifier

public Sparsifier(int length,
          double targetMean,
          double weight)

Sparsifier

public Sparsifier(int length,
          double targetMean,
          double weight,
          double meanLearnRate)

Method Detail

thinkInternal

public void thinkInternal()

Description copied from interface: IComponent

Thinks within the scope of the component. Updates component's output.

hasDifferentTrainingThinking

public boolean hasDifferentTrainingThinking()

getParameters

public mikera.vectorz.AVector getParameters()

Description copied from interface: IParameterised

Return an AVector referring to the parameters in the model. Expected to be mutable.

Returns:

getGradient

public mikera.vectorz.AVector getGradient()

Description copied from interface: IParameterised

Return an AVector referencing the accumulated gradient in this model

Returns:

trainGradientInternal

public void trainGradientInternal(double factor)

Description copied from class: AComponent

Abstract method for training gradients. Assumes use of the current activation states for all inputs/outputs. Should overwrite inputGradient, and adjust gradient for all parameters. Should apply own internal learn rate factor

Specified by:

trainGradientInternal in interface IComponent

Specified by:

trainGradientInternal in class AComponent

clone

public Sparsifier clone()

Description copied from interface: IModule

Creates a clone of a module, including a deep copy of any mutable state.

Specified by:

clone in interface IComponent

Specified by:

clone in interface IModule

Specified by:

clone in interface IParameterised

Specified by:

clone in interface ISynthesiser

Specified by:

clone in interface IThinker

Specified by:

clone in interface ITrainable

Overrides:

clone in class AComponent

Returns:

getInputState

public IInputState getInputState()

Specified by:

getInputState in interface IComponent

Overrides:

getInputState in class AComponent

getInput

public mikera.vectorz.Vector getInput()

getOutput

public mikera.vectorz.Vector getOutput()

getOutputGradient

public mikera.vectorz.Vector getOutputGradient()

setInput

public void setInput(mikera.vectorz.AVector input)

Specified by:

setInput in interface IInputState

Overrides:

setInput in class AComponent

getInputGradient

public mikera.vectorz.Vector getInputGradient()

getComponents

public List<IComponent> getComponents()