SinusoidalPositionalEncoding class
Properties
-
embedDim
→ int
-
final
-
hashCode
→ int
-
The hash code for this object.
no setterinherited
-
runtimeType
→ Type
-
A representation of the runtime type of the object.
no setterinherited
-
training
↔ bool
-
Whether this module is in training mode. Layers that behave
differently between training and inference (e.g.
Dropout) read
this flag in their call method. Defaults to training mode.
getter/setter pairinherited
Methods
-
call(Tensor x, {int startPos = 0})
→ Tensor
-
Adds sinusoidal PE to
x. Accepts [seqLen, embedDim] or a
batched [batch, seqLen, embedDim]. startPos is the position
of the first row of x (used by autoregressive / cached
inference so that a single new token gets the encoding for its
true position rather than position 0).
-
eval()
→ void
-
Put this module (and any registered submodules) into evaluation mode.
inherited
-
noSuchMethod(Invocation invocation)
→ dynamic
-
Invoked when a nonexistent method or property is accessed.
inherited
-
parameters()
→ List<Tensor>
-
Trainable tensors owned by this module (and its submodules).
override
-
submodules()
→ List<Module>
-
Submodules owned by this module. Subclasses that compose other
modules should override this so
train() / eval() propagate.
Default: empty.
inherited
-
toString()
→ String
-
A string representation of this object.
inherited
-
train()
→ void
-
Put this module (and any registered submodules) into training mode.
inherited
-
zeroGrad()
→ void
-
Zero every parameter's gradient. Safe to call before each
backward.
inherited
