Hardswish

class torch.nn.modules.activation.Hardswish(inplace=False)

Applies the Hardswish function, element-wise.

Method described in the paper: Searching for MobileNetV3.

Hardswish is defined as:

$$\text{Hardswish}(x)=\{\begin{array}{ll}0& \text{if }x\le -3,\\ x& \text{if }x\ge +3,\\ x\cdot (x+3)/6& \text{otherwise}\end{array}$$

Parameters

inplace (bool) – can optionally do the operation in-place. Default: False

Shape:

• Input: $(\ast )$, where $\ast$ means any number of dimensions.

• Output: $(\ast )$, same shape as the input.

Examples:

>>> m = nn.Hardswish()
>>> input = torch.randn(2)
>>> output = m(input)

forward(input)

Runs the forward pass.

Return type

Tensor