The nonlinear activation function is essential for deep learning models to learn to solve complex tasks. In optical neural networks, these parts are ideally implemented in the photonic domain as well.