ReLU soothes the NTK condition number and accelerates optimization for wide neural networks. - Chaoyue Liu 010; Like Hui (CoRR, 2023)