Are training trajectories of deep single-spike and deep ReLU network equivalent?

For the first time we demonstrate training of time-to-first-spike SNNs to equivalent accuracies to ReLU networks and following equivalent gradient descent trajectories.