Wenqi Gu

From Transformer to Transponder: Introducing Contextual Modulation Training for Residual Learning in LLMs

Conversion of sparse Artificial Neural Network to sparse Spiking Neural Network can save up to 99% of energy