Hardware efficient, neuromorphic dendritically enhanced readout for liquid state machines
Date of Issue2013
IEEE Biomedical Circuits and Systems Conference (BioCAS) (2013 : Rotterdam, the Netherlands)
School of Electrical and Electronic Engineering
In this article, we describe a new neuro-inspired, hardware-friendly readout stage for the liquid state machine (LSM) that is suitable for on-sensor computing in resource constrained applications. Compared to the state of the art parallel perceptron readout (PPR), our readout architecture and learning algorithm can attain better performance with significantly less synaptic resources making it attractive for VLSI implementation. Inspired by the nonlinear properties of dendrites in biological neurons, our readout stage incorporates neurons having multiple dendrites with a lumped nonlinearity (two compartment model). The number of synaptic connections on each branch is significantly lower than the total number of connections from the liquid neurons and the learning algorithm tries to find the best `combination' of input connections on each branch to reduce the error. Hence, the learning involves network rewiring (NRW) of the readout network similar to structural plasticity observed in its biological counterparts. We show that even while using binary synapses, our method can achieve 2.4 - 3.3 times less error compared to PPR using same number of high resolution synapses. Conversely, PPR requires 40-60 times more synapses to attain error levels comparable to our method.
DRNTU::Engineering::Electrical and electronic engineering
© 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: [http://dx.doi.org/10.1109/BioCAS.2013.6679699].