Title: Complex Sparse Code Priors Improve the Statistical Models of Neurons in Primate Primary Visual Cortex

Abstract: System identification techniques---projection pursuit regression models (PPR) and convolutional neural networks (CNNs)---provide state-of-the-art performance in predicting visual cortical neurons' responses to arbitrary input stimuli. However, the constituent kernels recovered by these methods, particularly those of CNNs, are often noisy and lack coherent structure, making it difficult to understand the underlying component features of a neuron's receptive field. In this paper, we show that using a dictionary of complex sparse codes, which are learned from natural scenes based on efficient coding theory, as the front-end for PPR and CNNs can improve their performance in neuronal response prediction. More importantly, this approach makes the constituent kernels of these models substantially more coherent and interpretable. Extensive experimental results also indicate that these interpretable kernels provide important information on the component features of a neuron's receptive field. In addition, we find that models with a complex sparse code front-end are significantly better than models with a standard orientation-selective Gabor filter front-end for modeling V1 neurons that have been found to exhibit complex pattern selectivity. This observation adds further credence to the sparse coding theory as well as empirical findings of complex feature selectivity in V1.