We gratefully acknowledge support from
the Simons Foundation and member institutions.

Neural and Evolutionary Computing

New submissions

[ total of 10 entries: 1-10 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Wed, 1 Dec 21

[1]  arXiv:2111.15250 [pdf, other]
Title: 2D-Motion Detection using SNNs with Graphene-Insulator-Graphene Memristive Synapses
Comments: Submitted to ISCAS 2022, 5 pages
Subjects: Neural and Evolutionary Computing (cs.NE)

The event-driven nature of spiking neural networks makes them biologically plausible and more energy-efficient than artificial neural networks. In this work, we demonstrate motion detection of an object in a two-dimensional visual field. The network architecture presented here is biologically plausible and uses CMOS analog leaky integrate-and-fire neurons and ultra-low power multi-layer RRAM synapses. Detailed transistorlevel SPICE simulations show that the proposed structure can accurately and reliably detect complex motions of an object in a two-dimensional visual field.

Cross-lists for Wed, 1 Dec 21

[2]  arXiv:2111.14916 (cross-list from eess.IV) [pdf]
Title: High-Speed Light Focusing through Scattering Medium by Cooperatively Accelerated Genetic Algorithm
Authors: Shu Guo (1 and 2), Lin Pang (1 and 2) ((1) College of Physics, Sichuan University, (2) LinOptx LLC)
Comments: 17 pages, 10 figures
Subjects: Image and Video Processing (eess.IV); Neural and Evolutionary Computing (cs.NE)

We develop an accelerated Genetic Algorithm (GA) system constructed by the cooperation of field-programmable gate array (FPGA) and optimized parameters of the GA. We found the enhanced decay of mutation rate makes convergence of the GA much faster, enabling the parameter-induced acceleration of the GA. Furthermore, the accelerated configuration of the GA is programmed in FPGA to boost processing speed at the hardware level without external computation devices. This system has ability to focus light through scattering medium within 4 seconds with robust noise resistance and stable repetition performance, which could be further reduced to millisecond level with advanced board configuration. This study solves the long-term limitation of the GA, it promotes the applications of the GA in dynamic scattering mediums, with the capability to tackle wavefront shaping in biological material.

[3]  arXiv:2111.14934 (cross-list from cs.GR) [pdf, other]
Title: GAN-CNMP: An Interactive Generative Drawing Tool
Comments: 9 pages, 10 figures
Subjects: Graphics (cs.GR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

Sketches are abstract representations of visual perception and visuospatial construction. In this work, we proposed a new framework, GAN-CNMP, that incorporates a novel adversarial loss on CNMP to increase sketch smoothness and consistency. Through the experiments, we show that our model can be trained with few unlabeled samples, can construct distributions automatically in the latent space, and produces better results than the base model in terms of shape consistency and smoothness.

[4]  arXiv:2111.15097 (cross-list from cs.CV) [pdf, other]
Title: EAGAN: Efficient Two-stage Evolutionary Architecture Search for GANs
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

Generative Adversarial Networks (GANs) have been proven hugely successful in image generation tasks, but GAN training has the problem of instability. Many works have improved the stability of GAN training by manually modifying the GAN architecture, which requires human expertise and extensive trial-and-error. Thus, neural architecture search (NAS), which aims to automate the model design, has been applied to search GANs on the task of unconditional image generation. The early NAS-GAN works only search generators for reducing the difficulty. Some recent works have attempted to search both generator (G) and discriminator (D) to improve GAN performance, but they still suffer from the instability of GAN training during the search. To alleviate the instability issue, we propose an efficient two-stage evolutionary algorithm (EA) based NAS framework to discover GANs, dubbed \textbf{EAGAN}. Specifically, we decouple the search of G and D into two stages and propose the weight-resetting strategy to improve the stability of GAN training. Besides, we perform evolution operations to produce the Pareto-front architectures based on multiple objectives, resulting in a superior combination of G and D. By leveraging the weight-sharing strategy and low-fidelity evaluation, EAGAN can significantly shorten the search time. EAGAN achieves highly competitive results on the CIFAR-10 (IS=8.81$\pm$0.10, FID=9.91) and surpasses previous NAS-searched GANs on the STL-10 dataset (IS=10.44$\pm$0.087, FID=22.18).

[5]  arXiv:2111.15099 (cross-list from cs.LG) [pdf, other]
Title: Trust the Critics: Generatorless and Multipurpose WGANs with Initial Convergence Guarantees
Comments: 20 pages, 8 figures
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC)

Inspired by ideas from optimal transport theory we present Trust the Critics (TTC), a new algorithm for generative modelling. This algorithm eliminates the trainable generator from a Wasserstein GAN; instead, it iteratively modifies the source data using gradient descent on a sequence of trained critic networks. This is motivated in part by the misalignment which we observed between the optimal transport directions provided by the gradients of the critic and the directions in which data points actually move when parametrized by a trainable generator. Previous work has arrived at similar ideas from different viewpoints, but our basis in optimal transport theory motivates the choice of an adaptive step size which greatly accelerates convergence compared to a constant step size. Using this step size rule, we prove an initial geometric convergence rate in the case of source distributions with densities. These convergence rates cease to apply only when a non-negligible set of generated data is essentially indistinguishable from real data. Resolving the misalignment issue improves performance, which we demonstrate in experiments that show that given a fixed number of training epochs, TTC produces higher quality images than a comparable WGAN, albeit at increased memory requirements. In addition, TTC provides an iterative formula for the transformed density, which traditional WGANs do not. Finally, TTC can be applied to map any source distribution onto any target; we demonstrate through experiments that TTC can obtain competitive performance in image generation, translation, and denoising without dedicated algorithms.

[6]  arXiv:2111.15296 (cross-list from cs.AR) [pdf, other]
Title: BrainScaleS Large Scale Spike Communication using Extoll
Comments: 3 pages, 2 figures, submitted to the Neuro Inspired Computational Elements 2020 (NICE'2020) conference, accepted and presented as a poster in March 2021
Subjects: Hardware Architecture (cs.AR); Neural and Evolutionary Computing (cs.NE); Networking and Internet Architecture (cs.NI)

The BrainScaleS Neuromorphic Computing System is currently connected to a compute cluster via Gigabit-Ethernet network technology. This is convenient for the currently used experiment mode, where neuronal networks cover at most one wafer module. When modelling networks of larger size, as for example a full sized cortical microcircuit model, one has to think about connecting neurons across wafer modules to larger networks. This can be done, using the Extoll networking technology, which provides high bandwidth and low latencies, as well as a low overhead packet protocol format.

Replacements for Wed, 1 Dec 21

[7]  arXiv:2012.01867 (replaced) [pdf, ps, other]
Title: Computational characteristics of feedforward neural networks for solving a stiff differential equation
Subjects: Neural and Evolutionary Computing (cs.NE)
[8]  arXiv:2103.15413 (replaced) [pdf, ps, other]
Title: Collocation Polynomial Neural Forms and Domain Fragmentation for solving Initial Value Problems
Subjects: Neural and Evolutionary Computing (cs.NE)
[9]  arXiv:2105.02944 (replaced) [pdf, ps, other]
Title: Semantics in Multi-objective Genetic Programming
Comments: 30 pages, 4 figures, 10 tables, journal article
Subjects: Neural and Evolutionary Computing (cs.NE)
[10]  arXiv:1810.02244 (replaced) [pdf, other]
Title: Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks
Comments: Extended version with proofs, accepted at AAAI 2019, added units of measurement of QM9 dataset into appendix, removed results from Wu et al., 2018 due to different units
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)
[ total of 10 entries: 1-10 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2111, contact, help  (Access key information)