Record-SWaP Photonic Cognitive System: Photonic Tensor Cores for Spacecraft & Autonomous Systems Data Processing

Smaller matrix multiplication for less complex inference tasks are still challenged by a non-negligible latency predominantly due to the access overhead of the various memory hierarchies and the latency in executing each instruction in the GPU. Given this context of computational hardware for obtaining architectures, it is necessary to explore and reinvent the operational paradigms of current computing platforms when performing matrix algebra, by replacing sequential and temporized operations to memory, with massively parallelized distributed analog dynamical units, towards delivering efficient post-CMOS devices and systems summarized as non-von Neumann architectures. Within this paradigm shift the lsquo;waversquo; nature of light and related inherent operations, such as interference and diffraction, enable seamless mathematical nbsp;operations (e.g. multiplication) to be executed in the optical domain. Hence, photonic processors can play a major role in enhancing computational throughput and concurrently reducing the power consumption of neuromorphic platform.Future technologies should perform computing tasks in the domain in which their time varying input signals lay, thus exploiting and leveraging their intrinsic physical operations.nbsp;There are 3 key innovationsnbsp; that we are considering combining in this PTC AI system, these include the (1) PTC architecture itself, which allows for a modular and scale design and incorporates multiplexing schemes such as WDM offered in photonics [Sorger Appl. Phys. Rev. 2020],nbsp;(2) Photonic nonvolatile but programmable memory (P-RAM), allowing to re-write the B-matrix of the VMM or, exemplary, the kernel of a CNN. The nonvolatility and retention of state in the photonic system allows for compute-in-memory functionality, thus bypassing the memory-access bottlenecks known in Van-Neumann architectures. And (3) If the data entering the PTC happens to be electronic and digital, then DAC is needed such as a photonic parallel binary-weighted DAC.nbsp;