SBIR Phase II: SSD In-Situ Processing

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase II project will be to fundamentally change what a storage device can do, and give storage a third capability that is not addressed by existing storage technology - the ability to actually process user data. For the computation to take place, only the computational request and the resulting data need to transfer over the storage interface, reducing interface traffic and the required power. The advent of Big Data and the increasing use of Hyperscale Server technology have resulted in the creation of an additional storage tier that is different from traditional enterprise storage. This new tier requires significantly larger capacity yet lower cost, lower operating power, and yet must still exhibit enterprise level reliability. This combination of characteristics cannot be serviced by existing technologies, and execution with large data sets typical of Big Data results in inefficient solutions. The information being stored represents the large, unstructured data mined by today's companies for key information and trends that help dictate corporate direction, advertising, and monetization. Future applications include machine learning for video analytics, genome sequencing and enabling Fog Storage and Fog Computing, among others. This Small Business Innovation Research (SBIR) Phase II project explores the Big Data paradigm shift where processing capability is pushed as close to the data as possible. The In-Situ processing technology pushes this concept to the absolute limit, by putting the computational capability directly into the storage itself and eliminating the need to move data to main memory before processing. The technology innovation begins with a solid foundation of an enterprise SSD tailored for the needs of modern Data Centers. Key technology that will be added to support these capabilities include hardware-assisted quality of service control, low-cost 3D-TLC and QLC NAND Flash enablement through the use of advanced ECC, and a proprietary elastic Flash Translation Layer to support extremely large capacity drives. The final element added to this foundation will be the ability to perform computation directly on the data with the addition of specialized In-Situ processing aided by hardware accelerators.