TensTorrent and Cerebras - Novel Advanced Computer Architectures for Deep Learning/Neural Networks Training

Interesting systems to check:TensTorrent Startup: https://www.tenstorrent.com/technology/Their architecture offers more independent parallelism of the cores than the current GPUs/TPUs, or as they express it: "Fully programmable architecture that supports fine-grain conditional execution, dynamic sparsity handling, and an unprecedented ability to scale via tight integration of computation and networking"Cerebras Systems: Building the World’s First Wafer-Scale Processorhttps://youtu.be/LiJaHflemKUAn amazing hugely-multi-core...

Read More