The lack of operational hierarchical structure in the Deep Learning ANN neural networks

A survey paper on the issues of Deep Learning by Gray Marcus: https://arxiv.org/ftp/arxiv/papers/1801/1801.00631.pdf The author has a valuable mix of expertise both in the ANN development and in linguistics, developmental psychology, cognitive psychology. There are good points on the lack of real hierarchical structure in (current/regular) DL/ANN, accenting that they are actually "flat", even though there are "layers" which gives a confusing impression. "To a linguist like Noam Chomsky, the troubles Jia and Liang documented...

Read More