Great article Devansh! I for one appreciate the work you put in. I agree 100% that the path forward is structure/architecture/specialization. Look how nature has modelled brains through evolution- this is so obvious- why do we insist on forcing intelligens into low structure backprop NN’s? For a single example of where structure absolutely outperforms LLM’s in forecasting (a rigorous test of “intelligence”)- check out some papers I wrote at: http://www.itrac.com/EGM_Document_Index.htm
Someday I hope to better understand this. Thanks for opening the path.
Great article Devansh! I for one appreciate the work you put in. I agree 100% that the path forward is structure/architecture/specialization. Look how nature has modelled brains through evolution- this is so obvious- why do we insist on forcing intelligens into low structure backprop NN’s? For a single example of where structure absolutely outperforms LLM’s in forecasting (a rigorous test of “intelligence”)- check out some papers I wrote at: http://www.itrac.com/EGM_Document_Index.htm