THE SACRED COMPUTER - СВЕЩЕНИЯТ СМЕТАЧ, a.k.a. ARTIFICIAL MIND: Thinking Machines, Creativity and Human Development. A pioneering virtual Research Institute for Artificial General Intelligence (AGI), Cosmism and Transhumanism, AI, Software, Interdisciplinary General Research, Creativity, Versatility, Universal Men ~ Twenkids etc. Created in 2000. (...)
На SIGI-2026 публикувах поредната версия на "Първата стратегия" - допълнено издание (от 256 до 283 стр. като подбирам още материал за следващата версия.
Пускам го като нов файл: Purvata_Strategiya_UIR_AGI_2003_Arnaudov_SIGI-2026.pdf
Реших да направя това издание след като се сетих за един въпрос, бележка под линия, за цената на "Витоша" (1961-1963 - през 1962 се извършва деноминация), и най-вече като препрочитах основния том на "Пророците" и писмата ми до Христо Крушков и др., докато работя и по неговото ново коригирано издание, а по-късно може би и допълнено през 2026 г.
Осъзнах, че множество писма и други статии и документи от началото и средата на 2000-те, вече публикуани в Основни том, в "Кратка хронология", "Подробна хронология ..." имат място и вна по-"прегледно" и "видно" място в "Първата стратегия", защото подсилват по още по-"графичен" начин вече дадените доказателства. В Основния том някои са във въведенията, но други са след 1600-та страница в подробната хронология.
Преписвайте тази историйца и пазете я да не изчезне!
Github:
Разширено издание от 28.6.2026 г. - 283 с.
Много допълнения спрямо предната версия от 9.6.2026 г.* Вече 283 стр. (от 256, +27). Много добавени писма от Основния том на Пророците: "5. Продължения на първата стратегия с конкретни научни и приложни насоки, публикувани между 12.2004 – 2.2008 г.: Вселена и Разум 5; Как двама всестранни младежи предвидиха пораждащия изкуствен интелект и принципа на работа на преобразителите между 2002 и 2005 г. – из писма между Илиян Георгиев и Тодор от януари-февруари 2005 г. Писма до Христо Крушков с повече обяснения и подробности от 11.2007 г.; писмо до Атанас Чанев от 12.2007; „Smarty – най-интелигентният речник в света“, 5.2007. Статията с дейностите и плановете ми от блог Изкуствен Разум от 2.2008 г.: „Творчески планове - какво правя, искам да правя, мисля си че правя... Частици от тях...“ . Коментар от 8.2008 г. за “Автоматична програмираща интелигентност“. Виж и писма до Людмила от 12.2007 г. в послеписа."
* В сравненията с Хасабис - включен още един откъс от писмото до А.Чанев.
* Бележка за деноминацията от 1962 г. относно бюджета на "Витоша" от 1.5 - 3 млн. (но неуточнено преди или след деноминацията 1:10).
Повече от статията "Творчески планове" ... добавяне на бел. че книгата е и на SIGI-2026.
* В изданието от 28.6.2026 включвам повече текст от началото на статията, където споменавам изрично „интелигентните асистенти“.
* Изследователската група в Уулвърхамптън, основана от Руслан Митков през 1995 г. http://clg.wlv.ac.uk/ (вече не е достъпен):
* Как работи разумът? Йерархичен самоорганизиращ се предсказател на бъдещето – научно представление .. - повече информация за събитието в ТУ София 2009 г.
(...)
* Версията от 9.6.2026 г. беше качена на SIGI-2025 и twenkid.com/agi
Yann Lecun cites a post, which is acknowledging that his ideas were correct etc.
A part of the concluding punch lines:
* It is "dime a dozen", but people decades older than me who *literally* repeated and ripped-off my suggestions, [strategy, plans, principles, theories, directions, conclusions, thoughts ...] and observations decades later, got prized with billions to *waste* and I am not even mentioned. They did it even in my own country, where one Bulgarian-Canadian became an "architect" of an institute in Sofia, with statements which were a *20 years late rip-off* of the above-cited essay, which were sold as "innovative" and ground-breaking :))), "for the first time in Eastern Europe" etc.
* As of "Dime a dozen"--> yes, or even "Five a dozen" --> The current "supercomputer" of my lab is called "PETAK I", where"Pet" means "5": from: 1. "Pentium" (historically the CPU and brand on which TUM was created), 2. The CPUs of all nodes: Core i5 (all old ones, 11-14 years old models, LOL); 3. Five nodes of the cluster (the initial full configuration) 4. A parody CPU-name from a science fiction work from 2004 from that theory ("Pentium 5"; "Петият Петак") and 5. In Bulgarian it also means "5 cents"... LMAO
Yann LeCun may have been right about something important: next-token and next-pixel prediction are probably not the most efficient path to real world understanding.
For years, the industry has been scaling generative models under the assumption that bigger models, more data, and more compute would eventually produce deeper intelligence. LeCun has been arguing the opposite: predicting every word or every pixel forces models to spend huge amounts of compute on surface details instead of learning the underlying structure of reality.
That’s the core idea behind JEPA (Joint-Embedding Predictive Architecture): instead of reconstructing the world pixel by pixel, learn a compact latent representation and predict what happens next inside that space.
The problem is that these models have historically been unstable. They suffer from “representation collapse,” where the latent space becomes too simple to carry useful information unless you add complex training tricks, auxiliary losses, or frozen components.
A new paper, LeWorldModel (LeWM), shows a much cleaner approach. It trains end-to-end from raw pixels using only two losses: a next-embedding prediction loss and a Gaussian regularizer on the latent space. This drastically simplifies the training setup compared to prior approaches.
The efficiency gains are striking. The model has around 15 million parameters, trains on a single GPU in a few hours, and can plan up to 48× faster than larger foundation-model-based world models, while staying competitive on several 2D and 3D control tasks. Its latent space also appears to capture meaningful physical structure and can detect physically implausible events in controlled environments.
This doesn’t mean generative AI is a dead end. LLMs remain extremely powerful. But it does reinforce a key technical point: for world modeling and physical reasoning, predictive latent-space approaches may be far more compute-efficient than brute-force generation.
The real shift might be this: not models that generate everything, but models that understand enough of the world to predict what actually matters."""
From the books "The First modern AI Strategy ..."... and "Stack Theory is Yet another fork of Theory of Universe and Mind" published at SIGI-2025
This idea, together with the prediction and next-token prediction (but in multi-scale, multi-precision hierarchy of resolutions of causality-control and perception), was published and explained nearly 25 years ago in Theory of Universe and Mind and presented during the world's first university courses in AGI in 2010 and 2011. Y.Bengio also rediscovered it 2017-2018 (Consciousness prior) and his example is almost literary repetition of an introductory definition from a treatise published about 14 years earlier. The author was a teenager, LOL.
Yann LeCun:
@Todor Arnaudov as I pointed out on another platform, ideas are a dime a dozen. The hard part, for something like this, is to implement it and to make it work.
The whole idea of hierarchical representations and learning by prediction is very old.
But learning hierarchies of representations didn't really work until convolutional nets were shown to do it in the late 1980s and more forcefully in the early 2010s (this took a while).
=== Todor Arnaudov:
Hi, first thanks for your answer as I didn't expect this honor. I don't disagree that there were earlier "prophets", I recently published a hyperbook with a related name (nearly 5000 pages in total), where one of the intros in one of the sections with collectons of related, prior and later work is a citation from the Holy Bible: "There is nothing new under the Sun"
Some of the prior work doesn't get enough credit and is unknown, even the "fellow AI historian" Schmidhuber doesn't mention them, e.g. the Soviet lab of Bongard and his colleagues etc. (E.g. once I caught Chollet literary restating insights from the 1967 book "Проблема узнавания" - perhaps he didn't know; he also rediscovers definitions for general intelligence of mine, published in 2001 (he couldn't know about it) - see the link at the end and the reviews of the LLMs).
The Bible is called "The Prophets of the Thinking Machines: Artificial General Intelligence & Transhumanism: History, Theory and Pioneers; Past, Present and Future", SIGI-2025 - and yes, almost nobody will bother to even open it. :))
BTW, e.g. IMO your PhD student Marc’Aurelio Ranzato deserves more credit for his pioneering work in DL and his insights (which perhaps [are] ~ also yours) -- his work is credited in my historical collections here: https://twenkid.com/agi/Lazar_The_Prophets_of_the_Thinking_Machines_20-8-2025.pdf ~p.21.
I do agree that I had to push to implementations immediately (not your type of NNs though) and perhaps my claims would be accepted after I implement them all by myself (Or if I or somebody else had - 20 years ago with no collaborators or any funding, no mechanical Turks to labe a gazillion of data and computing iterations, compared to 20 years later and all the collected resources in all senses of the word: i.e. IMO the difficulty of the implementation is supposed to decrease and be "discounted" with time like in RL; an idea 25 or 50 years ago may end up more "valuable" than an implementation in the present - see generative AI and the final citation below)
* I know about your dismissive opinion about "ideas", e.g. your comments to Schmidhuber's recent challenge, that you also could find ideas in your unpublished notes or something etc. and I've listened to your answers to him since 2022, "The path towards autonomous AI..." - I remember you defended yourself with referring to Optimal Control etc.
However many works are proposals, theoretical etc. but still get recognized, while other prior ones - don't and are even "humiliated". Also the core novelty there in my reading of the paper was also matching the mentioned TUM (and too general, it was not an implementation too); in general it looked like another cognitive architecture, which were popular in the cognitive science and the AGI community decades earlier, perhaps I have to reread it.
* I understand that if you dismiss even the German, who is at a comparable status as yours or, say he has more ground to be believed that he is, then you (and almost anyone) wouldn't recognize the claimed "priority" or even just the "contribution" of some obscure "self-proclaimed" "crank" or the mentioned theory, no matter the evidence (maybe you wouldn't even bother to check any evidence or count it as "theory" or anything).
BTW, your recent work about the brain/humans as "not general ..." also matches and is closely related to my prior work/accounts, beginning in early 2000s, however with different interpretation of the observations. The limitations don't deny the concept of general intelligence and the possibility of general principles and modules (prediction-compression etc.) I may address the correspondences in a paper.
* Stack Theory is yet another Fork of Theory of Universe and Mind, SIGI-2025
* The first modern AI strategy was published by an 18-year old in 2003 and repeated and implemented by the whole world 15-20 years later: Bulgarian Prophecies: How would I invest one million for the greatest benefit for the development of my country?https://twenkid.com/agi/Purvata_Strategiya_UIR_AGI_2003_Arnaudov_SIGI-2025_31-3-2025.pdf (Bongard, 1967 vs Chollet,2024 p.169-170)
* BTW, cheers from Kyuchuk Paris- that's the district in the city of Plovdiv, where TUM was created. 🙂
* This is the world's first modern "AI strategy", 2003, repeated and implemented by "the whole world" 15-20 years later: https://twenkid.com/agi/proekt.htm
* It is "dime a dozen", but people decades older than me who *literaly* repeated and ripped-off my suggestions and observations decades later, got prized with billions to *waste* and I am not even mentioned. They did it even in my own country, where one Bulgarian-Canadian became an "architect" of an institute in Sofia, with statements which were a *20 years late rip-off* of the above-cited essay, which were sold as "innovative" and ground-breaking :))), "for the first time in Eastern Europe" etc.
* As of "Dime a dozen"--> yes, or even "Five a dozen" --> The current "supercomputer" of my lab is called "PETAK I", where "Pet" means "5": from: 1. "Pentium" (historically the CPU and brand on which TUM was created), 2. The CPUs of all nodes: Core i5 (all old ones, 11-14 years old models, LOL); 3. Five nodes of the cluster (the initial full configuration) 4. A parody CPU-name from a science fiction work from 2004 from that theory ("Pentium 5") and 5. In Bulgarian it also means "5 cents"... LMAO
Also as I predicted in 2013 (counterintuitive to all "experts" up to just a few years ago, I namely wrote this article *because* of clueless "experts" predicted the opposite; they were later cited thousands of times for their *WRONG* world-model and wrong predictions):
"Creative Intelligence will be First Surpassed and Blown Away by the Thinking Machines, not the "low-skill" workers whose jobs require agile and quick physical motion and interactions with human-sized and human-shaped environment"
" (...) For the intellectual jobs - it's much easier to pick a computer, run the appropriate software or connect it to the service,
and get it thinking - you already have decent cameras, microphones and many sensors even in smartphones. (...) The bottom line is that the "white collars" are more endangered in current-time economy. Perhaps that kind of economy could hardly survive the AGI revolution. I guess it may turn upside down for a while - the low-skill workers could get higher pay, because intellectual activities will be done in 1 ms for free... 😉 We, the smart guys (the smart asses, see "Super Smartasses" the graphical series ) wouldn't be needed by anyone... Not that we are needed now. :))"
* The prediction of the generative AI (however it could have been created by the late 2000s-early 2010s - it came *too late*, not too quick as Hinton and Bengio "complain"; not with gradient-descent of course):
-- Creativity is Imitation at the Level of Algorithms - An outline sketch of a possible path of development of the Artificial Intelligence "Emil"
Read the latest corrected edition of the volume "Lazar", about 130 pages, consisting of an enormous survey and summary of many fields of AI and AGI, historical and recent.
Other updates may be published soon with more narrative introductions, summaries and conclusions. Download fromhttps://twenkid.com/agi and the Github page of the virtual conference Thinking Machines 2025/Self-Improving General Intelligence 2025 (SIGI-2025):
Lots of Papers:In AI, ML, CV, ANN, DL,
… throughout history, classical 1950s,
1960s, 1970s, 1980s, 1990s, 2000s, early 2010s to 2020s. Computer
Vision, Reinforcement Learning,
Program Synthesis. Lifelong Learning, Human-Computer Interaction, Mixed
Initiative Interfaces (Agentic Systems); Evolutionary
programming, Genetic Algorithms, Self-improving agents; Speech Synthesis,
Speech Recognition, Audio Generation etc.Groundbreaking or important
researchers or related to the flow and context of the reviewed topics; and a few Bulgarian
researchers who participated in some of the works. * Lifelong Learning, Continual Learning,
Reinforcement Learning (historical Q-Learning, modern Deep Q-Learning: Atari
DeepMind …), RL for LLMs, policy optimizations (DPO, PPO, OREO) … Conditional
Random Fields (CRF); Chain-of-Thought prompting … *
Survey of other techniques and research in computer vision, preceding the explosion of the application of
convolutional neural networks after 2012: DBN, RBM, MRF, SIFT etc.
*
Survey on Early Deep Learning architectures and Normalizations; seminal papers
and PhD theses by pioneers in DL from the schools of LeCun, Hinton, Bengio:
M.Ranzato, V.Mnih, A.Krizhevsky, I.Sutskever, A.Mohamed …
* Survey of Object Recognition and
Classification before Deep Learning
*
Selected Computer Vision works from 1960s to 2020s
*
Exploration and introduction of concepts and techniques in computer vision,
machine learning, neural networks
* Mixed-Initiative Interaction (Agentic Systems)
* Audio: Speech Synthesis, Audio Generation,
Speech Recognition; from 1980s to 2010s
* Neural Machine Translation, Language Models,
LLMs, Text Generation, Text and Language Learning and Representation,
Word-Embedding
*
Alternative approaches for sequence and next words prediction, instead of
neural networks: stochastic memorizer, sequence memorizer* Transformers - the
seminal paper from 2017
* Transformer architectures for images and for
reducing the quadratic complexity
*
Neural Program Synthesis
* Transformer architectures for images and for
reducing the quadratic complexity
* Evolutionary Algorithms | Genetic Algorithms |
Genetic Programming * Genetic Programming, Genetic
Algorithms, Evolutionary Programming: Part II
*
Summary
and selection of important concepts in Evolutionary Algorithms | Genetic
Algorithms | Genetic Programming etc.
