Saturday, April 24, 2010

// // 4 comments

Learned or Innate? Nature or Nurture? Speculations of how a mind can grasp on its own: animate/inanimate objects, face recognition, language...

Some possible explanations of mine. Български - като го преведа... :)

Nativists:

Babies early can make a difference between animate and inanimate objects etc...

Todor:

They can, because the difference is easy to extract from the raw sensory inputs:

Inanimate objects are:

- Static. E.g. places which seem to drive "place cells" in mammal's brain are simpler stimuli than stimuli caused by "animate" objects.
- Dynamic, but mind can predict their future with a precision that it believes is "high enough". E.g. when one throws a ball, he doesn't know where exactly it will fall, but the ball wouldn't fly at all if an animate object didn't throw it.
- They change in parallel with the will, in pair with the motor commands.
- Linear (generally).
- Places are immovable inanimate objects. 

An object is a set of correlated stimuli.

"Animate" objects or subjects with "free will":

-  Their future cannot be predicted with high enough precision and one cannot predict precisely enough their behavior based only on observations. Sometimes they are totally unpredictable.
- They can start to do a sequence of actions on their own, a behavior. 
- They can react to your action, without being physically affected/touched.
- Mind can assume that there are internal states, which are unobservable. This is the inanimate object's "free will" or  its "state of mind", opinion etc., as opposed to predictable entities, whose state is observable.
- Non linear.
- It's hard to synchronize your will with the will of another "animate objects", or to do so you need to do a complex sequence of voluntary actions. 

Where "high enough" precision is a value that mind decides. 

Recognition of faces

A baby can easily spot that this is an entity that changes the most in his first perceptions, especially the eyes and mouth. I think the eyes - two spots that move in the same direction and  same speed can show to a developing mind that they are correlated. This also goes for nose and mouth, which all do translate in parallel. Entities which are correlated can be grouped together, this is "a face", i.e. this is a set of dynamic correlated elements. 

Actually, this can be one of the first coherent and stable set of visual correlations/patterns that the mind understands, and may serve as a basis for the future ones, which may explain existence of "face cells" or so. Faces are seen everywhere afterwards, and we use to see faces in inanimate objects.

Besides, these stimuli are early and further strongly conditioned with the baby's/one's own feelings, behavior and other agents' behaviors - these functions are exercised a lot.

Why baby's cry irritates us?  

Nativists: "Evolutionary encoded" etc., to call his mother to deal with it... 

Todor:

Actually a very simple explanation of this is: because it reminds us our own cry, and these sound patterns were conditioned with our own early unpleasant experiences.

Why "mama" means a mother in so many languages?

This is also a simple one to explain - my theory is that "mama" requires one of the simplest possible articulations, if not the simplest - just the mouth opens and closes twice + breathing.* The sounds is recognizable even without a breathing, and even dogs can be trained to say "mama".

I think it is important that there are two open-close operations, because this may serve as a confirmation of the first syllable.

So I believe that the babies themselves  have coined the word for their mothers, then their parents started to use it themselves. 

*BTW, I've been speech synthesis designer and developer and have some projects, but not the time....

Hippocampus

- formation of long term memory
- navigation
- head direction cells
- spatial view cells
- place cells

At least several or even all of these can be generalized. Places and navigation goes together. Places are long-term memories of static immovable inanimate objects (the agent has not experiences that these entities move).

Navigation, head-direction, spatial-view, place-cells - they all are a set of correlations found between motor and sensory information, and long-term memories, which are invoked by the ongoing motor and sensory patterns.

The static immovable inanimate objects (places)  change - they translate/rotate etc. - most rapidly in a correlation with head direction (position) and head movements. 

Navigation and spatial view are derived from all. 

Language

This one needs work, but in short I would say that:

The language is a hierarchical redirection/abstraction/generalization/compression of sequences of sensory inputs and motor outputs, and records and predictions for both.

Chimps can communicate using sign languages, such as: http://en.wikipedia.org/wiki/Washoe_(chimpanzee) 

Mirror neurons

They were found experimentally in rhesus monkeys (it's well known that monkeys use to imitate people) . Monkeys can imitate facial expressions and operations with hands such as picking.

There is a famous research of Miltzoff proving that newborn human babies at age of a few weeks are capable to imitate some facial expressions, like sticking out a tongue. They've never seen themselves and other experiments show that babies at that age are not capable to recognize different faces or to find a difference between a face without a nose or mouth or 2D vs 3D etc. (it smiles when see fake faces, by Fantz, R., 1966 trough R. Stamatov "Child Psychology")

This is interesting, I don't know how far the experiments have gone in the aspect of showing to the babies stimuli which are similar to faces.

This capability may require inborn links between basic image analysis (to find contrast/color change etc.)  and motor commands to facial and tongue muscles, I suspect that part of this may be done out of the neocortex, it can be of a very low resolution. Or there can be some pre-wired mirror neurons at the neocortex, related to this.

Other researches state that a one month baby vision has about 1/30 of the adult's resolution, which grows rapidly to about 1/4  at 8 months.

Regarding imitation of manual operations by monkeys, though,  I believe that this can be learned by mapping of similarities. Human arms and hands are visually similar to monkey's ones, they are "sticks" and "planes" which translate, rotate etc.

Unlike with the face, a monkey can see its own hands and other hands and can make a map between both. I don't know how it's done, but I think it can be done even without a pre-wired map.

I would quote my own teenage Theory of Mind and Universe (only Bulgarian yet: http://eim.hit.bg/razum), where I concluded that mind is a Universal hierarchical simulator and predictor of virtual universes, where these virtual universes are derived from sensory inputs.

Further reading:

http://en.wikipedia.org/wiki/Andrew_N._Meltzoff
http://www.scholarpedia.org/article/Mirror_neurons
http://www.interdisciplines.org/mirror

Google keywords and expressions: "mirror neurons", "Miltzoff", "chimps sign language" etc....

Keywords: Artificial General Intelligence, Seed AI, Development, Cognition, Developmental psychology, Neuroscience

Read More

Thursday, April 8, 2010

// // 6 comments

Universal Artificial Intelligence (Artificial General Intelligence/AGI) - Course Program, Plovdiv University | Универсален Изкуствен Разум - Програма

by Todor Arnaudov (aka Tosh, The Twenkid)


Age: 25. M.S. Software Engineering 2008 (Second? average grade in alumni), B.S. Computer Science 2007 (Best average grade in the alumni) at Plovdiv University. 

Intern at RIILP Wolverhampton – Computational Linguistics/Natural Language Processing. A polymath, independent researcher and versatile artist, working on establishment of a private company for R&D in Artificial General Intelligence and other fields, as well as a professional film and multimedia studio.

Info from Plovdiv Univeristy: 
http://fmi-plovdiv.org/index.jsp?id=1060&ln=1

More Info:                  Български  
An interview in a popular-science magazine: http://research.twenkid.com

Twenkid Research: http://research.twenkid.com

Lecture Slides and other materials:
 https://research.twenkid.com/agi/2010/  

Todor Arnaudov's Researches Blog: http://artificial-mind.blogspot.comTwenkid Studio 

(mostly in Bulgarian yet): http://twenkid.com

Video (English):
 
http://artificial-mind.blogspot.com/2019/07/agi-course-plovdiv-2010-screencast.html

Видео с една от първите лекции в курса с нови коментари: "Какво  е Универсален изкуствен разум?": https://youtu.be/r582MVKj81A

Universal Artificial Intelligence(Artificial General Intelligence/AGI)



Program as of April 8-th 2010 (a syllabus)


It will be taught in Faculty of Mathematics and Informatics of Plovdiv University, Bulgaria, starting from 9-th of April.

The course is appropriate for undergraduate students who want to work in the very advanced interdisciplinary field of the Artificial General Intelligence/Universal Artificial Intelligence, also known as Strong AI. It would be interesting also for those who just want to learn what are the current theories of intelligence and how the brains and mind work, according to current theories and speculations. The course tries to give the direction of how to design a thinking machine, eventually self-improving, and gives the directions for deeper study and research.

This course is original and it seems it's one of the first worldwide, if not the first* as systematic and interdisciplinary one, including:

- Futurology (Singularity, Transhumanism)
- Neuroscience  - How Brain works
- Developmental Psychology
- Behaviorism/Reinforcement learning in living beings/humans and machines

Even Love as a form of reinforcement learning “bug”. ;) The course gives insights and theories of intelligence/Universe and meta evolution – higher level principles that cause and drive Universe evolution - which seem not to be popular yet – Boris Kazachenko's and mine. 



I will give students also some ideas of how and why to do practical research and engineering and high-tech entrepreneurship, something I'm trying to start-up myself and have some experience as an engineer (employee) in a fabless semiconductor start-up. The course is appropriate for all undergraduate students, because the special preliminary knowledge is taught in the course. A graduate student barely have an  advantage over a second year student.

Lectures will be in Bulgarian, but knowledge of English is highly recommended, especially if you wish to deepen your knowledge in the field. The exam will be a test.


Probably; eventually I will translate the course to English. Maybe teaching it abroad if I manage to reach to that point.


Universal Artificial Intelligence

  1. Introduction to the course. Why should one do research, especially so brave? PhD – Pro & Con. Is it possible to do a private research/science and scientific business? What is a Start-up? True stories and advices.

  2. What is Artificial Intelligence? Is it possible? Criticism and scepticists – Searle's Chinese room. Summary of the classical AI and why it failed. Review of the results and successes in current Weak AI (specialized/narrow AI) – why do they have limitations. Cognitive Science and cognitive architectures.

  3. What is Universal Artificial Intelligence (UAI, AGI, Strong AI). Technological Singularity and Singularity Institute. Transhumanism. Expected computing power of human brains. Attempts for literal simulation of brains. Universality paradox of the brains. Ethical issues, related to AGI.

  4. Complexity and Theory of Information. Probability Theory – statistical (empirical) probability. Chaos Theory. Systems Theory. Emergent functions and behavior. Universe as a computer – digital physics. Algorithmic Probability. Kolmogorov's Complexity and Minimum Message Length. Occam's Razor.

  5. Design of Mammalian and Human brains.

  6. What drives mammals and humans? Behaviorism – Reinforcement Learning as a Universal learning method. Supervised learning and imitation.

  7. Developmental Psychology (Child Psychology). Stages in cognitive development. First language acquisition.

  8. Machine Learning. Markov's Chains. Hidden Markov Models (HMM). Bayes Networks. Hierarchical Bayes' Networks and Hierarchical HMM. Principles of the algorithms of Viterbi and Baum-Welch (Expectation-Maximization).

  9. Tests for human and machine intelligence. Definition of a reinforcement learning Intelligent agent, according to Marcus Hutter. Beauty according to Jurgen Schmidhuber and Todor Arnaudov. Schmidhuber's Godel Machine.

  10. Theory of Mind and Universe by Todor Arnaudov – mind as a hierarchical system of interacting universal simulators of virtual universes. Universe as a computer and trends in Universe evolution. 

  11. Theory of Intelligence by Jeff Hawkins. How the neocortex in mammals and human works. Memory-Prediction Framework and Hierarchical Temporal Memory.

  12. Theory of Intelligence and Universe Meta-evolution by Boris Kazachenko. Cognition: hierarchically selective pattern recognition & projection. Мeta-evolution as Abstraction of a conserved core from its environment, via mediation of impacts & responses by increasingly differentiated adaptive interface hierarchy. Boris' prize for ideas.

  13. Summary of the principles of intelligence according to Todor Arnaudov, Marcus Hutter, Jeff Hawkins, Boris Kazachenko and others. Prediction, hierarchy, bottom-up development, scalability, complexity growth. Seed AI. Sample architecture of an AGI/UAI agent.

  14. Ben Goertzel's cognitive architecture Novamente.

  15. Other researchers and private companies in the field of AGI. Bibliography, references, links and directions. Discussion and Questions.

  16. Exam.

    See you in class! ;)

    * I know about the summer school of Ben Goertzel, Hugo De Garis and their colleagues in Xiamen 2009, but according to their program, it lacks significant parts, e.g. Jeff Hawkins is not even mentioned. http://www.goertzel.org/AGI_Summer_School_2009.htm
    Read More
    // // Leave a Comment

    Универсален Изкуствен Разум - програма на курса на Тодор Арнаудов - Тош във ФМИ на ПУ "Паисий Хилендарски" | AGI - course program (see link)

    Information about the course in English  (Contains more details)   
    Интервю за сп. „Обекти“ 10/2009: http://fmi-plovdiv.org/GetResource?id=269

    Видео: http://artificial-mind.blogspot.com/2019/08/AGI-at-Plovdiv-2010-vs-MIT-2018.html 


    Универсален изкуствен разум Програма към 8/4/2010

    Курсът е авторски и оригинален, ще се води във ФМИ на ПУ „Паисий Хилендарски“ от 9-ти април 2010 и е предназначен за студенти, които искат в бъдеще да се занимават с авангардната област Универсален изкуствен разум (в миналото известно като Силното направление на Изкуствения интелект) или да разберат за най-новите теории на разума и търсенията на отговор на въпроса как да се създаде самоусъвършенстваща се разумна машина. Курсът е един от първите по рода си в света, а така систематизирано изложение на теориите на разума, заедно с необходимите основополагащи знания е оригинално и може би е първото и най-изчерпателно до момента (виж статията за курса на англ. какви са подобията English and some more about the course).

    Курсът е интердисциплинарен и включва освен информатични и математически въпроси и супер авангардната материя - Теории на разума и мета-еволюция на Вселената, - още Футурология (Технологична сингулярност, Трансхуманизъм), Функционална невроанатомия на мозъка на бозайниците и човека, Психология на развитието (Детска психология),  Когнитивна психология; Бихевиоризъм (учене с подсилване), като тези знания се включват в контекста на теориите на разума. Например какво са емоциите и любовта като когнитивни и поведенчески процеси.  Ще се дадат още информация и идеи за извършване на практически насочени научни изследвания и за високотехнологично предприемачество. Курсът е подходящ за всички, защото специалните предварителни знания се преподават в самия курс. Лекциите са на български, но е препоръчително ползването на английски език, особено ако имате намерение да задълбочите познанията си. Изпитът е тест. 

    Универсален изкуствен разум

    1. Въведение в курса. Защо човек да се занимава с научни изследвания, още повече смели? Докторантура – за и против. Може ли да се прави частна наука и научен бизнес? Какво е „start-up”? Истински истории и съвети.

    2. Какво е изкуствен разум? Възможен ли е? Критици – Китайската стая на Сийръл. Обзор на класическия изкуствен интелект (AI) и защо се провали. Преглед на резултатите на съвременното слабо направление в ИИ (специализиран ИИ) - защо имат ограничена перспектива. Когнитивна наука и когнитивни архитектури.

    3. Какво е Универсален изкуствен разум? (AGI, Силно направление) Технологична сингулярност (Singularity). Сингулярен институт (Singularity Institute). Трансхуманизъм. Предполагаема изчислителна мощ на човешкия мозък и парадоксалната универсалност на мозъка. Опити за буквална симулация на мозъка. Етични въпроси, свързани с УИР.

    4. Сложност и теория на информацията. Теория на вероятностите - статистическа (емпирична) вероятност. Теория на хаоса. Теория на системите (Systems Theory). Възникваща функционалност и поведение. Вселената като компютър – цифрова физика. Алгоритмична вероятност. Сложност на Колмогоров и минимална дължина на съобщението. Бръснач на Окам.

    5. Архитектура и работа на мозъка на бозайниците и човека.

    6. Двигатели на човешкото поведение и поведението на бозайниците. Бихевиоризъм - учене с подсилване (reinforcement learning) – универсален метод за обучение. Учене с учител и подражаване.

    7. Психология на развитието (детска психология). Етапи на когнитивното развитие. Научаване на първия език (language acquisition).

    8. Машинно обучение. Вериги на Марков. Скрити модели на Марков. Мрежи на Бейс. Йерархични скрити модели на Марков. Принципи на алгоритмите на Витерби и Баум-Уелч (Expectation-Maximization).

    9. Тестове за човешка и машинна интелигентност. Дефиниция на интелигентен агент на Маркус Хутер, основана на учене с подсилване и взаимодействие със средата. Изследванията на Юрген Шмидхубер за интересността и красотата и машината на Гьодел. Красотата в теорията на Т. Арнаудов.

    10. Теория за разума и Вселената на Тодор Арнаудов - разумът като йерархична система от взаимодействащи си универсални симулатори на въображаеми вселени. Вселената компютър.

    11. Теория на разума на Джеф Хокинс. Механизъм на работа на кората на мозъка на бозайниците. Предсказване, основано на паметта - Memory-Prediction Framework. Йерархична темпорална памет - Hierarchical Temporal Memory.

    12. Теория на разума и метаеволюцията на Вселената на Борис Казаченко.

    13. Обобщение на принципите на разума според Тодор Арнаудов, Маркус Хутер, Джеф Хокинс, Борис Казаченко и др. Предсказване на бъдещето, йерархичност, развитие отдолу-нагоре, мащабируемост, натрупване на сложност. Зародиши на разум. Примерна архитектура на универсален ИР.

    14. Когнитивната архитектура „Новаменте“ на Бен Гьорцел.

    15. Други учени. Фирми, които се занимават с УИР. Библиография - насоки. Дискусия, въпроси.

    16. Тест  

    Read More

    Wednesday, March 31, 2010

    // // Leave a Comment

    The Gift, Visual Effects, Downhill Bikers, Speed Metal and Acting

    Български - http://twenkid.blogspot.com

    The Gift - A Dream (teaser trailer #1)

    Подарък - Сън на Тош (тийзър трейлър 1) from Todor Arnaudov on Vimeo.

    This is the first teaser trailer of my short film "The Gift" (A Dream), includes moment from "the making" of it.
    What I'm saying means:  I was late... When I just arrived up here, the sunset was still visible and there was a beautiful red light. A moment later - everything went dark...
    Genre: Experimental, Symbolic, Fantasy, "Dressed Erotics", Erotics, Thriller,  Drama, Animation, Modern Dance

    It's an ultimate author film, inspired by my own love poetry, characters inspired by a two-part novel of mine, called "Ada" and "Raya". Music is composed and performed also by me in mid-2009, it was a test one. Shots in this teaser are done in late 2008 and very early 2009, but are shown as late as February 2010. Work on the movie was frozen, there are some complex scenes to be shot and/or composited with some CGI.

    Twenkid FX

    The other important character in the film, a beatuful woman, is not visible here. Her and the movie as a whole require some visual effects, and I'm working on a custom Video Editing/Compositing/Visual Effects software, it's called Twenkid FX.  "The Gift" will not look like "Transformers", the effects will not be zillions of polygons etc. - simple, but beautiful and artistic, combined with appropriate artistic shots.

    The software is in an early stage of development yet, I'm designing it. For now it provides basic compositing.

    Effects done on frames from "The Wedding" (short film)


    Some planned/desired features sounds like:


    - Complex matte painting with static and animated masks
    - Manual, semi-automatic and intelligent motion tracking and motion compensation
    - Particle effects system 
    - Ligh/Lightning/Space rendering effects 
    - Intelligent color correction/color matching 
    Maybe also some forms of motion capture, related to motion tracking/compensation, they all may assist rotoscoping - turning video to animation/masks.

    Mini DownHill in Plovdiv, Bulgaria

    Mini MTB DownHill in Plovdiv - Спускане МТБ даунхил в Пловдив from Todor Arnaudov on Vimeo.


    Sorry for that horrible compression, the motion seems too much for Vimeo.

    Camera, Editor, Electric guitar player:  me

    Download High Quality
    Download The Music Track

    Acting

    More on this - later.  ;)

    ...

    Generally, this is my artistic blog, Twenkid Studio, I used to publish stories from it, but recently I haven't had:  http://twenkid.blogspot.com 
    Read More

    Saturday, March 20, 2010

    // // 1 comment

    NLP stands for Natural Language Processing and not Neuro-Linguistic Programming | НЛП означава Обработка на естествен език, а не ...

    The more popular NLP is a half-scientific or pseudoscientific psychological methodology for the so called "social engineering".

    In my opinion this is an immoral methodology of  how to manipulate and deceive people, especially about making sex or selling something. There are courses about how to pick-up girls and make them believe you love them while you just want sex; how to make people buy your shit and persuade them how brilliant it is etc.

    This kind of pseudo NLP sucks, and people who try to use this "methodology" are hard to be trusted. I've met several ones, such as a seller of stolen goods and an abusive network marketing distributor.

    Not that the scientific NLP is fine yet - What's wrong with Natural Language Processing? Part 2. Static, Specific, High-level, Not-evolving...

    But at least it can be taken as a science.  :)

    ...

    НЛП означава Обработка на естествен език. Има и друго - "невролингвистично програмиране", което според мен представлява неморална методология за манипулация и заблуда - може да си платите за курс на който да ви научат как да заблуждавате хората, да ги накарате да си мислят, че сте им приятел (а да имате единствено користни цели) и т.н.. Веднъж усетиш ли такъв човек, трудно можеш да му имаш доверие след това...

    Не че откриват кой знае какво, според мен концентрират добре известни и "работещи" методи на свалячи, ласкатели и други. Ако сте достатъчно умен човек и имате усет за хората, тези "мъдрости" на които ще ви научат, ще си ги знаете от собствен опит. 

    Не че Обработката на естествен език е цвете - What's wrong with Natural Language Processing? Part 2. Static, Specific, High-level, Not-evolving... (Къде греши Обработката на естествен език), но това е друга история.


    Read More

    Monday, March 15, 2010

    // // Leave a Comment

    Machine Translation 50 years ago | Машинен превод от преди 50 години

    While writing an article about Machine translation, I recalled this chapter from a book, printed in Moscow in 1958, just 4 years after the first MT demonstration in New York by IBM. You could try, if you wish, whether today's Google or Microsoft translators would manage. ;) The text is from a Bulgarian translation of the book.

    Google Translate to Enlgish this article
    ...

    Докато пишех една статия за машинен превод, се сетих за един интересен "препис", който бях публикувал в bgit.net преди 8 години, от вече 50-годишна книга.  Тези които превъзнасят "великото изобретение" на Койчо Митев, може да прочетат пасажа за това как се кодират думите, за "паспортите на думите". 

    Машинният превод започна през 1954-та...
    Статия | Автор Тодор Арнаудов | 28 Октомври 2002 @ 14:47 EET | 160 Прочита | 1

    Приложеният препис от книгата на М.С. Тукачински, "Машини математици". Д.И. "Наука и изкуство", София - 1960 г. (Москва - 1958) разказва за първите успешни опити за превод от руски на английски и обратно, извършени през 50-те години. Може би сметачът на IBM ("Интернейшънъл бизнес мешинз", според книгата), на който е извършена първата обществено показно на 7.януари 1954., е е бил IBM-704, а този, на когото в СССР успяват да пуснат действащо предписание за превод от англ. на руски малко по-късно, е БЭСМ - Быстродействующая Электронно-Счетная Машина, т.е. Бързодействаща електронно-сметачна машина, построена през 1953-та, с производителност до 8-10 хиляди действия/сек. И двете са, естествено, лампови.

    Междувпрочем, малко информация за транзисторната БЕСМ-6, с бързодействие до милион казби/сек, може да се прочете в "Свещения сметач", брой 5.: "БЕСМ 6 - Съветският компютър на 60-те"


    Тукачински, М.С. "Машини математици". Д.И. "Наука и изкуство", София - 1960 г. (Москва - 1958).

    стр. 114 Електронен преводач


    На 7 януари 1954 г. в кантората на Ню Йоркската фирма "Интернейшънъл бизнес мешинз" беше многолюдно. Поканените чакаха необикновено зрелище: първата публична демонстрация на автоматичен превод от един език на друг с помощта на електронна сметачна машина.
    Присъстващите бяха свидетели как с помощта на перфокарти бяха въведени в запомнящото устройство на машината специално подготвените речник и програма.
    А когато в машината беше поставена купчинка перфораторни картончета със записани на тях фрази на руски език, извеждащото устройство скоро автоматично отпечата в превод на английски език.
    Отчетът за тази демонстрация предизвика огромен интерес в целия свят. Проблемите на машинния превод станаха предмет на спорове, изучавания и други опити за практическо осъществяване. Успешни опити на превод от английски на руски език бяха проведени и в Москва на вече познатата ни машина БЭСМ.
    Как машината превежда?
    Методът, по който машината превежда текста, не се различава принципаиално по начина, по който превежда човекът. На човека е необходим речник - речник е необходим и на машината. Но на машината, разбира се, е необходим особен речник, изразен в числа. Да се изразят думите с числа не е сложно. Достатъчно е да се номерират буквите в азбуката, за да се представи думата чрез числа. Така се постъпва и в действителност.
    Английска азбука Руска азбука
    a-16 n-15 а-16 м-11 ч-23
    b-06 o-28 б-06 н-15 ш-09
    c-22 p-24 г-10 п-24 э-17
    d-30 q-23 д-30 р-07 ь-02
    e-08 r-07 е-08 с-05 ы-04
    f-14 s-05 ж-29 т-21 ю-01
    g-10 t-21 з-25 у-20 я-03
    h-26 n-20 и-12 ф-14 й-18
    i-12 v-29 к-19 х-1 ъ-00
    j-18 w-13 л-27 ц-22
    k-19 x-09
    l-27 y-04
    m-11 z-25

    Като се използва такава азбука, думата "машина" и английският й превовд "machine" може да се представи така: на руски 11109121516 (т.е. 11-16-09-12-15-16); на английски 111222121508 (т.е. 11-16-22-26-12-15-08).
    Тъй като една и съща дума на руски и на английски се състои от различни букви, то числата, които изразяват една и съща дума на различни езици, са естествено различни. Общото у тях ще бъде обаче поредният номе на думата в речника, който номер се поставя на всяко число-дума.

    Например:
    Английската част на речника Руската част на речника
    Пореден номер Число-дума Пореден номер Число-дума
    205 111222121508 205 111609121516

    Англо-руският речник и програмата за работа на машината се въвеждат в запомнящото устройство на електронната изчислителна машина.
    Как се извършва превеждането?
    Преобразуването на буквите на превеждания текст в числа и записването им с дупчици на хартиена лента се извършва на своеобразен перфоратор с клавиатура на обикновена пишеща машина (фиг. 41). Операторът "препечатва" английския текст, подлежащ на превеждане. Но вместо отпечатан с букви текст от машината излиза лента, на която всяка буква на английския текст е изразена във вид на дупчици, означаващи съответни цифри. Тази лента се въвежда в сметачната машина за превеждане.
    Сега да си представим, че в английската фраза, въведена в електронната изчислителна машина, се намира думата 11152226121508.
    Първата задача на машината е - подобно на това, което би направил човекът - да намери тази дума а английската част на речника. Този процес може да се извърши, като се извадят всички числа на речника от въведеното число. В случая, когато резултатът се окаже равен на нула, търсената дума ще бъде намерена. После машината възприема поредния номер на тази дума (в нашия случай 205) и от руската част на речника ще избере числото, съхраняващо се под този номер.
    Намереното число-дума ще бъде 11109121516.
    Сега на машината остава само да подаде това число на извеждащото устройство, където буквопечатащият телеграфен апарат ще го превърне в думата "машина".
    На пръв поглед всичко е много просто. Но в действителност работата е много сложна.
    В речника думите се намират в своя основен вид, например в ед. ч., именителен падеж и т.н. В текста пък думите могат да бъдат в най-разнообразни граматически форми. При това естествено буквеният състав на думите от текста ще се различава от буквения състав на думите в речника. Значи думите ще бъдат изразени с различни числа. Например думата от текста "machinery" (на машината) ще се изрази с числото 111622261215080704 вместо с числото от речника 11162226121508 (машина). По такъв начин може да се окаже, че в речника въобще няма да бъде намерена необходимата дума.
    По-нататък. Думите в английската и руската фраза могат да бъдат подредени в различен ред; една и съща английска дума може да има различни значения в зависимост от това, какви думи я обкръжават и т.н.
    Всичко това трябва да бъде взето под внимание при превода. Затова с шифровката и номерацията още не се свършва работата по съставянето на речника. Напротив, това е само началната, най-простата част от работата. Съставянето на речниците за машинен превод е много сложна съвместна работа на езиковедите, математиците и инженерите.
    Всяка дума въз основа на щателно изучаване се снабдява със своеобразен паспорт. Думата-число се разраства с двадесетина отнасящи се към нея цифри-признаци, които означават каква част е от речта, от кой род е, одушевен или неодушевен е предметът и т.н.
    Основно процесът на превеждането се разделя на два етапа: анализ и синтез.
    През първия етап машината трябва да анализира граматическата форма на английските думи, да намери превода им и мястото им в бъдещото изречение. През време на анализа машината използва не само речника, но и допълненията към него. Към допълненията тя се обръща, когато думата е нееднозначна.
    През време на втория етап се извършва синтезът на руското изречение: намерените в речника руски думи се изменят в съответствие с получените признаци и се подреждат по местата им.
    Специалната част от програмата "синтаксисът" дава възможност на машината правилно да подреди препинателните знаци, след което преведената фраза се печата.
    Машината извършва всички операции, които са необходими за превода, много бързо. За превеждане на просто изречение тя губи 7-8 сек. За качеството на работата на машината БЭСМ като преводач може да се съди по преведения от нея откъс, представен на фиг. 41. Както виждаме, преводът е напълно задоволителен. За да му се придаде безупречен литературен стил, е необходима само малка редакторска поправка. Впрочем може да мине и без нея. Нали става въпрос за превод на технически текст, където да се изгради литературната форма не е така необходимо. Точно в това направление - за превеждане на технически текстове, работят сега изследователите, които се занимават с машинно превеждане. Трябва ли да говорим, че превеждането на литературно-художествените произведения представлява нещо повече от грамотно преведените фрази и правилно подредените препинателни знаци.
    Проблемата за автоматичния машинен превод далеч не е решена. Напред има още много трудности. Засега са направени само първите опити. Но не бива също да се забравя, че от времето на първия превод изминаха само няколко години, а за този кратък период от време запасът от думи в машината (речникът) нарасна от 250 на 1000 и качеството на превода значително се подобри. Сега опитите за превеждане, извършвани на универсалните изчислителни машини, се пренасят на специални преводни машини, които имат мощни запомнящи устройства за съхраняване на речниците. Всяка такава машина ще може да превежда текстове от много езици.



    Read More

    Thursday, March 4, 2010

    // // Leave a Comment

    Video editor/Visual Effects/CGI software - in progress | Разработвам свой видеоредактор с възможности за специални визуални ефекти


    An experiment from 2005. A combination of two videos with masks for the intersections.


    The video editor/NLE/computer graphics environment I'm developing has no name yet and is getting its basic capabilities yet - opening video file, rendering 3D-graphics, postprocessing video, outputting to file. It's supposed to serve at least for the visual special effects needed for my fantasy short film "The Gift".

    I've been waking up my old-old passion for computer graphics, started as early as 90-ies. :) Smooth bit-mapped animation at 35+ fps, wire-frame 3D and a bit of texture-mapping on an 1.018 MHz Apple][ clone Pravetz-8M... There was even an animatronic/animation science-fiction movie partially done, with some music and test audio recordings. :)

    ...

    Работя по свой видеоредактор/среда за компютърна графика/визуални ефекти. Все още в съвсем ранна фаза. Би трябвало да послужи за специалните ефекти на "Подарък".


    "Trigonometric-3D" - I would call it "ellipse perspective transformation", my own invention from 1999 on a Pravetz-8M (Apple II clone).





    Read More

    Thursday, February 25, 2010

    // // Leave a Comment

    Universal Artificial Intelligence/AGI - a course at Plovdiv University from April/2010 | Универсален изкуствен разум - курс в ПУ от април (още новини)



    On Wednesday I welcomed 20-some Computer Science students who visited the presentation of my upcoming course - at least 21 of them signed in. :)

    This will be one of the first courses in the field in the world, I believe. Some time ago I noticed the Summer School in Xiamen that Goertzel, De Garis & a bunch of PhDs has teached last summer. Well, I'm just one and not even a PhD student, but my course will have some significant parts that theirs lacked. Besides, it seems they have ignored Hawkins (it's not mentioned in the Program), while I will not.

    More info to come.

    ...

    В сряда около 21 студенти се записаха за моя курс по Универсален Изкуствен Разум, който ще водя от април. Първата лекция се очертава около петък 9 април.

    Това ще бъде един от първите подобни курсове в света. Преди време разбрах, че миналото лято Гьорцел, Де Гарис и куп д-р-и са провели лятно училище по Универсален изкуствен интелект в Ксиамен, Китай. Е, аз съм само един, не съм дори докторант, но въпреки това моят курс съдържа теми, които те не знаят. Според програмата на лятното училище, даже са пропуснали Джеф Хокинс.

    Очаквайте повече инфо.


    Могат да се запишат и хора, които не са студенти въ ФМИ:
    http://old.fmi-plovdiv.org/courses/link8.html

    16. Универсален изкуствен разум (Практикум), хон.ас. Тодор Арнаудов

    (30 места, за всички)

    записване I етап: на 24.02.2010 г. (сряда) от 13:00 ч. до 14:00 ч. в 546 к. з.

    Целта на курса е въведение в теориите на разума. Курсът е предназначен за студенти, които искат в бъдеще да се занимават с авангардната област на Универсалния изкуствен интелект (Силното направление на ИИ) или да разберат за най-новите теории на разума и търсенията на отговор на въпроса как да се създаде самоусъвършенстваща се разумна машина. Така систематизирано изложението на теориите на разума, заедно с необходимите основополагащи знания, е оригинално и може би е едно от първите по рода си в света, заради авангардността и интердисциплинарността на тази материя, която все още не се преподава в никой университет
    Read More

    Thursday, February 11, 2010

    // // Leave a Comment

    Universal Artificial Intelligence/AGI - upcoming course at Plovdiv University | Курс по Универсален изкуствен разум в ПУ


    I'm writing an original course and will teach it in the third trimester, starting from April. More info to come.

    Подготвям оригинален курс по универсален изкуствен разум, който ще водя през третия триместър - от април. Очаквайте повече инфо.


    Read More

    Wednesday, February 10, 2010

    // // Leave a Comment

    Intelligence: A Search for the biggest cumulative reward for a given period ahead, based on a given model of the rewards. Reinforcement learning.

    Analysis of the meaning of a sentence, based on the knowledge base of an operational thinking machine. Reflections about the meaning and artificial intelligence.
    Part 4 of 4 - Comment #3
    Part 1 (и български): Semantic analysis of a sentence. Reflections about the meaning of the meaning and the Artificial Intelligence
    Part 2 (и български): Causes and reasons for human actions. Searching for causes. Whether higher or lower levels control. Control Units. Reinforcement learning.

    Part 3 (и български): Motivation is dependent on local and specific stimuli, not general ones. Pleasure and displeasure as goal-state indicators. Reinforcement learning.
    Part 4 : Intelligence: search for the biggest cumulative reward for a given period ahead, based on given model of the rewards. Reinforcement learning.
    One of the milestones of my AGI research. I wrote this particular article and the comments in Bulgarian as a 19-year old freshman in Computer Science at Plovdiv University.
    By Todor Arnaudov | 13 March 2004 @ 21:49 EET | 340 reads |
    First published at bgit.net and the e-zine “Sacred Computer” in Bulgarian

    Comment # 3 by Todor Arnaudov | 18 March 2004 @ 22:04 EET
    (...)

    I'm one of the "scientists" who assume that since anything in Universe does work, there is nothing mysterious in its operation. I think that every information process in Universe is formal and can be modeled by a Fon Noeman machine if it has enough memory and - because Universe is working as a computer; because the computer is what it is, perhaps because it is following a high and universal model, of the Universe. Why the essence of the computers is yet a CPU, memory, clock [time, synchronicity], input-output since the start - this is the simplest complete model of operation of the Universe.

    [As a University freshman it was harsh to call myself a scientist seriously, I was more a philosopher. This quotes my theory about "The Universe Computer", i.e. Digital Physics]


    Everything is "formal" and "external", i.e. it could be written with formulas. E.g. why anyone assumes that another one is intelligent, if not external. And what is "internally intelligent" - one that is working like a human? What does it mean - to be built from proteins?...

    Actually, a person usually says that something is "formal" if he believes that he does understand the formulas and/or if he thinks that these formulas are intelligible or superficial - just changing symbols like in Searle's Chinese room - even if he himself is incapable to understand them.

    E.g. if a thinking machine is built and after it is taught [from a seed intelligence, a core, like a human] and it gets as complex as me or you, so that it would be intractable for anyone, some humans would still say that it is formal, they do understand it and it is nothing special.

    Why would they think so? Because they assume that they do understand how computers work - "1 and 0, NAND, NOR; cycles, reading, writing, shifting... it's so simple and the computer doesn't realize anything of what it computes, so even if he appears to think, it would just calculate!"

    Does the carbon atom "realize" that it's a part of a neuron?! Or each neuron "realizes" that it's a part of the brain, and wouldn't it behave the same way if we put it outside of the brain and feed it with the same signals like in the brain? Is the neuron aware that it's a part of a mind and does it know a part of what thought it is?

    Bullshit! One thing is for sure to me - humans want to feel unintelligible, mysterious, hyper-complex, because people believe that to be "formal" or to be explainable is a bad thing. People don't want to ask hard questions, and more likely - don't want to get irritating answers. (...)

    However, what is to be a human? I would ask, perhaps as a "self-humiliating" individual.
    A new born is, not a 20-30 years old. A seed intelligence where mind grows and develops.

    The mysterious concept of soul is an example of a helpless "prove" that human is not a "formal" entity. It has a soul, actually it is just something that a machine or anything else couldn't have just because it is a machine, that means - not a human, that means - not a member of our precious club. However those people do not question why most people believe that the animals have one, but machines - don't, while a lot of pretty formal reasons could be found.
    (See the Teenage Theory of Universe and Mind/Intelligence and the short novel "The Truth" http://research.twenkid.com )

    To me human is formal, and the principles in his mind as information processes are similar to what they could be in a thinking machine: memory, processor (merged in one), clock (a way to separate/resolve events), input-output. In the memory there are records of possible actions from which the person - his body - all the time selects one that mostly matches current goals for a given selected period of time ahead, based on a current active model for checking whether the goal is reached or not.

    The purpose is a GOAL; a state, where the Control Units aims to. The "thirst for a purpose/meaning" is a search for local maxima, indicating to the Control Unit how close the goal is. [E.g. - an orgasm... ;) ]

    The machine, as of my current understanding [2/2004] - should be made to have complex enough subunits - diverse enough in their kinds and goals, and either real or virtual - which would feel "pleasure" in a particular way, i.e. they would seek achieving their goals. And it should be impossible all subunits to reach their goal in the same time.


    Terminal devices are needed (effectors) - muscles, which can't be controlled in parallel, e.g. only one subuint could control them at a given moment, so that the external behaviour, movement, output data - be clearly defined, as with human.
    The subunits should compete and interact; to contract and fight; sometimes to collaborate in groups and to "fight" against other groups, aiming at the goal each of them to reach maximum pleasure.


    I think that's what human does and I think [as of 2/2004] this is "mind" [intelligence]: search for pleasure and avoidance of displeasure by complex enough entities for a given period ahead [prediction, planning]; the "enough-ness"" is defined by the examples we already call "intelligent": humans at different ages, with different IQ, different characters and ambitions.

    The behaviour of each of them could be modeled as a search for the biggest sum of pleasure (displeasure is a negative in the sum) for a selected period of time ahead, which is also chosen at the moment of the computation.

    "Happiness" is another word for pleasure, and as a friend of mine, a poet, once said:
    "The man is restless happiness seeker. I don't know why it's so important for everybody to take their dose of happiness, but it is true... and the people, caught in the hands of vices and addictions are a kind of deluded seekers... They are also searching for happiness, but at a wrong place".

    Addictions - such as to drugs, but not only - are an example of Control Units finding their goal - an enormous pleasure they feel, taking a given drug - and this can lead to taking control over the whole body. "Happiness" for the body is turning to an elementary happiness for the elementary control units, which feel that their goal is reached by detecting a particular kind of molecules.

    PS. When I was about to write "a local maximum" I was about to say also "for a close enough neighborhood" (very short period), influenced by the Mathematical Analysis I've been studying lately, however mind is much more complex than the Analysis, i.e. it's based on much more linearly independent premises, that is impossible to be deduced from each other.

    It's not required the period for the prediction to be short enough, because like in the example with the chocolate, caries and the dentist, immediate actions can be included in functions that give result shifted far ahead in the future; at the same time, the same action can be regarded in the immediate future, in the example situation, the eater will feel ultimate pleasure in the following one second.

    One among many functions can be chosen or constructed, and they all can give both negative or positive results, depending on minor apparently random details - the mood of the mind in the particular moment; which variables are at hand, which the mind has recalled of, what the mind is thinking of right then...

    (...)

    Suggested reading - "The Truth", a short novel I wrote in 2002. [not translated as of 10/2/2010]



    Comments from 10/2/2010:

    Yes, multi-agent stuff reminds Minsky's "Society of Mind", but I hadn't read it then and still have not.
    The drug stuff is related to dopamine, endorphins and other neurotransmitters, "Reward pathway" ans so on. The discussion is about "virtual" units, Control units , not about neurons etc., though.
    Also, the last discussion is about Reinforcement learning bug, I didn't know the word "reinforcement learning" back then and didn't know what exactly behaviorism was, I knew about utilitarianism, though, and was using my imagination to find explanations.

    A version of reinforcement learning was reinvented in my early
    works from my Teenage Theory of Universe and Mind, where the Control Unit (agent/human/society/state/system) is predicting and aiming at scenarios which would lead to the biggest cumulative pleasure for a given period ahead.

    In society and states, most of the laws have this function, and it's related to another concept - the limited level of pleasure (reward in standard RL terms) that any control unit/subunit/agent can get in any possible circumstances. This is supposed to prevent one from gaining too much control over the system - mind/society.
    I gave the following example: when somebody robs a bank, he gets rich, can do better what he wants, but his happiness is not unlimited, it's normalized to 1 anyway. On the other hand, he is causing lasting displeasure to many people and the sum is highly negative. The system is aiming to avoid robberies. This is related also to doing what one wants and what doesn't want (another important concept in my theory about Control Units). Control Units are aiming to control, and losing control and predictability causes displeasure/confusion.
    Recently I found that Marcus Hutter and Shane Legg talk about a concept which is similar to my limited reward "Assuming that environments return bounded sum rewards ... " in "Universal Intelligence:A Definition of Machine Intelligence". Here. They also define the Universally intelligent agent as a seeker of a sum of rewards. However, his papers are published years later (or around, I haven't checked all), and I didn't know about him at the time, I heard of him in 2009.

    In 2002-2004 when I was building the foundations of my Universal AI theories and understanding, I was too young, busy and "ignorant" - I didn't know about any of the gurus such as Goertzel, Schmidhuber, Hutter, de Garis. Hawkins has just appeared with his "On Intelligence" right after I published the last 4-th part of my first works, which was written
    mostly in 2003.

    I wrote my stuff on my own
    and I still believe that "Imagination is more important than knowledge"; can't be so ignorant as back then, though.
    I wasn't sure whether I'm not a mad man at the time, because it's hard to find anybody to understand and appreciate such advanced stuff as AGI, I was 18-19 years old. Years later, starting from 2007, I started to find that my ideas, pieces of them or directions are shared by gurus in AGI - first Hawkins in his Memory-prediction framework and "On Intelligence", then Boris Kazachenko, Jurgen Schmidhuber, Marcus Hutter.

    Of course, this "Teenage Theory of Universe and Mind" is something that will be translated and shared as well.

    Keywords: Reinforcement learning, multi-agent systems, control units, pleasure seeking, utilitarianism, local maximum, Todor Arnaudov's Teenage Theory of Universe and Mind, Todor Arnaudov's Teenage Theory of Universe and Intelligence, limited reward, limited pleasure, bounded reward, bounded pleasure, addiction, addiction bug of reinforcement learning, cumulative reward, cumulative pleasure, pleasure seeking, seeker, searcher, intelligent agents, Twenkid Research
    http://research.twenkid.com
    Edit @ 30.12.2018: Corrections of typos: shifter, loosing, predicatability, utilitarism, cummulative, circumsances, displeausure, smiliar, bulding, enourmous, neighbourhood,amongst, construted, unresting, muscules, theTeenage, untracable, synchron, input-otput, endorfine ...
    Edit @ 3.9.2025: "its ..." (of human) - his; and one other similar. Visit the virtual conference Self-Improving General Intelligence SIGI-2025 and find the "Prophets of the Thinking Machines": https://github.com/Twenkid/SIGI-2025/
    Read More

    Tuesday, February 9, 2010

    // // Leave a Comment

    Motivation is dependent on local and specific stimuli, not general ones. Pleasure and displeasure as goal-state indicators. Reinforcement learning.

    Analysis of the meaning of a sentence, based on the knowledge base of an operational thinking machine. Reflections about the meaning and artificial intelligence.

    Part 3 of 4 - Comment #2 continues...

    Part 1 (и български): http://artificial-mind.blogspot.com/2010/01/semantic-analysis-of-sentence.html

    Part 2 (и български): http://artificial-mind.blogspot.com/2010/02/causes-and-reasons-for-any-particular.html

    Part 4   Intelligence: search for the biggest cumulative reward for a given period ahead, based on given model of the rewards. Reinforcement learning.

    One of the milestones of my AGI research. I wrote this particular article and the comments
    in Bulgarian as a 19-year old freshman in Computer Science at Plovdiv University.

    By Todor Arnaudov | 13 March 2004 @ 21:49 EET | 340 reads |
    First published at bgit.net and the e-zine “Sacred Computer” in Bulgarian


    Comment # 2 by Todor Arnaudov | 18 March 2004 @ 21:58 EET |CONTINUES...


    Let's note, that when a mind is being evaluated, a "stop frame" is evaluated. In this very moment. (...) And somebody with a particular attitude is the one who can find best why he does like or dislike a particular thing.

    E.g. only you know, you see or imagine on what exact circumstances you're talking about. Every detail in a given situation is important, not only the generalized ones, said in a few sentences. E.g. on the wall that you imagine, there could be other particular objects which don't match this one. And this is your taste - your like or dislike.

    The purpose of this "will", this kind of will - like/dislike something - is a search for a reason to decide and choose, when a single and unambiguous action should be executed. If that action doesn't lead to a damage (you won't be hurt either if that clock with a thermometer is put on the wall or not) - then there is not an immediate practical consequence/meaning what we choose. For a long period ahead, we cannot predict how exactly this particular action and decision will affect us, because the future inputs are too much and too much unknown in advance.

    So, let's assume that it doesn't matter the clock & thermometer combo is on the wall or not, and the reason is that "we like it" (anyhow) and it is possible to find a persuasive reasonable explanation, if it is possible to analyze ourselves precisely enough.

    It is possible that:

    1. You already had a clock and a thermometer (separate) and you're a practical person who doesn't like possessing redundant stuff.
    2. You don't need a thermometer anymore. - This is a preliminary calculated reason; once you have told to yourself "I don't need a thermometer anymore". Then you have never questioned this reason and you have followed it as a reason not to put a thermometer on the wall)
    3. You're in a bad mood and you would deny anything that anyone would ask you to do.
    4. You don't like anybody to tell you to do whatever, and you feel like they are giving you a command (e.g. it's a gift from your mother in law)
    5. You just don't know why.


    In general, of course - if we're searching for a reason, it's nice to have as complete model of the evaluator as possible...

    Definition of a "meaning" with the meaning of a goal/purpose or cause/reason and "not contradictory link" expresses the attitude of the evaluator to the item that is being evaluated (where a cause/reason/purpose/meaning is searched).

    And it is very important to note, that the evaluator determines whether there is or there is not a cause/reason/meaning/purpose for him personally. "Meaning" is subjective.

    Actions of thinking machines and persons can't be explained unambiguously from an external evaluator, because externally the information is very scarce [and intelligent agents behaviour is very complex and non-linear]. The amount of information which is transferred between the parts/modules of the machine/human is enormously bigger than the data which is outputted - e.g. the externally visible behaviour.

    Besides, the mind is biased and limits itself when searches. To me, the ultimate cause for anything is the whole past, the every single little difference would make the whole different. However, since it is impossible for the mind to compute all causes, mind uses greedy algorithms and searches for most direct and "plausible" explanations/causes/scenarios.

    It is like differentiating in mathematics - there is raw data, a graph of values; the function that has drawn the function is searched. However, this is an ambiguous operation, we can guess, but not always know - the causes are also ambiguous.

    That's why any "differentiated" causes are meaningful at a given deepness, resolution or so, where the search is interrupted.


    Now, let's check Konstantin's opinion once more, differently:

    Konstantin: People do absurd things, which however appear to be full of deep meaning. Programmers sing - out of tune... A banker who owns millions and visits luxury restaurants once passes next to an old lady who is selling donuts; then he takes one from a dirty bag and buys a donut for 30 cents. No doubt this donut was made by a poor snotty baker, but... For the banker, this is the best food and the best thing in the world!

    Where's the absurd in programmer singing? "A programmer" means a person, and a person usually can sing - good or bad.
    What you express here is just your opinion, your disapproval.

    There is not a reason/purpose for a bad singer to sing? Why? Because he's afraid of being accused for singing, mocked... (...) 

    [However] This particular programmer may be singing because:
    - He feels in love and felt happier than the moment before, and singing is a way to express your good mood.
    - He is alone, and he wanted to sing before, but he was shy.
    - He is drunk and his inhibition was taken away.
    - He is in a karaoke bar, lonely, he saw a beautiful girl and he decided that this is a meaningful way to attract her attention. He might be drunk or not.

    (...)

    It is impossible to embrace all possible reasons, because of the combinatorial explosion, but when having rich enough information about the circumstances, it is always possible to find plausible concrete reasons, if one wants to find one. (The one who denies, usually doesn't want to find reasons.)

    Konstantin: For him, this is an act that is filled with deep meaning, but how would you persuade a computer program? Especially if the program is counting the number of viruses and bacteria that has entered the banker's organism in that very moment. How does the banker would explain it - “I felt a thrill, I remembered once when I was a child...”. From the viewpoint of the computer, this is a non-sense, just a random association – especially if from this little moment eventually grow up a serious decision for his life and career; how would you explain to a computer what's in common between the donuts and the money?

    What does a "program" means? The implied in your words is "a dumb program" or one that would react as it doesn't understand. However, then obviously this is not a thinking machine!

    I think the reason is actually very purposeful and meaningful. Every Control Unit has goals: the man has recalled an event that has made him feel good and he wanted to feel that pleasure again. He didn't think of the microbes, he didn't include them in the evaluation function, and he has never counted the microbes. If a machine is searching for a reason for a human, it must put itself in his shoes and evaluate as if it were him, not as if it was a counting machine. (As I noted before, at least according to my research, "pleasure" means achieving the goal of the behaviour of the Control Unit.

    The banker has recalled a reachable state that in the past has made him feel pleasure.
    That state is a set of circumstances, feelings, possibilities for actions; possible ways for changes in the circumstances/perceptions/feelings.

    In that very moment there weren't any other possibilities that would give him higher pleasure in the next, say, 5 seconds. After he has bitten the donut, the search for another way to feel pleasure is cut. The donut became a "master" of the mind and rules the person's current goals and behaviour. [This local reward] rules the hands, the jaw etc. in order the person to feel the taste that has made him feel the pleasure in the past, and that pleasure to come back and be felt again.

    How does this temporal control over the mind and the effectors (muscles) happen?

    The behaviour of human can be represented as a complex of greedy algorithms which are searching for states, local maxima - the biggest possible pleasure, and the minimum possible displeasure.

    Any chosen action is reasonable, for the virtual greedy algorithm that has ruled over the rest in the given situation. (...)

    E.g. if one starts to eat some food and it's tasty, he doesn't spit it after the first bite, in order to search for something which is tastier, even if he knows that such food does exist and is near-by - in the fridge; the first bite may rule us for a moment and inhibits the urge for another piece of tasty food.

    However, what if in the evaluation of the pleasure the mind includes "the fear of caries"? It is so complex mixture in the mind, what exactly would "rule" depends on specific memories, specific stimuli in the recent past and it may appear random.

    In case of caries being included in the evaluation, it might be negative - the chocolate is not the maximum pleasure and shouldn't be taken. Different Control Units are working in parallel, all fighting for control over the effectors. And if one which has this fear rules out, it may stop the eating operation and switch to "brush my teeth immediately".

    Before the caries consideration, the greedy algorithm has computed the biggest cumulative pleasure/reward in the near 1 second. However, the caries and the pain at the dentist forced him to look feelings long ahead, which are assumed to be caused by the teeth and chocolate. This assumption is important - something else may actually cause it, but the person takes this as a reason/cause!

    The dental pain is much bigger punishment than not feeling neither pain, nor pleasure (not eating the chocolate), so it is avoided.

    Turning back to the donut - this "random" link/memory/recall is not random at all!

    The apparent reason that recalled the memory are the images of donuts, their smell. Also, the circumstance that the banker has been walking alone and he was thinking of something; not long ago he has met his grandparents in his village; when he was young he loved donuts...

    All these details has made him want to feel this pleasure again right then.

    Let's analyze the donut even once more:

    Konstantin: People do absurd things, which however appear to be full of deep meaning. Programmers sing - out of tune... A banker who owns millions and visits luxury restaurants once passes next to an old lady who is selling donuts; then he takes one from a dirty bag and buys a donut for 30 cents. No doubt this donut was made by a poor snotty baker, but... For the banker, this is the best food and the best thing in the world!

    The banker may possess millions, but while he's walking by the old lady on the streets, those millions are worthless. When one is walking on the street, he is supposed to follow the stimuli around him - reading the captions, watching the cars, traffic lights, passers-by. There are not luxury restaurants at every single corner, and you can't purchase a Ferrari or an airplane right there.

    The action of the banker just seems "meaningless", i.e. inappropriate, impossible to explain, because it was assumed that if one agent is a banker, then he should do this and that, and never does this-and-that. This is another example of artificial self-pruning of the search of reason/purpose, without explaining why and without an explicit cause, besides the prejudice.

    Every human being, even every humanoid robot can put his hand in a bag, catch the donut, pay and is capable to inform the others that "this is the great thing I've ever did in my life".

    There is always a possible reason to do it, if this is the best/most rewarding action that the agent has found in the current situation/planning period.


    CONTINUES with part 4/4...

    More keywords: Universal AI, Artificial General Intelligence (AGI), Behaviorism, Psychology, Control Unit


    Part 4   Intelligence: search for the biggest cumulative reward for a given period ahead, based on given model of the rewards. Reinforcement learning.

    ...



    Corrections 3.Sept.2025, 3.9.2025: 
     "not as if it wa counting machine." (if it was a counting machine) - the style can be improved in some places as well.

    * Note that there are some omissions from the complete text in Bulgarian (...), you can find the original from the first part of these English articles.

    Visit the virtual conference Self-Improving General Intelligence SIGI-2025 and find the "Prophets of the Thinking Machines": https://github.com/Twenkid/SIGI-2025/

    Read More