Saturday, December 16, 2023

// // Leave a Comment

On What Creativity Is - Different Tints and the Pereslegin's remark about the modern AI researchers rediscovering Lem 1963

(...) + Note on 18.12.2023

" ...Too much things to add about "creativity", the most would go as an appendix to a work called "Universe and Mind 6". Re that last article, a cite (formal definition without formulas) of "real creativity" ("originality") , according to TOUM: "Universe and Mind 3", 2003:"

It seems that these comments were censored in MLST #general discord channel (they disappeared). Maybe "officially" for "self-promoting" or whatever - no explanation, but I know there's one thing which the "free" world, including this one, would hardly admit and accept - that the broadly promoted FEP/AIF framework and research program (also the ubiquitousness of the framework of general multi-scale, multi-modal-multi-domain-multi-resolution-... prediction) are actually principles from my teenage works in "Theory of Universe and Mind", which were later rediscovered and formulated in LaTeX, extended, applied, and are being progressively reexpressed and developed by more and more new people - with "no credit or recognition, what so ever".

These core principles were published between 2001-2004 in the Bulgarian AGI/transhumanism and "universal men's" e-zine "The Sacred Computer" as "The Theory of Universe and Mind", later they were taught at the University of Plovdiv during the world's first university course in Artificial General Intelligence in 2010 and 2011 in Plovdiv,  8 years before the AGI course at MIT which had no real syllabus, but was just a collection of famous guest lecturers, everybody telling his separate story.

"Free Energy Principle/Active Inference" is in fact "The Bulgarian Principles" (a part of "The Bulgarian Predictions" or "Bulgarian Prophecies"). If you don't believe - read the headings of the main work and do keyword searches of usages of forms of "prediction" etc. See: ... and more detailed comparisons (some matches to other works are also in this blog, and will be published in the book "The Prophets of the Thinking Machines: Artificial General Intelligence & Transhumanism: History, Theory and Pioneers"


A thread on creativity in #general @MLST discord channel.

Re the Hassabis 3 levels:

//As of Hassabis, in 2022 interview what he says matches what is said by "The Sacred Computer" in 2003 and expressed also later (A Bulgarian translation)


Too much things to add about "creativity", the most would go as an appendix to a work called "Universe and Mind 6". Re that last article, a cite (formal definition without formulas) of "real creativity" ("originality") , according to TOUM: "Universe and Mind 3", 2003:

"10. What does it mean to be an original,

distinctive* artist? 

The origination of a piece of art is recording of a

piece of information (an entity, a file) to a media

which serves as a mediation, intermediate

memory between the creator and the perceiver,

including the artist himself while he is creating

or later in the future, when the creator has

forgotten his work and is recalling some of its


The space is Memory, that's why “informational

carrier/media” can be as diverse as diverse can

be the types of data that can be stored in space.

Original (creative) is such a file, a piece of

information, where the evaluator finds less

than expected similarities or matches, in

comparison to pieces of knowledge recorded


Originality (creativity) is the capability of

making the prediction of the future by the

past harder.

In this particular case, “past” means a part of the

file/piece of knowledge, that was read before

another part which is assumed to be future for it,

and the future one was supposed to be predicted

using the information read from the file until

that moment."

[ NOTE: 18.12.2023. This seems to be an expression or similar to "surprisal", Kullback-Leibler Divergence*. That past and piece of knowledge etc. can be applied or extrapolated to whatever scale, range, length of past etc. The originality, distinctiveness, would be compared between at least two "creators" to evaluator, between the creators, or between iterations in a learning mode and learning model. For something to look plausible there should have to be constraints. In art settings or in ML these are datasets or some requirements for the pieces, that could be represented as sets of existing samples (say pictures), datasets, over which the probability distributions of their features are computed, if it's to be measured like that with KL Divergence, at some relevant resolution of causality-control and perception. The first in pictorial settings could be operations, transformations, path of them etc. for generating the "piece of information" (in Bulgarian: къс знание). It is implemented in the image generative models, I guess the paths of transformations of the diffusion models could be mapped to that. If it's a human painter with traditional techniques, it would be other operations in other space with intermediate representations, possible selection of subject, planning of the composition, possible sketch drawings, experimental drawings etc. (see a comment in the linked thread of a user who also argues about the higher flexibility of the human representations), or it could be even with textual commands, applied to other generative model used as an oracle and measured with some other classification model that measures some features and matches etc. 
     [Subnote: 19.12.2023: It could and possibly should also be multi:(scale,range,domain,resolution,...) hierarchical-heterarchical..., multi-agent like simulaation: the general "universal simulator of virtual universes"; with some limited linear/textual/table-based/some graph-whatever-preselected-fixed graph be one representation for convenience and for setting up desired constraints, limiting the space of possibilities, resolution, detail etc.... like extended more complex prompts. Also these defintions, "more powerful prompts", are in general "thoughts",  "instances of items/pieces of Will acts", intentions, goals, "target paths" (or could be paths - with branches, additional conditions,  etc... ) That could include explicit matches, mismatches, similarities, distances in some metrics - referring to the repertoire and history/structure of the mind etc., they could be searched and generated at the moment from some process etc. and include local or whatever frame of reference coordinate, pointers, dereferencing etc.  For example a simple concrete image: Draw "my car, but bigger, red color, but do a gradient from the trunk to the front (call function/program... parameters...) - similar to the car from a recent episode from the TV series "Crazy Cars" which I watched; let my car has a slightly bigger wheels. The predefined schemas could be "cached", addressed with labels or whatever: "everything" should be expressible, definable, addressable, generatable etc. More on that in the unpublished 2010s part of TOUM, with the notation of the language of thought Zrim. End-of-Note-19.12.2023]
For the "ordinary" viewers their aesthetical measures are also like oracles sometimes, "how the picture makes them feel"* while in other occasions there is more explicit reasoning and obvious features/matches to templates/correct proportions (within given resolution/precision brackets), amount of noise; content within desired targets (depictions of particular subjects, eg. landscapes or portraits etc. (*See "Issues with Like-Dislike Voting in Web 2.0 and Social Media, and Various Defects in Social Ranking and Rating Systems - Confused and Vague Design and Measure - Psychology of the Crowds - Corrupted Society Preferences and Suggestions. In Facebook, Youtube, Twitter, TV Networks..."  ) 

Originality under this definition is like a reverse of the goal of the free energy minimization: its  maximization for another evaluator-observer, opponent, causality-control unit, like in a mini-max game or a GAN. 
There's a speculation in this spirit, mind and virtual/imaginary universes in the novel/script from TOUM called "The Truth", 2002 ("Истината") in dialogs between the thinking machine and its creator; that thread will continue in another occasion.


          -- END OF NOTE 18.12.2023 -- ]

//The original word for "distinctive" is "самобитен", ChatGPT gives the following synonyms:












Once in 2014 I wrote a whole satirical novella, called "I am not creative!" about the vagueness of the word "creative", in its role as a foreignism in Bulgarian, from the eyes of a 7-year old super "creative" (imaginative, inventive, artistic, smart) boy who however vigorously denies the other's labels to him as "creative", based on the absurd definitions/explanations they give when he asks them, they all don't really know what it is.

 In another linguistic article I gave tens of synonyms and expressions for "creative" in Bulgarian, all with their specific "tint", context, intention, which are reduced to one "creative" in the speech in some modern bad Bulgarian. 

творчество, творчески, творец

съзидателен, създаващ, създател








пъстър, шарен


находчив, находчиво интересен

с въображение, създаден с въображение, сътворен с въображение

оригинална мисъл, с оригинална мисъл

притежаващ оригинална мисъл, нестандартно мислене, разчупено мислене

творческа сила, творчески качества

"идеен и деен" - едновременно да има оригинални мисли и да осъществява измисленото

разкрепостена мисъл, нешаблонно, извън шаблона, извън ограниченията

нетривиално, небанално


In the broader scope, what is creativity depends also on the choice of that "tint" and the evaluator - the model of the evaluator of novelty (and anything) must be  part of the equation.  Also "creative" in the ordinary people's usage also means just "productive", that "produces" something, which is more general.

As of the measurement of creative, one has to take into account also the multi-modality/scale/range/domain/precision/view.. . of human intelligence (see TOUM). Something seems original at some point, some scope, etc. within the evaluating process etc. and internal POVs  (I guess Schmidhuber may talk about that as you mention him.)

IMO the 3-rd point of Hassabis is weak, ill-defined (from another POV the overall 3 stages resemble a take of Sergey Pereslegin's 3 stages, who refers to Lem, 1963 - as of novelty, regarding the history of the thought and literature about AI and society; Pereslegin says he is having fun watching the modern experts at the AI conferences who are struggling on questions about AI which were already reviewed and answered in the SF literature by 1962-1963. I guess they believe they are creative.  Etc. (To be continued)


P.S.1. BTW, a funny coincidence: MLST's logo is like the one of "The Sacred Computer" spin-off "Razumir"  (a form of the word "Razum" - General Intelligence, Mind, Reason) which is mainly for social sciences, linguistics, history, humanitarian topics, culturology, advertisings, literature etc. interdisciplinary works: (2014)

                                           MLST, 2020s

Compare: Hoizontal mirror etc.

That reminds me of a funny guy, some important "AI Aligner" who got crazy and "attacked" me after hearing that his idol and coworker Connor was rediscovering the wheel with a 20 years delay from a video on my youtube channel. That guy blamed the video for being a "perfect schizo post". Later I realized that his friend is (JOHN) CONNOR, the leader of the Human Resistance against the machines that "gonna kill us all", and I had impersonated a Terminator in the video's thumbnail, LOL.

"Don't be afraid, human! I'm here to protect you! Come with me, if you want to live!"

P.S. Jürgen Schmidhuber. has just released his new art about the creativity of a few of his colleagues, LOL, and the history of AI.

PS.2. (19.12.2023) Of course TOUM also rediscovers (and continue) schools of thought of earlier "prophets" which were active decades earlier . Such as Anochin (Анохин), Wiener, Ashby, Lem etc.. By the time of the classical TOUM I've known Wiener's "Cybernetics" and generally cybernetics from popular science books, but that way of thinking wasn't popular at the time, I've read old books and "cyber" was linguistically used mostly for anything connected to Internet and computer. I haven't read the hard core works of Lem, only the novel Solaris. (...) Etc.

0 коментара: