Entropic Learning Model. I have tried to make a thinking or…
By: John Von Neumann Ii
Tags: 2019, Autobiography, Learning, September, Entropy

Entropic Learning Model

A learning model based on the local, internal reduction of entropy a.k.a. your brain

I have tried to make a thinking or learning model based around the concept of reducing entropy locally, in this case our brains and possible extended phenotypic effects (like making tools). It is a combination of Kolb’s experiential learning cycle and Bloom’s taxonomy of learning. I have omitted some and changed some phases. In short, this is what Bloom’s taxonomy looks like: knowledge, comprehension, application, analysis, synthesis, and evaluation.

Knowledge — like knowing what a muscle is

Comprehension — why certain muscles are built the way they are

Application — by knowing how muscles are built and why, how to use that knowledge to build bigger muscles efficiently

Analysis — how different muscles are different (smooth versus skeletal or small vs big muscles)

Synthesis — knowing how muscles work, look, fatigue etc., now putting a workout routine together

Evaluation — why one workout routine is better (for you) and why something else is worse

And Kolb’s experiential learning theory goes as follows: experience, observe, conceptualize, and experiment. (See more: 08/18/2019 — Kolb’s experiential learning theory)

So I put these together and formed what I will call the Entropic Learning Model: experience, observe, inductive reasoning, deductive reasoning, application, synthesis, antithesis, experiment, diffuse mode, and efficient repetition.

It is based around the idea of forming as many and as strong brain connections possible by reducing entropy locally (within the brain). This, hopefully, also reduces entropy locally outside the brain as much as possible (through extended phenotypic effects). Although the latter is more uncertain than the former.

I. Experience

Experience is something like burning your hand. Remember, this phase is without any judgements like “I was stupid” or “this is bad”. The experience without judgement is what the Stoics called phantasiai, which is a word also used in psychology to refer to fantasies not within or generated by oneself, albeit they use the word phantasia.

II. Observe

This is the phase where judgement comes along. Burning my hand makes me an idiot. Or this was unfortunate. Applying judgements to experiences is what the Stoics called hypolapsis. So far, the first two are happening pretty much subconsciously, although the awareness of it can certainly help in becoming more Stoic by experiencing the things without calling them good or bad.

III. Inductive reasoning

This is the phase where we ‘build the puzzle’. Our experiences and observations are our puzzle pieces which we can put together. An example is the two puzzle pieces ‘burning hand’ and ‘hot fire’, put them together and you get the whole puzzle which says ‘if I put my hand in hot fire, my hand will burn’. This process has been done through what is called inductive reasoning. Or if you want a more complex but official definition:

Inductive reasoning: characterized by the inference of general laws from particular instances.

Particular instances → puzzle pieces

General laws → putting the puzzle pieces together and form the puzzle (the general law) e.g. relativism

IV. Deductive reasoning

This is the phase where you have built or received a (mostly) complete puzzle work and you apply it to certain experiences. The puzzle which says ‘if I put my hand in hot fire, my hand will burn’ and you happen to use deductive reasoning, you will see that it counts for everything that is hot enough, not just fire. For a more official definition:

Deductive reasoning: characterized by or based on the inference of particular instances from a general law.

V. Application

This is where action plays a role. One has to remember that not knowledge is power, but action, the ability to do things externally. Or more precisely, how much entropy you can reduce locally. Knowing how to build muscles through empirical data is one thing, but also applying it to yourself is the next step. Many more factors will appear like how much mental or physical energy you got, which makes working out 6 times a week not an option for you, even though empirical data says it is overall the best muscle-building frequency.

VI. Synthesis

In this phase, you ask yourself the question “so what does this remind me of?” or “can I use this knowledge to transfer it to something else I am trying to understand”. Again, this is a phase that happens pretty much subconsciously when repeated enough, but it can still be worthwhile to be aware of it. This phase is important in order to learn new things exponentially — learning certain things and remembering it makes learning new things easier and faster and so on.

VII. Antithesis

Now, we essentially try to find the polar opposite of something e.g. universalism is the opposite of relativism. Positive and negative. Top-down thinking and bottom-up thinking etc. This phase is a really efficient phase that I myself tend to forget occasionally, because it is as simple as trying to find the opposite of something you already know. It is like doubling your knowledge with much more ease than discovering the antithesis of something by random luck.

VI + VII — von Neumann two-factor model box

So this is an optional phase, because not always is it really efficient to use this one in learning new things. It is, however, a nice way of being creative consciously rather than having the creativity appear subconsciously like when you are having a shower. Putting the ‘synthesis’ and ‘antithesis’ opposite to each other and you get what I will call a von Neumann two-factor model box. I named it after him, because he is the creator, or at least a great contributor to the game theory which makes use of this so-called box. I will make a dedicated chapter about John von Neumann in the future, because he is one of my inspirations.

What are some examples of such ‘von Neumann two-factor model boxes’?

Well, Pascal’s wager is a nice one (you can Google it).

Or a nice one I found on the internet when I was discussing the relation between free will and its possible consequences on behavior. It is a modification of Pascal’s wager:

In short, this von Neumann two-factor model box says that if free will ‘Doesn’t Exist’ but you have a ‘Disbelief’ in it, then your gain and lose is equal to zero, and the other ones you can reason yourself. But essentially, this box says that the best option you can take is to ‘Belief’ free will ‘Exists’, because if you compare it to the other options and their descriptions, this one has the highest gain.

VIII. Experiment

This is a phase where you are truly free with asking questions or proposing thought experiments in any way you like. Personally, I like to begin with the questions ‘why not?’ or ‘what if’. Examples are, why not just do whatever you want in your life or what if the maximum cosmic speed limit was infinity.

IX. Diffuse mode

See the chapter: 09/10/2019 — Learning How to Learn: Powerful mental tools to help you master tough subjects, Focused Mode for more information about the focused and diffuse modes.

After all the previous 8 phases where you mostly used the focused mode, you now do something relaxing like taking a shower, gaming, physical exercise, and whenever something pops up in your mind, whether about the subject you are learning or anything else, you simply think about it and note it down somewhere. This phase is so important in terms of creativity that I made it a separate phase to continuously be aware of it.

X. Efficient repetition

This is where you note down everything you have learned and use spaced repetition in order to keep things fresh in your mind. It should not just be spaced, but also efficient in a manner where you experience the least diminishing returns. Solving the same problem in a spaced repetitive manner is not as efficient as solving a problem and using that knowledge to solve more complex ones. This is also called deliberate practice.

Learning Model and its relation to Entropy

Entropy plays a big role in many things including learning and taking action. This Entropic Learning Model is therefore dedicated in trying to reduce entropy locally as much as possible. It is based on the idea that if you reduce entropy internally (in your brain), then the value of its reduction will also reflect on the outside (the future, other humans, actions etc).

How is entropy reduced internally, that is, in your brain?

Well, by all kinds of mechanisms like potentiation, myelination, making more connections, making neural pathways more efficient (through synaptic pruning), creating bigger chunks, making connections with a longer cerebral distance etc.

This model also follows the inside-out mindset: first working on things that are most within your control (yourself, the present etc.) before working on things that are least within your control (other people, the future etc).