-
Compositionality
It helps IID and OOD generalization because lower level features in smaller quantities can be combined in different way to generalize to something out of distribution of the training data. It has forms such as: And the Bengio’s goal is to introduce more forms of compositionality.
-
Dual process theory and key questions in SOTA DL
As I understood more about how Type 1 / Type 2 processing is defined and what the Global Workspace Theory for consciousness is about. I came to realized while Type 2 cognitive processing and consciousness explained by GWT share a striking similarity, namely, they both require the working memory to hold and process elements coming…
-
Ear training for dancing
Concepts: Timbre, tone and texture https://www.musical-u.com/learn/topic/ear-training/timbre/https://www.musical-u.com/learn/hearing-tone-timbre-texture/ Timbre Active listening: https://www.musical-u.com/learn/how-to-hear-more-in-the-music-you-love/ Ear training on timbre and frequency in bass drums: https://www.musical-u.com/learn/music-production-listening-skills-timbre-frequency-and-bass-drums/
-
The Dual Process Theory and its Criticisms
What is the precise definition of system 1 and system 2? I was discussing with Genia the other day and realized I was describing their characteristics and giving examples, which most of other people do. But I wasn’t really talking about the definition Kahneman provided in his research. Okay, so in the book Thinking Fast…
-
Consciousness Research
Concepts The brain’s processing of information and our experience of that processing. And the experience is what we called consciousness. Consciousness is our awareness of ourselves and our environment. Everything psychological is simultaneously biological. Dual processing: the principle that information is simultaneously processed on separate conscious and non-conscious tracks. Selective attention: the focusing of conscious…
-
Noteworthy ideas in “Power and Politics in Today’s World”
The three I’s to consider when examine an political event Interests, Ideals and Institutions The sign of a weak state and the sign of a weak political party The sign of a weak state: An inability to collect tax the sign of a weak political party: Individuals are at the forefront and they look after…
-
Thoughts on youth dancers/battlers
I went to the Massive Monkees Day battle yesterday, with a headache and pretty bad shoulders. I went anyway because a friend responded to my team up request and I had to be there for him, it was a 2v2 battle. The crew we battled is gigabot crew, or two members of the gigabot crew.…
-
World Model
Bengio’s world model Bengio’s concept of world model is a generative model that learns the abstract structure, or abstraction, of x. And this is similar to how human learns and understands the world. This is powerful because this enables training with far less data (because we don’t operate at the low level anymore) and better…
-
Discriminative function/model vs. Generative model
Do “discriminative function” and “discriminative model” refer to the same thing? In general, yes, they refer to models that define the decision boundary between classes, like logistic regression, SVM and most ANNs. The only difference, in a more specific context, is a discriminative function can refer to the actual mathematical function that takes the input…
-
GWT – Global Workspace Theory
What is it? Global Workspace Theory (GWT) is a cognitive architecture and theory of consciousness proposed by psychologist Bernard Baars. This theory is often used to explain various aspects of human cognition, including attention, perception, and action. The central metaphor of GWT is a “theater of consciousness.” In this theater, the conscious mind is like…
-
Subscribe
Subscribed
Already have a WordPress.com account? Log in now.
Gang Fang's Blog 