Category: AI
-
GWT – Global Workspace Theory
What is it? Global Workspace Theory (GWT) is a cognitive architecture and theory of consciousness proposed by psychologist Bernard Baars. This theory is often used to explain various aspects of human cognition, including attention, perception, and action. The central metaphor of GWT is a “theater of consciousness.” In this theater, the conscious mind is like…
-
Study Probabilistic Modeling
I have studied everything until 2.1. Methods such as maximum likelihood and Bayesian parameter estimation are used to learn probabilistic models. Probabilistic modeling deals with uncertainties and is used to predict probability of future events. To paraphrase, probabilistic models output a probabilistic distribution over possible answers.
-
Amortized inference
“This raises the problem of amortized inference: howto flexibly reuse inferences so as to answer a variety of related queries” What does this mean exactly? And why does the reward function representing the prior x likelihood makes it so? “This makes GFlowNets amortized probabilistic inference machines that can be used both to sample latent variables…
-
GFlowNets study notes
GFlowNet is really MANY THINGS IN ONE THING. And I need to put all aspects together in order to fully understand it. Like, how is this a stochastic policy in the light of it being a generative model i.e., P(y,x)? Generative active learning, reinforcement learning, stochastic policy, generative model, energy-based probabilistic modelling, variational models and…
-
How do GFlowNets relate to attention or human thinking?
How is that related to attention? It makes sense to consider deterministic transitions when the policy is an internal policy, not operating in some stochastic external environment, but instead performing computational choices (like what to attend to, what computation to perform, what memory to retrieve, etc). Immediately, GFlowNets are motivated by the kind of internal…
-
AI study blog 1
In Yoshua’s blog post introducing the GFlowNets, most concepts used to describe the new framework are something I don’t know. So, the first phase is to understand all basic concepts: