-
System 2 AI, DL – Jan 21, 2024
I have been challenging myself my notion that in order for a system to conduct deliberate thinking, its design has to have some certain inductive biases that underpin such an ability in human. But then I read that these days neuroscience’s inspirations on DL are more limited than I used to think, I started to…
-
DL theory study – Jan 20, 2024
DL by IG, YB and AC I have been reading the Introduction of the book and here are some notes:
-
DL implementation study – Jan 19, 2024
Building Micrograd Complete Micrograd notebook: https://github.com/gangfang/micrograd/blob/main/micrograd.ipynb
-
Can ChatGPT understand? A tiny case study – Jan 16, 2024
Can current machines understand? One observation that seems to be strongly showing ChatGPT doesn’t reason but merely imitate language formations is that it responds to more complex contextual information completely differently depending on the phrasing of the question, especially whether positivity or negativity is implied when a why question is asked. This shows that the…
-
DL implementation study, Jan 13, 2024
Building micrograd Notes Questions Why are gradient descent or its variants used to optimize parameters instead of solving the loss function analytically for its minima? AN: complex loss functions aren’t easily solvable analytically
-
DL implementation training – Jan 12, 2024
After a week of absence, I am finally back here writing. I was in contact with someone helpful and important who is already doing my dream research and is willing to guide me through my system 2 journey. And I was planning my next chapter of study, which is planned to last 3 months (or…
-
What does Bengio have to say about consciousness? – Jan 3-5, 2024
I have studied the science of consciousness, particularly GWT, and the influence of that on constructing system 2 AI. The remaining perspective I haven’t examine is the AI scientists’ ideas on consciousness. I asked the question: if system 2 AI is successful, could it be used to simulate consciousness? I have already got a preliminary…
-
Subscribe
Subscribed
Already have a WordPress.com account? Log in now.
Gang Fang's Blog 