-
Another step towards convergence
It strikes me that history says the opposite. ChatGPT represents another stride toward the broader trend of convergence, aligning with how the internet, industrialization, and agriculture have historically embodied the same momentum. This convergence is characterized by a gradual reduction in uncertainties that, while reducing risks and damages, also diminishes “interestingness” in human experiences. Essentially,…
-
DL weekly study notes: DNN’s Initialization and GPT4 Can’t Reason
Published on Mar 17th, 2024. Notes: Notes on GPT for Can’t reason In my view, the most compelling a priori considerations against the plausibility of reliably robust LLM reasoning turn on computational complexity results. Reasoning is a (very) computationally hard problem. In fact, in the general case (first-order or higher-order logic), it is algorithmically undecidable, i.e.,…
-
DL weekly study note: Bengio’s AI scientist, Bayesian or Frequentist, and more
Bengio’s AI scientist talk: Why greatness can’t be planned: https://youtu.be/lhYGXYeMq_E?si=EaFHRz0d1MAqQ68G Bayesian Statistics Bayesian or Frequentist, Which Are You? Basics
-
This week in dancing, week March 10
Reading my note on paper from many months ago I wrote “start with emotions and feelings first and then use techniques. Abstraction is implemented by the techniques.” Now I’m questioning if this principle is too restricting? Most of the things that I am doing and taught by Katie start with movements and we haven’t talk…
-
DL weekly study notes: DL engineering and Bengio’s AI scientist
lec3 model reproduction and experimentations: https://github.com/gangfang/makemore/blob/main/makemore_mlp.ipynb Implementation notes: High-level:
-
Experiments I ran on ChatGPT
Here is a collection of experiments I ran on ChatGPT. This is more explorative and the direction is to get the chatbot to produce results that reveal more of its nature. 1. Can ChatGPT produce texts that don’t display regularities of English language? Regularities here refer to anything that gives senses to a text, like…
-
[IN PROGRESS] Life principles for the next 10 years
This list is the principles that I hope I can stick for the next 10 years. I should come back to this and review often and hopefully this is also useful for anyone who is reading. Other useful advice that I love:
-
[IN PROGRESS] Software 2.0 and AI in charge of the whole stack to the bits
With Software 2.0, we say the broader the scope of responsibility DL takes on, the better the end results are. Using this as a prior, should we train a model to produce bits that a CPU can execute directly instead of code in a modern programming language? What is the point of producing code if…
-
Subscribe
Subscribed
Already have a WordPress.com account? Log in now.
Gang Fang's Blog 