Notes on Judea Pearl

I’ve known about Judea Pearl and his work for many years, but I just started studying it in detail. Many recent papers I have read directly cite his work. In thinking about my model building engine theory, cause and effect is one of the central ideas that came about from that thought experiment. If humans… Continue reading Notes on Judea Pearl

The Language of Thought hypothesis and Compositionality was worked on hundreds of years before computers existed!

I just learned Gottfried Wilhelm Leibniz (1646-1716), famous for inventing calculus, was also interested in the philosophy of mind. He proposed a concept called the Alphabet of human thought, which is an idea that says there is a universal way to represent all human thought with small primitive components. With these primitive components, we should… Continue reading The Language of Thought hypothesis and Compositionality was worked on hundreds of years before computers existed!

Analysis of functional types of adjectives in the English language

The definition of an adjective is a word that modifies or describes attributes of a noun. Another definition: “Adjectives describe or limit the qualities of people, things, and abstractions.” I’m interested to understand everything about adjectives so that I can have a theory of how to better implement them into computational models. I focused on… Continue reading Analysis of functional types of adjectives in the English language

Notes on “Programs as Causal Models: Speculations on Mental Programs and Mental Representations”

I just read the paper from Nick Chater and Mike Oaksford. I found this paper from reading “Creativity, Compositionality, and Common Sense in Human Goal Generation”. Very cool paper: https://pubmed.ncbi.nlm.nih.gov/23855554/ They follow Judea Pearl’s thinking that counterfactuals and causality are central to intelligence, both natural and artificial intelligence. I know of Judea Pearl’s work and… Continue reading Notes on “Programs as Causal Models: Speculations on Mental Programs and Mental Representations”

Notes on ” Are there Semantic Primes in Formal Languages? “

Research was done comparing NSM to a few languages such as OWL,PDDL, and MOF. They found a subset of primitives are in formal languages already. The ones missing are about 40/65. So over 2/3 of these words are not in formal languages. The abstract: “Abstract. This paper surveys languages used to enrich contextual information with… Continue reading Notes on ” Are there Semantic Primes in Formal Languages? “

Notes on Neural Module Networks (NMN)

I’ve been studying Neural Module Networks from Jacob Andreas. He focuses on compositionality and grounding, my 2 favorite subjects. I just read 2 of his papers: https://openaccess.thecvf.com/content_cvpr_2016/html/Andreas_Neural_Module_Networks_CVPR_2016_paper.html https://openaccess.thecvf.com/content_iccv_2017/html/Hu_Learning_to_Reason_ICCV_2017_paper.html I’ll go over the first paper: “Deep Compositional Question Answering with Neural Module Networks” He has created a new type of neural network architecture where he builds… Continue reading Notes on Neural Module Networks (NMN)

Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”

Just read this short and sweet paper from Guy Davison et al. Brenden Lake is also a co-author, I have read several of his papers. paper link: https://psyarxiv.com/byzs5/ They built mini programs as DSLs that represent game rules. The programs act as reward generating functions (goals as reward-generating programs). Their line of reasoning follow the… Continue reading Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”

A computational definition of grounded compositionality

“The meaning of a whole is a function of the meaning of the parts and of the way they are syntactically combined”. It seems there is not a clear consensus on how we would implement compositionality in computers. I have gone through several research papers and collected several different definitions. Systematic The most common definition… Continue reading A computational definition of grounded compositionality