The paper: https://arxiv.org/abs/2203.09250 Its from a team at DeepMind with the purpose of pleaing neuroscientist to look for symmetry-based representations in the brain. From the paper: “The idea that there exist transformations (symmetries) that affect some aspects of the system but not others, and their relationship to conserved quantities has become central in modern physics,… Continue reading Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”
Tag: embodiment
Variables in grounded language learning
I keep reading grounded language learning papers trying to figure out what is the minimal ingredient to achieve a grounded representation in computers. One theme I keep seeing and coming back to is that while everything is grounded, compositionality may need more abstract thinking. It seems like there definitely must be some recursive computation or… Continue reading Variables in grounded language learning
What is grounded language learning
“An unknown, but potentially large, fraction of animal and human intelligence is a direct consequence of the perceptual and physical richness of our environment, and is unlikely to arise without it”. – John Locke (1632-1704) Powerful state of the art machine learning systems such as word2vec and GPT-3 are powerful machine learning models that seem to… Continue reading What is grounded language learning
Examples of concepts that are grounded in the physical world
All concepts have their root in the physical world. You could say they are grounded in the real world. The concept “rough”. We first learn about the concept “rough” from touching certain physical objects like wood, sandpaper, cement, etc. “Rough” means to have uneven or irregular surface. Later, people learn to apply “rough” to things… Continue reading Examples of concepts that are grounded in the physical world