What work have you done in machine learning? What areas have you focused your research? Have you done any theoretical work vs applied work? Have you spent any time in neuroscience or cognitive science? Have you reimplemented any papers on your own? What is the biggest difficulty you find in working in AI? What is… Continue reading Some questions I would ask AI researchers
Tag: research
NSM notes
I have been studying natural semantic metalanguage (NSM). It has been studied and cross-referenced fom 30+ languages. the core 65 changes several times, in the beginning it was 13 core concepts. It is as objective as it can to study human language, but of course there is still some subjectivity in it. Some words they… Continue reading NSM notes
skills needed to run a research lab
leading and helping people raising money PM projects prioritizing and delegating charisma ideation execution researching and sorting lots of information writing skills for papers, proposals, and inspiring thinking – finding the key to solutions experimenting – being able to run experiments
Sci-Hub is one of the greatest contributions to humanity in our lifetime
What is the point of academic research? In my mind it is to accelerate human understanding and civilization. If researchers publish research, it should be available for anyone to research. If people want to view that research, it should be available for anyone to view without paying some crazy fee. A large portion of academic… Continue reading Sci-Hub is one of the greatest contributions to humanity in our lifetime
Notes on “Time, space, and events in language and cognition: a comparative view”
I recently learned about Peter Gärdenfors and his idea on conceptual spaces using Voronoi tesselations. I have been reading through some of his papers and came across this paper that he co-authored with Chris Sinha in 2014: Time, space, and events in language and cognition: a comparative view I have been studying time as well… Continue reading Notes on “Time, space, and events in language and cognition: a comparative view”
Notes on “Programs as Causal Models: Speculations on Mental Programs and Mental Representations”
I just read the paper from Nick Chater and Mike Oaksford. I found this paper from reading “Creativity, Compositionality, and Common Sense in Human Goal Generation”. Very cool paper: https://pubmed.ncbi.nlm.nih.gov/23855554/ They follow Judea Pearl’s thinking that counterfactuals and causality are central to intelligence, both natural and artificial intelligence. I know of Judea Pearl’s work and… Continue reading Notes on “Programs as Causal Models: Speculations on Mental Programs and Mental Representations”
Notes on ” Are there Semantic Primes in Formal Languages? “
Research was done comparing NSM to a few languages such as OWL,PDDL, and MOF. They found a subset of primitives are in formal languages already. The ones missing are about 40/65. So over 2/3 of these words are not in formal languages. The abstract: “Abstract. This paper surveys languages used to enrich contextual information with… Continue reading Notes on ” Are there Semantic Primes in Formal Languages? “
Notes on Neural Module Networks (NMN)
I’ve been studying Neural Module Networks from Jacob Andreas. He focuses on compositionality and grounding, my 2 favorite subjects. I just read 2 of his papers: https://openaccess.thecvf.com/content_cvpr_2016/html/Andreas_Neural_Module_Networks_CVPR_2016_paper.html https://openaccess.thecvf.com/content_iccv_2017/html/Hu_Learning_to_Reason_ICCV_2017_paper.html I’ll go over the first paper: “Deep Compositional Question Answering with Neural Module Networks” He has created a new type of neural network architecture where he builds… Continue reading Notes on Neural Module Networks (NMN)
Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”
Just read this short and sweet paper from Guy Davison et al. Brenden Lake is also a co-author, I have read several of his papers. paper link: https://psyarxiv.com/byzs5/ They built mini programs as DSLs that represent game rules. The programs act as reward generating functions (goals as reward-generating programs). Their line of reasoning follow the… Continue reading Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”
Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”
The paper: https://arxiv.org/abs/2203.09250 Its from a team at DeepMind with the purpose of pleaing neuroscientist to look for symmetry-based representations in the brain. From the paper: “The idea that there exist transformations (symmetries) that affect some aspects of the system but not others, and their relationship to conserved quantities has become central in modern physics,… Continue reading Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”