Notes on Neural Module Networks (NMN)

I’ve been studying Neural Module Networks from Jacob Andreas. He focuses on compositionality and grounding, my 2 favorite subjects. I just read 2 of his papers: https://openaccess.thecvf.com/content_cvpr_2016/html/Andreas_Neural_Module_Networks_CVPR_2016_paper.html https://openaccess.thecvf.com/content_iccv_2017/html/Hu_Learning_to_Reason_ICCV_2017_paper.html I’ll go over the first paper: “Deep Compositional Question Answering with Neural Module Networks” He has created a new type of neural network architecture where he builds… Continue reading Notes on Neural Module Networks (NMN)

Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”

Just read this short and sweet paper from Guy Davison et al. Brenden Lake is also a co-author, I have read several of his papers. paper link: https://psyarxiv.com/byzs5/ They built mini programs as DSLs that represent game rules. The programs act as reward generating functions (goals as reward-generating programs). Their line of reasoning follow the… Continue reading Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”

A computational definition of grounded compositionality

“The meaning of a whole is a function of the meaning of the parts and of the way they are syntactically combined”. It seems there is not a clear consensus on how we would implement compositionality in computers. I have gone through several research papers and collected several different definitions. Systematic The most common definition… Continue reading A computational definition of grounded compositionality

Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”

The paper: https://arxiv.org/abs/2203.09250 Its from a team at DeepMind with the purpose of pleaing neuroscientist to look for symmetry-based representations in the brain. From the paper: “The idea that there exist transformations (symmetries) that affect some aspects of the system but not others, and their relationship to conserved quantities has become central in modern physics,… Continue reading Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”

What is Success

“Success is doing what you want, when you want, with who you want, as much as you want.” — Tony Robbins “Success is liking yourself, liking what you do, and liking how you do it.” — Maya Angelou “Success is walking from failure to failure with no loss of enthusiasm.” — Winston Churchill “Success does… Continue reading What is Success

shifted schedule

I will spend every week reviewing my calendar until I am happy with it. 7pm-2am sleep,meditate 2am -6am (5am – 9am) study/research 4 am (7am) light therapy 10 mins. 6am-2pm (9am-5pm pst) work 2-2:20 prepare for tomorrow 2:20-3 play/relax. Put on night glasses. 3-3:30 dinner 5pm(8pm) stop all stimulating things 6-7 meditate for an hour… Continue reading shifted schedule