I’ve been studying Neural Module Networks from Jacob Andreas. He focuses on compositionality and grounding, my 2 favorite subjects. I just read 2 of his papers: https://openaccess.thecvf.com/content_cvpr_2016/html/Andreas_Neural_Module_Networks_CVPR_2016_paper.html https://openaccess.thecvf.com/content_iccv_2017/html/Hu_Learning_to_Reason_ICCV_2017_paper.html I’ll go over the first paper: “Deep Compositional Question Answering with Neural Module Networks” He has created a new type of neural network architecture where he builds… Continue reading Notes on Neural Module Networks (NMN)
Month: March 2022
Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”
Just read this short and sweet paper from Guy Davison et al. Brenden Lake is also a co-author, I have read several of his papers. paper link: https://psyarxiv.com/byzs5/ They built mini programs as DSLs that represent game rules. The programs act as reward generating functions (goals as reward-generating programs). Their line of reasoning follow the… Continue reading Notes on “Creativity, Compositionality, and Common Sense in Human Goal Generation”
A computational definition of grounded compositionality
“The meaning of a whole is a function of the meaning of the parts and of the way they are syntactically combined”. It seems there is not a clear consensus on how we would implement compositionality in computers. I have gone through several research papers and collected several different definitions. Systematic The most common definition… Continue reading A computational definition of grounded compositionality
How to measure success of a ground-able compositional data structure
If I were able to build a data structure that can represent a set of core language primitives, how would I know if it can represent compositionality? I want to write/think about if I implement a compositional base language, how do I measure if it works for other new words. The idea is that if… Continue reading How to measure success of a ground-able compositional data structure
High Performance Evening review journal template
A moment that I really appreciated today was… A situation or task I handled well today was… Something I realized or learned today was… I could have made today even better if I… Something that could have helped me feel more connected to others today would have been… If I was mw own high performance… Continue reading High Performance Evening review journal template
Leadership is about amplification
Leadership means many different things to people. I’ve personally studied it on and off as an entrepreneur for many years. I would read articles about it, usually with lots of grand and fluffy talk. Leaders eat last, leaders are servants, leaders are tough, leaders are hardworking … It didn’t make sense to me what exactly… Continue reading Leadership is about amplification
Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”
The paper: https://arxiv.org/abs/2203.09250 Its from a team at DeepMind with the purpose of pleaing neuroscientist to look for symmetry-based representations in the brain. From the paper: “The idea that there exist transformations (symmetries) that affect some aspects of the system but not others, and their relationship to conserved quantities has become central in modern physics,… Continue reading Notes on “Symmetry-Based Representations for Artificial and Biological General Intelligence”
What is Success
“Success is doing what you want, when you want, with who you want, as much as you want.” — Tony Robbins “Success is liking yourself, liking what you do, and liking how you do it.” — Maya Angelou “Success is walking from failure to failure with no loss of enthusiasm.” — Winston Churchill “Success does… Continue reading What is Success
Causalnaughts (working title)
Scribblenaughts is a game where you are put into random scenes where you must solve a puzzle. You have a “magic notebook” where you can write out one of 23k (first version was ~2k words) different words, the object appears and potentially interacts with the world. This interaction may cause the world to change in… Continue reading Causalnaughts (working title)
shifted schedule
I will spend every week reviewing my calendar until I am happy with it. 7pm-2am sleep,meditate 2am -6am (5am – 9am) study/research 4 am (7am) light therapy 10 mins. 6am-2pm (9am-5pm pst) work 2-2:20 prepare for tomorrow 2:20-3 play/relax. Put on night glasses. 3-3:30 dinner 5pm(8pm) stop all stimulating things 6-7 meditate for an hour… Continue reading shifted schedule