Dear Georgina,
I read your essay with great interest, particularly your warnings about biases and your identification of goals as based on imagined futures.
I agree with much of your analysis. I also noticed that you cited Kahneman's "Thinking Fast and Slow", which points out the illusions in our conscious thinking.
In my own essay, "No Ghost in the Machine", I also cited Kahneman, and identified a series of illusions that have obscured our understanding of intelligence and consciousness.
I further propose that consciousness may reflect a specific evolved brain structure based on an adaptive neural network, which creates a simplified dynamical model that recognizes self and other agents in a causal world. I also point out the role of dreams as an alternative consciousness without external sensory input. Finally, analogous electronic networks may be developed to create true artificial intelligence.
Alan Kadin