Hi Douglas,
Thanks for the interesting essay.
I think you might find some connection with my essay on computationally intelligent personal dialogic agents. This system (I have a prototype developed as part of a NSF CAREER award) can "steer" individual interactions by providing guidance in the moment of action. I envision many kinds of evaluation incorporating a multitude of factors as the system "tests" different interventions in human dialogue. It will be able to take your idea of evaluating many small projects and moving them to the level of conversations.
I'd appreciate a rating, if you can do that, since I am a bit short on ratings, and also appreciate it if you know of any potential collaborators in the further development of the dialogic system.
Thanks,
Ray Luechtefeld, PhD