Dear Stefan,
Thanks for responding.
From your agreement, "machines may become conscious", one may infer that you accept the objectivity of physical function that gives rise to consciousness. And if a process is objective, then it is repeatable, it is same for all, and it applies the same way in all applicable contexts, then its description must be constructible. The process of emergence is algorithmically expressible. But then, you also add, "but in that case my assumption is that the "algorithmic" activity for that to happen will be such complex that ... no one will be able to point to those parts of the algorithmic activity that initialize a state of conscious awareness within these machines". By this addition, you seem to be taking away the same objectivity that you granted a moment ago. Somehow, you tend to maintain that consciousness is fundamentally inexplicable, and that an entity is either conscious or non-conscious as given as in a corporal sense. My effort in the following paragraphs was to show that 'association of consciousness to an entity' is a representation of semantics (meaning) that attributes consciousness to a body as a person.
Consider for a moment, the neuronal system in modular hierarchy represents meaningful information that expresses relations among objects, where one of the represented objects refers to the self in the same way as another represented object refers to 'a book', and yet another object refers to the 'act or reading'. The three combined together in conjunction refers to, "I am reading a book". Every object is referable by the constancy of its relation with other objects, and constancy of structural relation among component objects. Try constructing a description by any other relations, and you will know that these are the only two ways to construct a description of any object. Hence, the mechanism of representation of semantic value (meaning) is knowable for all objects including the self.
For instance, when we refer to pain in our hand, the represented semantic value includes a reference to the hand as a component of the represented unified system, the specifics of pain, the specifics of location, etc. Now, the point is that, for this to be represented, hand need not exist, as is established from phantom limb experiments and dream events. That is, the sense of pain is a semantic attribution to the represented extension of the body, as the attribution of consciousness to the represented unified self. The attribution of all this characteristics to an unified system as unitary referable system composes the self with the semantics of knower, actor, and controller; it is that represented self that gets referred to in an expression like, 'I know', 'we know', etc. As I referred to a publication, where the physics or mechanics of representing and processing of semantic values (meanings) of information has been worked out.
If it makes good sense to you, then reconsider the statement, "We know X", and determine how it is constructed. So, if we know the mechanism of how to build structured and abstract semantics via organized phyiscal interaction, then we can lay down the algorithm, and we also know what processing constructs the self with the associated properties of consciousness.
Rajiv