I could do the same with any program that I may write, but am I really doing? I am merely giving the user the impression that my program is happy that it won. However, the program is not really aware that it won, is it?
Again, think of the Chinese Room. The people outside the room fully believe they are talking to native Chinese speakers in the room (that they cannot see). However, if we are inside the room we realize that there is no native speaker - in fact no one understands Chinese.
This conflicts with actual human experience. We are not merely automatons that process data and simply give the appropriate response that our genes via evolution are required to give. Rather, we experience an awareness of understanding.
I know you think this is programmable, but I have not the slightest idea how to do it. It's not computer processing power that would limit my ability to create such a program, rather I don't have the foggiest idea on how to code something like that, do you?
All of my ideas would simply boil down to people inside a Chinese room who would not understand the language. I can only fool the user of the program into believing that my program is as they are, but in actual fact my program cannot understand a word they are saying. It simply breaks down their sentences into recognizable segments ('you', 'that', 'now', etc) and looks up the actions based on the digital representation as it is translated by an analog receiver. At no point does my program understand what is being said.
This is the problem with strong AI and the reason that we have not found a way to develop conscious AI life forms. It seems that without any major innovation in software design all we can do is fool the user - we cannot code awareness. We just have not the foggiest idea how to do it.
Warm regards, Harv