May 11-16, 2024 | Amanda K. Newendorp, Mohammadam Sanaei, Arthur J. Perron, Hila Sabouni, Nikoo Javadpour, Madeline J. Sells, Katherine T. Nelson, Michael C. Dorneich, Stephen B. Gilbert
Apple's 1987 Knowledge Navigator video envisioned a sophisticated digital personal assistant, but the conversational agent shown in the video does not currently exist. The authors analyzed the video using three theoretical frameworks: the DiCoT framework, the HAT Game Analysis framework, and the Flows of Power framework. These frameworks were used to codify human-agent interactions and classify the agent's capabilities. While some barriers to creating such agents are technological, other barriers arise from privacy, social and situational factors, trust, and the financial business case. The social roles and asymmetric interactions of the human and agent are discussed in the broader context of HAT research, along with the need for a new term for these agents that does not rely on a human social relationship metaphor. This research offers designers of conversational agents a research roadmap to build more highly capable and trusted non-human teammates.
The KN video was produced in 1987 by Apple in only six weeks for part of their presentation at Educom, a higher education conference. The Educom presentation, including the KN video, was repeated at Macworld in January 1988, which was the public and the media's first glimpse of Apple's newest vision of human-computer interaction. A key component of this interaction was the main character, Mike, a professor at UC Berkeley, speaking with an intelligent digital assistant, Phil. Phil appears human and exists on the Knowledge Navigator, a foldable touchscreen tablet.
In the video, Mike enters his office, opens the Knowledge Navigator tablet computer, and Phil (the agent) begins speaking: "You have three messages..." Phil then describes Mike's daily schedule, and when "lecture at 4:15" comes up, Mike engages Phil to help him prepare slides for that talk. Along the way Mike notes, "There's an article about five years ago, Dr. Flemson or something," and Phil finds it: "John Fleming of Upsala University." During this search, they mention Mike's colleague Jill, who has published a recent article. Phil demonstrates the ability to pull information from multiple sources, combine it in real time, and offer simulations per Mike's requests. Eventually, they engage Jill in a videoconference to discuss her findings. The call has many features of Zoom, including screensharing (but no one says, "Can you see my screen?"). Phil is an equal participant in the video conference. At one point, when Mike and Jill are talking, Mike forgets what time his lecture is: "That's not until, um..." and Phil takes the initiative to fill in for him helpfully by saying, "4:15." Mike and Jill collaborate further and wrap up the call. Then Mike prepares to go to lunch and leaves Phil with several requests to fulfill while he is gone. This 5.5-minute video offers a vision of what conversational agent collaboration might look like. Phil is dressed in a bowtie,Apple's 1987 Knowledge Navigator video envisioned a sophisticated digital personal assistant, but the conversational agent shown in the video does not currently exist. The authors analyzed the video using three theoretical frameworks: the DiCoT framework, the HAT Game Analysis framework, and the Flows of Power framework. These frameworks were used to codify human-agent interactions and classify the agent's capabilities. While some barriers to creating such agents are technological, other barriers arise from privacy, social and situational factors, trust, and the financial business case. The social roles and asymmetric interactions of the human and agent are discussed in the broader context of HAT research, along with the need for a new term for these agents that does not rely on a human social relationship metaphor. This research offers designers of conversational agents a research roadmap to build more highly capable and trusted non-human teammates.
The KN video was produced in 1987 by Apple in only six weeks for part of their presentation at Educom, a higher education conference. The Educom presentation, including the KN video, was repeated at Macworld in January 1988, which was the public and the media's first glimpse of Apple's newest vision of human-computer interaction. A key component of this interaction was the main character, Mike, a professor at UC Berkeley, speaking with an intelligent digital assistant, Phil. Phil appears human and exists on the Knowledge Navigator, a foldable touchscreen tablet.
In the video, Mike enters his office, opens the Knowledge Navigator tablet computer, and Phil (the agent) begins speaking: "You have three messages..." Phil then describes Mike's daily schedule, and when "lecture at 4:15" comes up, Mike engages Phil to help him prepare slides for that talk. Along the way Mike notes, "There's an article about five years ago, Dr. Flemson or something," and Phil finds it: "John Fleming of Upsala University." During this search, they mention Mike's colleague Jill, who has published a recent article. Phil demonstrates the ability to pull information from multiple sources, combine it in real time, and offer simulations per Mike's requests. Eventually, they engage Jill in a videoconference to discuss her findings. The call has many features of Zoom, including screensharing (but no one says, "Can you see my screen?"). Phil is an equal participant in the video conference. At one point, when Mike and Jill are talking, Mike forgets what time his lecture is: "That's not until, um..." and Phil takes the initiative to fill in for him helpfully by saying, "4:15." Mike and Jill collaborate further and wrap up the call. Then Mike prepares to go to lunch and leaves Phil with several requests to fulfill while he is gone. This 5.5-minute video offers a vision of what conversational agent collaboration might look like. Phil is dressed in a bowtie,