Dr. Tomoyuki MAEKAWA

Home | Research | Publications


Context-aware language processing

An example of a dialogue between two speakers. With statement 9, speaker A wants to say that Tokyo is a very attractive place for her. A listener, who missed statements 7 and 8, might interpret statement 9 to mean that mountainous areas are attractive to speaker A.

A sentence is interpreted based on its context. The interpretation of a sentence can vary depending on the context in which it is used. I suggest a method for illustrating the influence of natural-language context in a clear and intuitive manner. Specifically, a Large Language Model (LLM) can rephrase a sentence to make it more specific, incorporating words from the context. The rephrased sentence conveys the contextually aware interpretation of the original sentence in natural language.

Related work

Tomoyuki Maekawa and Michita Imai, "Identifying Statements Crucial for Awareness of Interpretive Nonsense to Prevent Communication Breakdowns," Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 12550–12566, 2023. [Link]

Tomoyuki Maekawa and Wataru Takano, "Spatial representation of context-dependent sentences and its application to sentence generation," Advanced Robotics, vol. 31, no. 15, pp. 780-790, 2017. [Link]

Interactive AI systems

Example of SCAINs Presenter in use. The SCAINs Presenter presents statements that are ambiguous in interpretation or subsequently misunderstood if missed. In (a), the man misses part of the woman's statement and listens back. In (b), the man confirms the statement he missed with the SCAINs Presenter and communication proceeds smoothly.

AI-based systems can improve interactions between humans and machines, as well as between humans themselves. For instance, a system can highlight important statements during a spoken conversation to ensure that the speakers don't miss crucial information. Another system can search for ads relevant to the topic of the conversation between users, making the ads more appealing to the users. These systems have the potential to influence user behavior and mindset.

Related work

Aoto Tsuchiya, Tomoyuki Maekawa, and Michita Imai, "SCAINs Presenter: Preventing Miscommunication by Detecting Context-Dependent Utterances in Spoken Dialogue," Proceedings of the 29th International Conference on Intelligent User Interfaces (IUI), pp. 549–565, 2024. [Link]

Ryoichi Shibata, Shoya Matsumori, Yosuke Fukuchi, Tomoyuki Maekawa, Mitsuhiko Kimoto, and Michita Imai, "Conversational Context-Sensitive Ad Generation With a Few Core-Queries," ACM Transactions on Interactive Intelligent Systems (TiiS), vol. 13, no. 3, pp. 1-37, 2023. [Link]

Minami Inoue, Tomoyuki Maekawa, Ryoichi Shibata, and Michita Imai, "The Effect of Response Suggestion on Dialogue Flow: Analysis Based on Dialogue Act and Initiative," Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci), vol. 45, pp. 1974-1980, 2023. [Link]

Ryoichi Shibata, Shoya Matsumori, Yosuke Fukuchi, Tomoyuki Maekawa, Mitsuhiko Kimoto, and Michita Imai, "Utilizing Core-Query for Context-Sensitive Ad Generation Based on Dialogue," Proceedings of the 27th International Conference on Intelligent User Interfaces (IUI), pp. 734-745, 2022. [Link]

Human preference prediction

Trajectories of eye movement drawn over 12 ukiyo-e paintings. Six high-evaluated paintings and six low-evaluated paintings were chosen.

Humans need to be able to predict the likes and desires of others in order to form and maintain social relationships. It's surprising that humans can accurately predict an individual's preferences by observing their responses to just a few items. I am exploring how humans select samples and adjust their mental models of others' preferences.

Related work

Yuka Nojo, Tomoyuki Maekawa, Yuri Sato, and Kazuhiro Ueda, "Relating aesthetic-value judgment to perception: An eye-tracking and computational study of Japanese art Ukiyo-e," Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci), vol. 45, pp. 2282-2288, 2023. [Link]

Yuta Watanabe, Yosuke Fukuchi, Tomoyuki Maekawa, Shoya Matsumori, and Michita Imai, "Inferring Human Beliefs and Desires from their Actions and the Content of their Utterances," Proceedings of the 9th International Conference on Human-Agent Interaction (HAI), pp. 391-395, 2021. [Link]

Cognitive science of watching sports

Flow of a volleyball video where winning probabilites of the teams were displayed.

Sports can be seen as a probabilistic process. Before a game starts, it is uncertain which team will win. The probability of winning changes as the game progresses. At the end of the game, spectators know which team has won. I am studying the connection between the change in winning probability and the level of interest spectators have in watching the game.

Related work

Tomoyuki Maekawa and Kazuhiro Ueda, "How to Enjoy Watching One-Sided Sport Games," 2020 12th International Conference on Knowledge and Smart Technology (KST), pp. 177-181, 2020. [Link]

Tomoyuki Maekawa and Kazuhiro Ueda, "Displaying Winning Probabilities in Volleyball Interests Audiences Sensitive to Probability," 2019 11th International Conference on Knowledge and Smart Technology (KST), pp. 82-87, 2019. [Link]

Tomoyuki Maekawa, Hidehito Honda, and Kazuhiro Ueda, "Measure of the Ability Dominance of Tournament Systems and Subjective Judgment," 2018 10th International Conference on Knowledge and Smart Technology (KST), pp. 13-18, 2018. [Link]