[Demonstration experiment] Consider “Visualization of conversation counseling interview evaluation method” with Startline CO.,LTD.

Pixie Dust Technologies, Inc. (Headquarters: Chiyoda-ku, Representative Director Yoichi Ochiai, Taiichiro Murakami, hereinafter "PxDT"), which is engaged in research and development and commercialization in the personal care and diversity area and the workspace area, is an industry that aims to create innovation. With the cooperation of the academia open innovation platform Tokyo Marunouchi Innovation Platform (TMIP), Startline CO.,LTD. (Headquarters: Mitaka-shi, Tokyo, Representative Director: Kenji Nishimura), which aims to be a "society where everyone lives their own way" through employment support for people with disabilities. In order to develop a new evaluation method for counseling interviews, we examined the demonstration test "Visualization of conversation, counseling interview evaluation method."

A joint presentation at an event hosted by TMIP

TMIP, which provides a demonstration field for creating innovation, has matched our technology with PxDT, and from May 2022, the three companies have started demonstration tests to solve problems.

Background of the demonstration experiment

Through our support of companies' employment of people with disabilities, we provide counseling interviews to people with disabilities. Our employees who conduct counseling interviews have undergone training to acquire supportive techniques such as ACT (hereafter referred to as third-generation cognitive-behavioral therapy) and Applied Behavior Analysis. Furthermore, we have been engaged in on-the-job training and skill development training to improve our counseling techniques.
In a general counseling interview, the end of the interview is clear because the counselor and client set a common goal. However, the evaluation of how counseling interviews were conducted was largely based on the counselor's subjectivity, and there was a problem that objective evaluation was difficult.
The purpose of this demonstration experiment was to conduct counseling interviews using ACT, analyze video and audio data of the counselor and client during the counseling interview, and develop a new evaluation method for counseling interviews.

Image of the ACT counselling interview

Implementation method and data analysis method

ACT-based interviews will be conducted online with counselors (interviewers) and clients (interviewers). Video data of counselors and clients during interviews, audio data of counselors and clients, and three data points are sent to PxDT. PxDT conducted an analysis using conversation visualization technology, and based on the analysis results, the effectiveness of counseling was verified.

Reference: Part of visualization technology (voice recognition, Speed to text, text mining, word cloud) analysis results

Word cloud analysis result / score order

[Description] Score based not only on the number of appearances but also on characteristic words.
The colors of the letters are blue for nouns, red for verbs, green for adjectives, and gray for sensitive verbs.
* The score order is "words that appear frequently in general documents are not important, so lighten the weighting," on the other hand, words that do not appear often in general documents but often appear only in the documents to be surveyed. Refers to the scoring result with an emphasis mechanism.
TF-IDF (term frequency–inverse document frequency) statistical processing method is used.

Changes in the number of utterance characters and changes in the type of words used

[Explanation] For all four interviews, the "transition of the number of utterance characters" and "transition of the type of words used" of each counselor and client are displayed in a graph.

Achievements obtained
・ Visualization of changes and effects (partial) of the client's thinking through ACT counseling
・ It is easy to understand at what timing and to what extent a specific word was spoken (e.g., value, face)
・ It is easy to review the interview by having visualized outputs such as numerical values and graphs.
・ There is a tendency and new awareness of the counselor's involvement, and it is easy to self-analyze (e.g., there are more phases than you can imagine, and exclamations are often used)
・ It is easy to prepare for the next interview (e.g., the ratio of the amount of speech between the counselor and the client should be 7:3 next time)

Discussion and future prospects
We believe that the "conversation visualization" technology provided by PxDT is likely to be used as an evaluation method for ACT counseling interviews. In addition, since the evaluation can be changed according to the counselor's counseling level, it is assumed that it will be useful for the training of counselors, and we will continue to work on the development of evaluation methods for counseling interviews.

Company Profile

[TMIP (Tokyo Marunouchi Innovation Platform)]
TMIP is an organization run by the Association for the Promotion of Environmentally Conscious City Development in Daimaru-Yu, an open innovation platform that aims to create an innovation ecosystem in the Marunouchi area (Otemachi, Marunouchi and Yurakucho) for the global market by bringing together large corporations, start-ups, government and academia to solve social issues. Including members and partners, there are more than 150 organizations.
https://www.tmip.jp/ja/

[Startline CO.,LTD.]
https://start-line.jp
With effective and professional support based on ABA (Applied Behavior Analysis) and third-generation cognitive behavioral therapy, it is a company that realizes a one-stop service from creating a new "place" for employment of people with disabilities to supporting retention.
Based on the corporate philosophy of "I care about myself, I care about people, and I care about the future," since its founding in 2009, we have focused on "recruitment" and "establishment" of people with disabilities in the area of employment support for people with disabilities. Operate satellite office services. Focusing on comprehensive consulting on the employment of people with disabilities, we are expanding our service menus such as IBUKI, an indoor farm-type employment support service for people with disabilities, BYSN, a roastery-type employment support service for people with disabilities, customized training for companies / people with disabilities, home employment support, and employment support for people with disabilities. By creating as many options as possible and expanding the possibilities of diverse people, we aim to create a society where everyone lives their own lives.