notesum.ai
Published at November 11Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapy
cs.HC
cs.AI
Released Date: November 11, 2024
Authors: Xin Sun1, Jan de Wit2, Zhuying Li3, Jiahuan Pei4, Abdallah El Ali5, Jos A. Bosch6
Aff.: 1University of Amsterdam and Centrum Wiskunde & Informatica (CWI), The Netherlands; 2Tilburg University, The Netherlands; 3Southeast University, China; 4Vrije Universiteit Amsterdam, The Netherlands; 5Centrum Wiskunde & Informatica (CWI) and Utrecht University, The Netherlands; 6University of Amsterdam, The Netherlands

| CA Conditions | Metric 1 | Metric 2 |
|---|---|---|
| Rule-based (as oracle) | 100.00 | 98.81 |
| Pure LLM | 85.71 | 12.62 |
| LLM-SAG (Prompt) | 97.62 | 96.42 |
| LLM-SAG (FT) | 71.43 | 70.24 |