notesum.ai
Published at October 21PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creation
cs.LG
cs.AI
Released Date: October 21, 2024
Authors: Mohi Reza1, Ioannis Anastasopoulos2, Shreya Bhandari2, Zachary A. Pardos
Aff.: 1University of Toronto, Canada; 2UC Berkeley, USA

| Lesson | Condition | N | Avg. Time (s) | Learning Gain (%) | Avg. Pre-test (%) | Avg. Post-test (%) | p-value |
|---|---|---|---|---|---|---|---|
| 1.2 | PromptHive | 29 | 480.0 | 2.31% | 74.71% | 77.02% | 0.315 |
| Control | 26 | 585.5 | 3.85% | 65.38% | 69.23% | 0.224 | |
| 2.5 | PromptHive | 31 | 663.0 | 21.50% | 47.31% | 68.81% | 0.027 |
| Control | 29 | 533.0 | 10.34% | 37.93% | 48.28% | 0.235 | |
| 3.2 | PromptHive | 33 | 449.0 | 10.11% | 50.51% | 60.62% | 0.024 |
| Control | 28 | 312.0 | 21.44% | 41.66% | 63.11% | 0.001 | |
| 4.3 | PromptHive | 34 | 579.0 | -9.80% | 80.39% | 70.59% | 0.026 |
| Control | 30 | 459.5 | -8.88% | 74.45% | 65.56% | 0.225 | |
| 5.1 | PromptHive | 25 | 1380.0 | 13.34% | 42.66% | 56.00% | 0.147 |
| Control | 29 | 748.0 | 13.80% | 34.47% | 48.27% | 0.068 | |
| 6.4 | PromptHive | 31 | 667.0 | 12.37% | 54.30% | 66.67% | 0.159 |
| Control | 25 | 444.0 | 2.67% | 56.00% | 58.67% | 0.725 | |
| 7.1 | PromptHive | 27 | 755.0 | 4.95% | 66.66% | 71.61% | 0.302 |
| Control | 29 | 1025.0 | 14.93% | 63.23% | 78.16% | 0.025 | |
| 7.7 | PromptHive | 27 | 1325.0 | 19.76% | 27.15% | 46.91% | 0.015 |
| Control | 26 | 1225.0 | 12.83% | 30.76% | 43.59% | 0.112 | |
| 8.4 | PromptHive | 21 | 880.0 | 1.60% | 52.38% | 53.98% | 0.753 |
| Control | 22 | 624.0 | -4.55% | 43.94% | 39.39% | 0.418 | |
| 9.6 | PromptHive | 23 | 1566.0 | 5.79% | 7.24% | 13.03% | 0.102 |
| Control | 24 | 1430.5 | 5.55% | 4.16% | 9.71% | 0.102 |