Review Article

The role of technology in performance feedback on teacher practice: A systematic review

Caitlin J. Criss 1 * , Adam C. Carreon 1 , Cynthia C. Massey 1 , Allison Davis 1
More Detail
1 Georgia Southern University, Statesboro, GA, USA* Corresponding Author
International Journal of Professional Development, Learners and Learning, 7(1), January 2025, e2501, https://doi.org/10.30935/ijpdll/15690
Submitted: 03 June 2024, Published Online: 05 December 2024, Published: 01 January 2025
OPEN ACCESS   168 Views   64 Downloads
Download Full Text (PDF)

ABSTRACT

Evidence-based practices (EBPs) are proven effective in increasing student achievement in the classroom; however, teachers’ use of EBPs is far below the recommended rate. Performance feedback offers a potential solution to increase teachers’ use of EBPs, and advancements in technology allow performance feedback to be delivered in innovative ways. In this systematic review, we examine 24 experimental studies in which performance feedback is delivered to teachers through various technologies. Overall, the review discovered that technology was primarily used during the training phase of intervention, and real-time feedback was the most common method for delivering feedback. Additionally, generalization and maintenance measures were limited, and there were inconsistencies in the length of intervention. We discuss why the current uses of technology with performance feedback may be limited or outdated and provide recommendations for researchers, teachers, and teacher educators to expand the use of technology within performance feedback.

CITATION (APA)

Criss, C. J., Carreon, A. C., Massey, C. C., & Davis, A. (2025). The role of technology in performance feedback on teacher practice: A systematic review. International Journal of Professional Development, Learners and Learning, 7(1), e2501. https://doi.org/10.30935/ijpdll/15690

REFERENCES

  1. Aljadeff-Abergel, E., Peterson, S. M., Wiskirchen, R. R., Hagen, K. K., & Cole, M. L. (2017). Evaluating the temporal location of feedback: Providing feedback following performance vs. prior to performance. Journal of Organizational Behavior Management, 37(2), 171–195. https://doi.org/10.1080/01608061.2017.1309332
  2. *Amendum, S. J., Bratsch-Hines, M., & Vernon-Feagans, L. (2018). Investigating the efficacy of a web-based early reading and professional development intervention for young English learners. Reading Research Quarterly, 53(2), 155–174. https://doi.org/10.1002/rrq.188
  3. *Bradshaw, C. P., Pas, E. T., Debnam, K. J., & Johnson, S. L. (2021). A randomized controlled trial of MTSS-B in high schools: Improving classroom management to prevent EBDs. Remedial and Special Education, 42(1), 44–59. https://doi.org/10.1177/07419325209667
  4. *Brown, P., Stephenson, J., & Carter, M. (2014). Multicomponent training of teachers of students with severe disabilities. Teacher Education and Special Education, 37(4), 347–362. https://doi.org/10.1177/0888406414546873
  5. Cavanaugh, B. (2013). Performance feedback and teachers’ use of praise and opportunities to respond: A review of the literature. Education and Treatment of Children, 36(1), 111–137. https://doi.org/10.1353/etc.2013.0001
  6. *Cheek, A. E., Rock, M. L., & Jimenez, B. A. (2019). Online module plus eCoaching: The effects on special education teachers’ comprehension instruction for students with significant intellectual disability. Education and Training in Autism and Developmental Disabilities, 54(4), 343–357.
  7. *Chen, G., Chan, C. K. K., Chan, K. K. H., Clarke, S. N., & Resnick, L. B. (2020). Efficacy of video-based teacher professional development for increasing classroom discourse and student learning. Journal of the Learning Sciences, 29(4–5), 642–680. https://doi.org/10.1080/10508406.2020.1783269
  8. *Coogle, C. G., Rahn, N. L., Ottley, J. R., & Storie, S. (2016). Ecoaching across routines to enhance teachers’ use of modeling. Teacher Education and Special Education, 39(4), 227–245. https://doi.org/10.1177/0888406415621959
  9. Cook, B. G., & Odom, S. L., (2013). Evidence-based practices and implementation science in special education. Exceptional Children, 79(2), 135–144. https://doi.org/10.1177/0014402913079002021
  10. Cooper, J. O., Heron, T. E., & Heward, W. L. (2020). Applied behavior analysis (3rd ed.). Pearson.
  11. Cornelius, K. E., & Nagro, S. A. (2014). Evaluating the evidence base of performance feedback in pre-service special education teacher training. Teacher Education and Special Education, 37(2), 133–146. https://doi.org/10.1177/0888406414521837
  12. Criss, C. J. (in press). The effects of temporal timing of performance feedback on novice teachers’ use of behavior-specific praise. Education and Treatment of Children. https://doi.org/10.1007/s43494-024-00135-y
  13. Criss, C. J., Konrad, M., Alber-Morgan, S. R., & Brock, M. E. (2024a). A systematic review of goal setting and performance feedback to improve teacher practice. Journal of Behavioral Education, 33(2), 275–296. https://doi.org/10.1007/s10864-022-09494-1
  14. Criss, C. J., Konrad, M., Alber-Morgan, S. R., Brock, M. E., & Harris, A. B. (2024b). Using performance feedback with and without goal setting on teachers’ classroom management skills. Behavioral Disorders, 49(2), 91–105. https://doi.org/10.1177/01987429231201096
  15. *Cuticelli, M., Collier, M. M., & Coyne, M. (2016). Increasing the quality of tier 1 reading instruction: Using performance feedback to increase opportunities to respond during implementation of a core reading program. Psychology in the Schools, 53(1), 89–105. https://doi.org/10.1002/pits.21884
  16. Darling-Hammond, L., Hyler, M. E., & Gardner, M. (2017). Effective teacher professional development. Learning Policy Institute. https://doi.org/10.54300/122.311
  17. Ennis, R. P., Royer, D. J., Lane, K. L., & Dunlap, K. D. (2020). Behavior-specific praise in pre-K-12 settings: Mapping the 50-year knowledge base. Behavioral Disorders, 45(3), 131–147. https://doi.org/10.1177/0198742919839221
  18. Every Student Succeeds Act. (2015). Every Student Succeeds Act, 20 U.S.C. § 6301. http://congress.gov/114/plaws/publ95/PLAW-114publ95.pdf
  19. *Fallon, L. M., Cathcart, S. C., DeFouw, E. R., O’Keeffe, B. V., & Sugai, G. (2018). Promoting teachers’ implementation of culturally and contextually relevant class‐wide behavior plans. Psychology in the Schools, 55(3), 278–294. https://doi.org/10.1002/pits.22107
  20. Fallon, L. M., Collier-Meek, M. A., Maggin, D. M., Sanetti, L. M. H., & Johnson, A. H. (2015). Is performance feedback for educators an evidence-based practice? A systematic review and evaluation based on single-case research. Exceptional Children, 81(2), 227–246. https://doi.org/10.1177/0014402914551738
  21. *Fawley, K. D., Stokes, T. F., Rainear, C. A., Rossi, J. L., & Budd, K. S. (2020). Universal TCIT improves teacher-child interactions and management of child behavior. Journal of Behavioral Education, 29(4), 635–656. https://doi.org/10.1007/s10864-019-09337-6
  22. *Gage, N. A., Grasley-Boy, N. M., & MacSuga-Gage, A. S. (2018). Professional development to increase teacher behavior‐specific praise: A single‐case design replication. Psychology in the Schools, 55(3), 264–277. https://doi.org/10.1002/pits.22106
  23. Gage, N. A., MacSuga-Gage, A. S., & Crews, E. (2017). Increasing teachers’ use of behavior-specific praise using a multitiered system for professional development. Journal of Positive Behavior Interventions, 19(4), 239–251. https://doi.org/10.1177/1098300717693568
  24. *Garland, D. P., & Dieker, L. A. (2019). Effects of providing individualized clinical coaching with bug-in-ear technology to novice educators of students with emotional and behavioral disorders in inclusive secondary science classrooms. Journal of Inquiry and Action in Education, 10(2), 23–40.
  25. *Garland, K. M. V., Holden, K., & Garland, D. P. (2016). Individualized clinical coaching in the TLE TeachLivE lab: Enhancing fidelity of implementation of system of least prompts among novice teachers of students with autism. Teacher Education and Special Education, 39(1), 47–59. https://doi.org/10.1177/0888406415600769
  26. Gersten, R., Ruchs, L. S., Compton, D., Coyne, M., Greenwood, C., & Innocenti, M. S. (2005). Quality indicators for group experimental and quasi-experimental research in special education. Exceptional Children, 71(2), 149–164. https://doi.org/10.1177/001440290507100202
  27. *Ginns, D. S., & Begeny, J. C. (2019). Effects of performance feedback on treatment integrity of a class-wide level system for secondary students with emotional disturbance. Behavioral Disorders, 44(3), 175–189. https://doi.org/10.1177/0198742918795884
  28. *Goodman, J. I., Brady, M. P., Duffy, M. L., Scott, J., & Pollard, N. E. (2008). The effects of “bug-in-ear” supervision on special education seachers’ delivery of learn units. Focus On Autism and Other Developmental Disabilities, 23(4), 207–216. https://doi.org/10.1177/1088357608324713
  29. Gorton, K., Allday, R. A., Lane, J. D., & Ault, M. J. (2022). Effects of brief training plus electronic feedback on increasing quantity and intonation of behavior specific praise among preschool teachers. Journal of Behavioral Education, 31, 731–750. https://doi.org/10.1007/s10864-020-09427-w
  30. *Gregory, A., Allen, J. P., Mikami, A. Y., Hafen, C. A., & Pianta, R. C. (2014). Effects of a professional development program on behavioral engagement of students in middle and high school. Psychology in the Schools, 51(2), 143–163. https://doi.org/10.1002/pits.21741
  31. Gürgür, H. (2016). Analyzing the coaching based professional development process of a special education teacher. Educational Sciences: Theory & Practice, 17(5), 1783–1813. https://doi.org/10.12738/estp.2017.5.0418
  32. Hartman, R. J., Townsend, M. B., & Jackson, M. (2019). Educators’ perceptions of technology integration into the classroom: A descriptive case study. Journal of Research in Innovative Teaching & Learning, 12(3), 236–249. https://doi.org/10.1108/JRIT-03-2019-0044
  33. Horn, A. L., Layden, S. J., Roitsch, J., & Karadimou, O. (2021). Providing performance-based feedback to teachers in real-time using bug-in-ear technology. Coaching: An International Journal of Theory, Research and Practice, 14(1), 92–101. https://doi.org/10.1080/17521882.2020.1784972
  34. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165–179. https://doi.org/10.1177/001440290507100203
  35. *Kennedy, M. J., Hirsch, S. E., Rodgers, W. J., Bruce, A., & Lloyd, J. W. (2017). Supporting high school teachers’ implementation of evidence-based classroom management practices. Teaching and Teacher Education, 63, 47–57. https://doi.org/10.1016/j.tate.2016.12.009
  36. Kennedy, M. J., Rodgers, W. J., Romig, J. E., Mathews, H. M., & Peeples, K. N. (2018). Introducing the content acquisition podcast professional development process: Supporting vocabulary instruction for inclusive middle school science teachers. Teacher Education and Special Education, 41(2), 140–157. https://doi.org/10.1177/0888406417745655
  37. Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education, 33(4), 279–299. https://doi.org/10.1177/0888406410371643
  38. Lee, J., Topping, K., & Lakin, E. (2023). Technology-facilitated continuous professional development during a pandemic: A Hong Kong primary school case study. RELC Journal, 54(2), 376–393. https://doi.org/10.1177/00336882231175239
  39. McLeod, R. H. (2020). Supporting pre-service teachers to implement systematic instruction through video review, reflection, and performance feedback. Early Childhood Education Journal, 48, 337–343. https://doi.org/10.1007/s10643-019-01001-y
  40. *O’Handley, R. D., Dufrene, B. A., & Wimberly, J. (2022). Bug-in-the-ear training increases teachers’ effective instruction delivery and student compliance. Journal of Behavioral Education, 31(4), 771–795. https://doi.org/10.1007/s10864-020-09429-8
  41. *Ploessl, D. M., & Rock, M. L. (2014). eCoaching: The effects on co-teachers’ planning and instruction. Teacher Education and Special Education, 37(3), 191–215. https://doi.org/10.1177/0888406414525049
  42. *Randolph, K. M., Duffy, M. L., Brady, M. P., Wilson, C. L., & Scheeler, M. C. (2020). The impact of iCoaching on teacher-delivered opportunities to respond. Journal of Special Education Technology, 35(1), 15–25. https://doi.org/10.1177/0162643419836414
  43. Royer, D. J., Lane, K. L., Dunlap, K. D., & Ennis, R. P. (2019). A systematic review of teacher-delivered behavior-specific praise on K-12 student performance. Remedial and Special Education, 40(2), 112–128. https://doi.org/10.1177/0741932517751054
  44. Samudre, M. D., LeJeune, L. M., Anderson, E. J., Viotto, J. A., Brock, M. E., & Nichols, H. (2023). A meta-analysis on behavioral support training and general education teacher implementation. Exceptional Children, 90(2), 164–185. https://doi.org/10.1177/00144029231172175
  45. Schaefer, J. M., & Ottley, J.R. (2018). Evaluating immediate feedback via big-in-ear as an evidence-based practice for professional development. Journal of Special Education Technology, 33(4), 247–258. https://doi.org/10.1177/0162643418766870
  46. *Scheeler, M. C., Congdon, M., & Stansbery, S. (2010). Providing immediate feedback to coteachers through bug-in-bar technology: An effective method of peer coaching in inclusion classrooms. Teacher Education and Special Education, 33(1), 83–96. https://doi.org/10.1177/0888406409357013
  47. Scheeler, M. C., McAfee, J. K., Ruhl, K. L., & Lee, D. L. (2006). Effects of corrective feedback delivered via wireless technology on pre-service teacher performance and student behavior. Teacher Education and Special Education, 29(1), 12–25. https://doi.org/10.1177/088840640602900103
  48. Schles, R. A., & Robertson, R. E. (2019). The role of performance feedback and implementation of evidence-based practices for pre-service special education teachers and student outcomes: A review of the literature. Teacher Education and Special Education, 42(1), 36–48. https://doi.org/10.1177/0888406417736571
  49. Sinclair, A. C., Gesel, S. A., LeJeune, L. M., & Lemons, C. J. (2020). A review of the evidence for real-time performance feedback to improve instructional practice. The Journal of Special Education, 54(2), 90–100. https://doi.org/10.1177/0022466919878470
  50. Sleiman, A. A., Sigurjonsdottir, S., Elnes, A., Gage, N. A., & Gravina, N. E. (2020). A quantitative review of performance feedback in organizational settings (1998-2018). Journal of Organizational Behavior Management, 40(3–4), 303–332. https://doi.org/10.1080/01608061.2020.1823300
  51. Sweigart, C. A., Collins, L. W., Evanovich, L. L., & Cook, S. C. (2016). An evaluation of the evidence base for performance feedback to improve teacher praise using CEC’s quality indicators. Education and Treatment of Children, 39(4), 419–444. https://doi.org/10.1353/etc.2016.0019
  52. Sweigart, C. A., Landrum, T. J., & Pennington, R. C. (2015). The effect of real-time visual performance feedback on teacher feedback: A preliminary investigation. Education and Treatment of Children, 38(4), 429–450. https://doi.org/10.18297/etd/2082
  53. *Tang, S., Tong, F., Irby, B. J., Lara-Alecio, R., & Guerrero, C. (2020). Fidelity of implementation in a randomized controlled trial study: The effect of virtual professional development on bilingual teachers. Bilingual Research Journal, 43(1), 111–124. https://doi.org/10.1080/15235882.2019.1711268
  54. U.S. Department of Education. (2017). Reimagining the role of technology in education: 2017 national education technology plan update. Office of Educational Technology. https://tech.ed.gov/files/2017/01/NETP17.pdf
  55. *Vernon-Feagans, L., Kainz, K., Amendum, S., Ginsberg, M., Wood, T., & Bock, A. (2012). targeted reading intervention: A coaching model to help classroom teachers with struggling readers. Learning Disability Quarterly, 35(2), 102–114. https://doi.org/10.1177/0731948711434048
  56. *Verschuur, R., Huskens, B., & Didden, R. (2021). Training teachers to implement classroom pivotal response teaching during small-group instruction: A pilot study. Developmental Neurorehabilitation, 24(2), 85–97. https://doi.org/10.1080/17518423.2020.1819462
  57. *Weiser, B., Buss, C., Sheils, A. P., Gallegos, E., & Murray, L. R. (2019). Expert reading coaching via technology: Investigating the reading, writing, and spelling outcomes of students in grades K-8 experiencing significant reading learning disabilities. Annals of Dyslexia, 69(1), 54–79. https://doi.org/10.1007/s11881-018-00175-1