Estimating Collaboration through Variation in Time Series from Members in Group Works


  • Yuto Hattori Ritsumeikan University
  • Fumiko Harada
  • Hiromitsu Shimakawa



Group work; Collaboration; Time series data; Singular spectral transformation


In successful group works, members engage in monitoring where they guess what other members are thinking. Since monitoring promotes self-regulated learning, many teachers try to introduce group works.

This paper proposes a method to inform teachers on the fly of the monitoring status of students in group works using inexpensive and less invasive sensors. In the field of education, the method enables a teacher who supervises many student groups to direct their group works to successful ones.

The method collects accelerations of multiple body parts and pulse waves from each member using sensors. The method uses the singular spectral transformation (SST) to detect the relative changes of each signal in the course of time. When a significant change takes place, it is considered the members get arousal. The method considers group members engage in monitoring when significant changes appear simultaneously among them.

In an experiment to detect successful discussion to integrate ideas from the members into one feasible solution, we have obtained the accuracy of over 0.7. It indicates that the simultaneity of significant changes detected by SST is effective to estimate the monitoring state. In the experiment result, acceleration often worked better than pulse wave signals. It was also found that each member has a different role in the group. The behavior of each member varies with the role of the member. These results show that the method has potential to estimate the monitoring state. They also imply examination of the acceleration of each body parts would enable us to estimate the role of the members. The method allows one teacher to lead many groups to successful group works.


(1) Baker, M., Hansen, T., Joiner, R., & Traum, D. (1999). The role of grounding in collaborative learning tasks. Collaborative Learning: Cognitive and Computational Approaches, 31, 63., p.31

(2) Behera, A., Matthew, P., Keidel, A., Vangorp, P., Fang, H., & Canning, S., (2020). Associating Facial Expressions and Upper-Body Gestures with Learning Tasks for Enhancing Intelligent Tutoring Systems, International Journal of Artificial Intelligence in Education, Volume 30, pp.236–270

(3) Bosch, N., D ’Mello, S., Baker, R.S., Ocumpaugh, J, Shute, V., Ventura, M., Wang, L., Zhao,W. (2016). Detecting Student Emotions in Computer-Enabled Classrooms. IJCAI 2016.

(4) Deibel, K. (2005). Team formation methods for increasing interaction during in-class group work. In ACM

SIGCSE Bulletin (Vol. 37, No. 3, pp. 291-295). ACM.

(5) Ekman, P., and Friesen, W.V. (1975). Unmasking the face. Englewood Cliffs, N.J., Prentice-Hall, 1975

(6) Garfield, J. (1993). Teaching statistics using small-group cooperative learning. Journal of Statistics Education, 1(1).

(7) Haataja, E., Malmberg, J., J¨arvela¨, S., (2018) Monitoring in collaborative learning: Co-occurrence of observed behavior and physiological synchrony explored, Computers in Human Behavior, Volume 87, Pages 337-347

(8) Hung, H., & Gatica-Perez, D. (2010). Estimating cohesion in small groups using audiovisual nonverbal behavior. IEEE Transactions on Multimedia, 12(6), 563-575.

(9) Ito,T.(2018). The Psychological Changes of Learners in the Active Learning Style Class. Japan journal of educational technology 41(Suppl.), 061-064.

(10) Johnson, D. W., & Johnson, R. T. (1987). Learning together and alone: Cooperative, competitive, and individualistic learning. Prentice-Hall, Inc.

(11) Johnson, R. T., & Johnson, D. W. (2008). Active learning: Cooperation in the classroom. The annual report of educational psychology in Japan, 47, 29-30.

(12) Jokinen, K. (2009, July). Gaze and gesture activity in communication. In International Conference on Universal Access in Human-Computer Interaction (pp. 537-546). Springer, Berlin, Heidelberg.

(13) Joseph, N., Pradeesh, N., Chatterjee, S., & Bijlani, K. (2017, September). A novel approach for group formation in collaborative learning using learner preferences. In 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (pp. 1564-1568). IEEE.

(14) [Lie 2002] Lie, A. (2002). Cooperative learning: Mempraktikan cooperative learning di ruang-ruang kelas. Jakarta: Grasindo.

(15) Lien, J.J., Kanade, T., Cohn, J. F., & Li, C. C. (1998, April). Automated facial expression recognition based on FACS action units. In Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition (pp. 390-395). IEEE

(16) Liu, C. C., & Kao, L. C. (2005, November). Handheld devices with large shared display groupware: Tools to facilitate group communication in one-to-one collaborative learning activities. In IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE’05) (pp. 128-135). IEEE.

(17) Malmberg, J., Haataja, E., Sepp¨anen, T., J¨arvela¨, S., (2019) Are we together or not? The temporal interplay of monitoring, physiological arousal and physiological synchrony during a collaborative exam. ijcscl 14 (4), pp. 467-490

(18) Malmberg, J., J¨arvel¨a, S., Holappa, J., Haataja, E., Huang, X., & Siipo, A. (2019). Going beyond what is visible: What multichannel data can reveal about interaction in the context of collaborative learning? Computers in Human Behavior, 96, 235–245.

(19) Nagaoka, C., Komori, M., & Yoshikawa, S. (2005, May). Synchrony tendency: interactional synchrony and congruence of nonverbal behavior in social interaction. In Proceedings of the 2005 International Conference on Active Media Technology, 2005.(AMT 2005). (pp. 529-534). IEEE.

(20) Okada, S., Ohtake, Y., Nakano, Y. I., Hayashi, Y., Huang, H. H., Takase, Y., & Nitta, K. (2016, October). Estimating communication skills using dialogue acts and nonverbal features in multiple discussion datasets. In Proceedings of the 18th ACM International Conference on Multimodal Interaction (pp. 169-176). ACM.

(21) Palumbo, R. V., Marraccini, M. E.,Weyandt, L. L., Wilder-Smith, O., McGee, H. A., Liu, S., & Goodwin, M. S. (2016). Interpersonal autonomic physiology: A systematic review of the literature. Personality and Social Psychology Review, 21(2), 99–141

(22) Pomeranz, B., Macaulay, R. J., Caudill, M. A., Kutz, I., Adam, D., Gordon, D., Kilborn, K.M, Barger, A.C., Shannon, D.C., Cohen, R. J. & Benson, H.(1985). Assessment of autonomic function in humans by heart rate spectral analysis. American Journal of Physiology-Heart and Circulatory Physiology, 248(1), H151-H153.

(23) Roschelle, J. (1992). Learning by collaborating: Convergent conceptual change. The Journal of the Learning, Sciences, 2(3), 235–276

(24) Russell, J.A., (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178

(25) Schneider, B. & Pea, R. (2014) Toward collaboration sensing. ijcscl 9 (4), pp. 371-395

(26) Schneider, B., Sharma, K., Cuendet, S. et al. (2018) Leveraging mobile eye-trackers to capture joint visual attention in co-located collaborative learning groups. ijcscl 13 (3), pp. 241-261

(27) Schneider, B., Yong, D., Radu, I. (2020) Unpacking the relationship between existing and new measures of physiological synchrony and collaborative learning: a mixed methods study. ijcscl 15(1)

(28) Shi, W., Pattichis, M. S., Celed´on-Pattichis, S., & L´opezLeiva, C. (2018, October). Dynamic Group Interactions in

Collaborative Learning Videos. In 2018 52nd Asilomar Conference on Signals, Systems, and Computers (pp. 1528-1531). IEEE.

(29) Smith, B. L., & McGregor, J. T. (1992). What is collaborative learning., Procedia - Social and Behavioral Sciences, 31, 491 – 495

(30) Su, Y., Li, Y., Hu, H., & Ros´e, C. P. (2018). Exploring college English language learners ’ self and social regulation of learning during wiki-supported collaborative reading activities. International Journal of Computer-

Supported Collaborative Learning, 1–26.

(31) Task Force of the European Society of Cardiology. (1996). Heart rate variability, standards of measurement, physiological interpretation, and clinical use. circulation, 93, 1043-1065.

(32) Tomasello, M. (1995). Joint attention as social cognition. In C. Moore & P. J. Dunham (Eds.), Joint attention: Its origins and role in development (pp. 103–130). Hillsdale: Lawrence Erlbaum

(33) Tsunoda, K., Chiba, A., Chigira, H., Yoshida, K., Watanabe, T., Mizuno, O., (2016), Online estimation of a cognitive performance using heart rate variability, 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp.761-765

(34) Voyiatzaki, E., Margaritis, M., & Avouris, N. (2006). Collaborative interaction analysis: The teachers’ perspective. In Sixth IEEE International Conference on Advanced Learning Technologies (ICALT’06) (pp. 345-349).


(35) Welch, P. (1967). The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Transactions on audio and electroacoustics, 15(2), 70-73.

(36) Wheatley, T., Kang, O., Parkinson, C., & Looser, C. E. (2012). From mind perception to mental connection: Synchrony as a mechanism for social understanding. Social and Personality Psychology Compass, 6(8), 589-606.

(37) Winne, P. H. (2017). Cognition and metacognition within self-regulated learning. In Handbook of self-regulation of learning and performance (pp. 52-64). In D. Schunk, & J. Greene (Eds.). Handbook of self-regulation of learning and performance(2nd ed.). Routledge.

(38) Xiao, B., Georgiou, P., Baucom, B., & Narayanan, S. S. (2015). Head motion modeling for human behavior analysis in dyadic interaction. IEEE transactions on multimedia, 17(7), 1107-1119.

(39) Zimmerman, B.J., & Schunk, D.H., (2013) Self-Regulated Learning and Academic Achievement: Theoretical Perspectives, Lawrence Erlbaum Associates, 2nd edition




How to Cite

Hattori, Y., Harada, F., & Shimakawa, H. (2021). Estimating Collaboration through Variation in Time Series from Members in Group Works. Transactions on Engineering and Computing Sciences, 9(1), 28–48.