Research Methods in Context of TEL and HCI, Exercises and Reflections

There exist a plethora of research methods, which are broadly divided into two major types: quantitative and qualitative, though mixed method amalgamating subsets of both types are prevalent for today’s ever increasingly complex research projects. Nonetheless, when confronting with the problem “Which research methods should be used for a research project?” it is often necessary back-track a step to reflect on a more critical issue: “Are the research questions appropriate, well-defined, relevant or even worthy to explore?” Indeed, selection of research methods is preceded by several significant steps. While the steps are normally seen as linear, they are rather iterative, undergoing cycles of refinement when alternative views emerge. To enhance understanding each of these steps, we are going to contextualize them with some concrete examples from the field of technology-enhanced learning (TEL) and human-computer interaction (HCI).. Two examples will be taken from each of these fields. As an example of a TEL application, a CSCL (computer-supported collaborative learning) case that entails mixed-method evaluation will be selected. An interesting field study for validating a specific usability evaluation tool will be presented, as an example from the area of HCI.

The primary goal of the workshop is to instantiate some of the ideas presented in the lecture. Specifically, participants will be asked to select research methods for some cases of research contexts. Discussion on proposed methods will be conducted. Furthermore, some advanced data analysis techniques such as Repertory Grid Technique (RGT), interaction and content Analysis (ICA), and Social Network Analysis (SNA) will be demonstrated. Small-scales hands-on practice on some of these techniques will be conducted.