Developing instrument to measure the use of online comic as educational media

Radeswandri, Afiq Budiawan, Rian Vebrianto, Musa Thahir Department of Mangement, Universitas Terbuka, Indonesia Department of Family Law, Sekolah Tinggi Agama Islam Lukman Edy, Indonesia Department of Master of Teacher Education at Madrasah Ibtidaiyah, Universitas Islam Negeri Sultan Syarif Kasim, Indonesia Department of Mathematic Education, Universitas Islam Negeri Sultan Syarif Kasim, Indonesia


INTRODUCTION
Considering that students today are generally very interested in technology, the world of digital technology can be used as an alternative educational media for students. The use of gadgets for students has advantages and disadvantages. Therefore, teachers need to find the right strategy to minimize these limitations. The use of gadget technology in students was suggested by several experts who stated that children naturally learn about their environment through observation, which in this case technology offers easily accessible facilities to expand the area and reach of exploration [1]. Furthermore, applying technology in education can develop higher order thinking skills (HOTS) and students can creatively develop new insights that will begin to emerge more and more steadily [2]. In addition, building an information technology competency framework in online teaching has many meanings in the mentoring process that contributes to increasing student learning capacity [3]. The results of these previous studies suggest that instructional technology should be used in education wherever possible, to facilitate resource utilization, support cognitive and meta-cognitive development processes.
Research on the importance of technology for students has been carried out in several developed countries. A research conducted in America provides policy recommendations encouraging parents to use media technology for their children. The research was done using a nationally representative sample of 2,326 parents of children age eight years and under. This study examined the factors associated with parent-child relationships across six types of media: book, television (TV), computer, video game, tablet, and smartphone. The implication of the results of this study was that parental intervention is more focused on encouraging the sharing of media technology [4]. Other researchers conducted studies related to joint reading activities between parents and children using electronic books, where there was good interaction between children and teachers or parents [5]. Programs carried out include reading electronic books together, where adults as teachers can develop children' insights in various fields of science such as the concept of marine conservation and support children's language and literacy development. At this point, digital educational comics that are based on the blending of text and image, can be used as a powerful teaching tool and at the same time prepare children for a digital future come to the fore [6].
The use of electronic comic book media that uses images and text can facilitate children to get to know various ideas. According to McVicker [7], comics are available for children as a literacy media that allows teachers to design and create comics themselves and link them to learning themes. Chen and his friends conducted a study on 89 children in an elementary school, early grade, in Taoyuan City, Taiwan. These experts researched a situational learning system using digital comic games designed to help students learn through script writing in groups. The results of the study showed that students from the experimental group had significantly higher learning motivation compared to the control group who were taught using traditional teaching methods [8]. Based on various literatures and reports, it is stated that there are 80% of comic readers worldwide [9]. In addition, the use of comics in learning makes students more motivated [10,11], students describe comics as fun [9,12], improves students' understanding and memory [13][14][15], and the use of comic media is very attractive to students [16][17][18][19]. The integration of comics with teaching activities will open a new window to students' imagination and thus contribute to their creative thinking processes [20]. Thus, there is an emerging need to develop instruments using comics. Based on the importance of using online comics as an educational media, an appropriate assessment instrument is needed in order to evaluate and provide improvements to increase the use of online comics. Therefore, the objectives of this study were 1) to develop a non-test instrument or questionnaire to measure the evaluation of the use of online comics among students at Open University, Pekanbaru, Indonesia and 2) to obtain the validity and reliability of the instrument.

RESEARCH METHOD
The research used a theoretical model, which is a model that describes a thinking framework based on relevant theories and is supported by empirical data [21]. The research steps carried out include eight stages, namely: 1) conducting theoretical studies in formulating constructs and evaluation indicators for the use of online comics, 2) compiling instrument grids, 3) compiling instrument items, 4) ) conducting expert judgment, 5) conducting trials, 6) conducting analysis, 7) revising, and 8) formulating the final instrument of research results [22,23]. This research was conducted at Open University, Pekanbaru, Indonesia in the even semester of the 2019/2020 academic year and involving sixty students from various study programs. In accordance with the characteristics of the response type, the format of the measuring instrument used was the Likert scale, where each statement had 4 alternative answers, namely strongly agree (SA) with a score of 4, agree (A) with a score of 4, disagree (D) with a score of 3, and strongly disagree (SD) with a score of 1. Development of a questionnaire instrument with a scale of 4 [24] which will assess the level of validity and reliability so that it can produce quality instruments and to know what should be measured. After the data was collected from the distribution of questionnaire instruments using online comics among Open University students, the data was then analyzed using the statistical package for social sciences (SPSS) [25][26][27] to determine the quality of the instruments that had been developed. The researcher determined the validity of this instrument by comparing the significance level obtained with the specified significance level of 0.05. The reliability index was also obtained using the Cronbach Alpha. The validity of an instrument must have a minimum value of 0.3 [28] and the instrument reliability value must be in the range of 0.6<X<1 [29]. A good and quality instruments will be produced by fulfilling these two requirements.

Validity of non-test instruments, and the developed questionnaire
The formulation and method of developing an evaluation instrument for the use of online comics in this study was carried out using a theoretical development model. This research began with conducting a theoretical study to formulate an evaluation construct for the use of online comics. Based on a study of various theories on evaluating the use of online comics, seven constructs for evaluating the use of online comics for students were compiled, namely: deductive components; online comic construction; online comic technicality; ease of use; online comics' efficiency; benefits; and interest. The following is a grid for evaluating the use of online comics for students.
Based on Table 1, it showed that the number of statement items is 34 items which are scattered into seven constructs. After the researcher arranged the instrument for each construct, the researcher then compiled the statement items using a Likert scale. After the instrument was composed, expert judgment was carried out which is consulted with the evaluation expert. The result of the expert judgment was the correction of several statement items. After the corrections were made, the researchers conducted a trial on 60 students of Open University at Pekanbaru. Based on the test results data, the next step was to conduct an analysis to determine the validity and reliability of the training evaluation instruments for teachers. Construct validity is a measuring tool that shows results in accordance with theory [30]. Emory stated that construct validity is one of the methods that can be used in measuring, namely considering the correlation between research data and existing measurement methods, convergent discriminant techniques, factor analysis, and multi-method analysis [31]. The question item in an instrument is said to be valid if the calculated Pearson coefficient (r-count) is greater than the Pearson table coefficient (r-table) [32]. Nunnally [28] also said that the correlation between items with a total score that exceeded 0.25 is considered a high score. The results of the instrument validity test of the research data are as shown in Table 2.

Reliability of non-test instruments, and developed questionnaires
Each item was assessed for internal consistency in developing an evaluation instrument for the use of online comics for students. It is a measure of the extent to which items on the scale measure the same construct as other items on the same scale. Table 3 illustrates the reliability scale using Cronbach's alpha coefficient for a set of questionnaires based on an evaluation instrument for the use of online comics for students.  Table 3, the Cronbach's alpha Reliability Index value for each study construct in this study was obtained and the overall alpha value obtained was indicated by the overall alpha value obtained for 1) deductive components, 2) online comic construction, 3) online comic technicality, 4) ease of use, 5) online comics efficiency, 6) benefits, and 7) interests respectively 0.981; 0.980; 0.980; 0.980; 0.981; 0.980; and .980. This indicated that the reliability value (α) is greater than 0.60 for each construct under study. This result is reinforced by the opinion of Basuki and Haryanto that instruments that have a high or reliable correlation are in the range 0.6<X<1 [29,33]. Therefore, the seven research constructs have met the requirements for being reliable and valid so it can be used for further research needs. Based on the validity and reliability test results of the online comic use evaluation questionnaire, a valid and reliable instrument is obtained. The results of this study are reinforced by previous research which states that an assessment instrument that can be used is an instrument that has met the valid criteria [34,35]. In addition to meeting valid criteria, the instrument must also meet high valid criteria [36,37]. Furthermore, the findings of Inteni, et al. which states that the instrument is suitable for use in research if it meets the four test requirements, namely validity, reliability, difficulty level of questions, and differentiation [38,39]. Holli, et al. also said that validity is efficient as the ability of the instrument to measure the attributes of the construct under study [40]. These opinions strengthen the results of this study so that the evaluation instrument for the use of online comics for students is declared valid and worthy of use for further research needs related to the use of online comics.
In addition to the instrument having met the valid criteria, this study also produced a reliable research instrument with a Cronbach's alpha value of 0.980. This results are reinforced by the opinion that an instrument is reliable if it has an Cronbach's alpha value greater than 0.6 [41]. Furthermore, the instrument is said to be reliable if the Cronbach's alpha reliability coefficient is between 0.70-0.90 [42]. The results of this study are also reinforced by the opinion of Tang Keow Ngang, Subadrah Nair, Bouphan Prachak that the scale and criteria used to measure the test instrument must meet very reliable criteria [43]. The instrument with a greater Cronbach's alpha should be used for all types of research because it has smaller measurement errors and has greater statistical power for any research setting [44]. However, when item in parallel targets a uni-dimensional constructs, the Cronbach's alpha of an instrument should be increased by developing a set of highly correlated items, but not by increasing the number of items with insufficient correlation between items.
Based on the analysis conducted, the questionnaire developed based on the evaluation instrument for the use of online comics for students has good construct validity and high reliability so that it can be used in research in the development of online comics. Therefore, the research instrument that measures the evaluation of the use of online comics for students that has been tested is deemed worthy of use and is believed to be used in research that measures evaluation of the use of online comics for students. This is reinforced by research which states that to ensure the quality of research results, the instruments used are derived from the selection of valid and reliable tools [45,46]. Furthermore, the use of evaluation instruments must meet valid criteria and is suitable for use [47]. With an evaluation instrument for evaluating the use of online comics for students, it can prevent speculation from students in conducting assessments, especially in determining the final score after carrying out research on the achievement of evaluating the use of online comics for students. However, this instrument did not involve sufficiently many respondents from students of Open University at Pekanbaru and thus it is not necessarily suitable to be used as a research instrument in other universities. Further research is expected to be carried out to see the validity and reliability of respondents in other universities and with a larger sample of respondents. It is intended that this research instrument will be better and the level of validity and reliability values is higher so that this instrument can be used as a better research tool in obtaining research data.

CONCLUSION
This research produces several conclusions, namely: the preparation and development of an evaluation instrument for the use of online comics for students in this study was done using a theoretical development model to test seven research constructs, namely: deductive components, online comic construction, online comic technicality, ease of use, online comics efficiency, benefits, and interest; the results of the construct validity and reliability testing indicated that the validity of the evaluation instrument using online comics for students met the valid criteria because the value of r-count >r-table (r-count>0.254); and the reliability of online comic use evaluation instrument for students that had been compiled and developed in this study also met the high category as indicated by the Cronbach's alpha reliability coefficient of 0.980. Service (LPPM) of UIN Sultan Syarif Kasim Riau. As a researcher, he actively conducts research and development tasks in the field of education and development. In addition, he is active in writing scientific articles published in various Scopus indexed international journals and accredited national journals. Besides being active as a writer, he is also active as an editor and reviewer in various scopus indexed international journals and accredited national journals.
Musa Thahir completed his Bachelor degree in Mathematics Education at the Faculty of Tarbiyah and Teacher Training of UIN Sultan Syarif Kasim Riau and Master in the Mathematics Education of Postgraduate Program of Universitas Riau. He works as a lecturer and young researcher at the Institute for Research and Community Service (LPPM) of UIN Sultan Syarif Kasim Riau. As a researcher, he actively conducts research and development tasks in the field of education and development. In addition, he is active in writing scientific articles published in Scopus indexed international journals and several accredited national journals. Apart from being active as a writer, he is also active as an editor in various accredited national journals and is active as a member of the Indonesian Journal Volunteer (RJI) of Riau Regional Coordination.