Journal of Physics: Conference Series PAPER • OPEN ACCESS Analysis of students’ mistakes in solving mathematics olympiad problems To cite this article: L J Shinariko et al 2020 J. Phys.: Conf. Ser. 1480 012039 View the article online for updates and enhancements. This content was downloaded from IP address 91.201.177.34 on 17/12/2020 at 01:19 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 Analysis of students’ mistakes in solving mathematics olympiad problems L J Shinariko1, N W Saputri1, Y Hartono1, and J Araiku1* 1 Mathematics Education Department, Universitas Sriwijaya, Palembang, South Sumatra, Indonesia * Corresponding author’s email: jeriaraiku@fkip.unsri.ac.id Abstract. This study aims at analysing students’ mistakes in solving mathematical olympiad problems. The test was conducted in SMA Negeri 1 Palembang involving 40 students. The main topics are algebra, combinatorics, geometry, and number theory. The analysis is based on Newman Error Analysis. The results show that the most common mistakes are found in combinatorics and geometry. The most common mistakes analysed using Newman Error are comprehension and transformation errors. In order to solve this problem, teachers need to assign various mathematical problems. Hence, the students will have more flexibility to apply problemsolving strategies. 1. Introduction The study begins because when someone wins the olympiad, they can improve the prestige of their school [1 - 4]. That’s why most of the schools try their best to send their students’ representation to win the olympiad. The Ministry of Education and Cultural is supporting the olympiad by making National Science Olympiad (OSN) [3 - 6]. The number of participants in the OSN is increasing every year [7]. The Government has already facilitating students that like mathematics by holding OSN since 2003 at the national level [3, 5, 6]. OSN aims to find the exceeded students that found in cities and region all over Indonesia to be prepared participated International Mathematics Olympiad (IMO) in international level [3, 7, 8]. Winning the selection of OSN is not an easy task because the participants must pass all the selection from 3 levels in city, province, and nation level [7, 9]. For this reason, a thorough preparation is required before entering the competition due to strict selection. The topic in OSN is general, but the problems require participants to answer with a high level of thinking. The different way of thinking from solving common problems are needed, these are the issues that need to be solved [10, 11]. OSN Syllabus refers to aspects of reasoning, problem solving, and mathematical communication [9]. Mathematics is the science of logic regarding the structure, quantity, and concepts related to one another [12, 13]. The mistakes that occur where people have different logics and structuring concepts of mathematics because when learning mathematics everyone has differences in understanding, knowledge, and other aspect of the environment [13, 14]. According to other researchers, aspects that needed in solving OSN problems are the maturity of mathematics with advanced levels such as concepts, comprehension, accuracy, foresight, ingenuity, ways of thinking and mathematical experience [15, 16]. Syllabus from OSN refers to the International Mathematics Olympiad (IMO) and can be classified into four main topics namely algebra, combinatorics, geometry, and number theory [8, 17]. Studies suggest that experiences are various because students have different comprehension and knowledge from each other [15, 18 - 20]. This can be an obstacle in learning if the roots of problems are Content from this work may be used under the terms of the Creative Commons Attribution 3.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI. Published under licence by IOP Publishing Ltd 1 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 founded. For this reason, tests will be conducted and students’ answers will be analyzed following the procedure of Newman Error Analysis. This analysis consists of (1) reading error (error type 1) is caused when the students cannot read, in common cannot understand the terms, words, and symbols used in the problem, (2) comprehension error (error type 2) is caused when the students do not understand the main idea of the problems and cannot determine what is known and what is being asked, (3) transformation error (error Type 3) is caused when the students fail to specify the formula or strategies or procedures, (4) process skill error (error type 4) is caused when fails to work and not using appropriate algorithm, and (5) encoding error (error type 5) is caused when the students are not able to answer according to what being asked [10, 11, 14, 21 - 25]. Sumatera Selatan is one of the provinces actively taking part in OSN because Education Authorities in Palembang wants to show their region’s potential [5]. SMA Negeri 1 Palembang is one of the schools that takes part in OSN every year and also actively conducts training for students. They support all of the students that elected by school because superior in academic. In this case, mathematics is the focus of the researcher, because we are the instructor of mathematics’ olympiad. The research was conducted there and the results were analysed using Newman Error Analysis. The tests will be divided into four main topics that have already mentioned. It is hoped that from this research, we can see further which part should be improved. We hope to find the obstacles, so we can fix the most common mistakes that happen in students [14, 15, 26]. Eventually, we can learn what is needed hence we can improve their concepts and intensify the quality of learning [27]. In the future, we can focus on fixing the one that needed and improving their strategy to solve mathematical olympiad problems. 2. Method The study is an analysis of mistakes based on Newman Error Analysis. The research was conducted on students’ in the olympiad class on SMA Negeri 1 Palembang. The subjects consisted of 40 students in grades 10 and 11. The tests will be carried out within 4 weeks. Each week, they will be given tests with different materials, namely algebra, combinatorics, number theory, and geometry constructively. Later on, each material will be given 2 questions each within 30 minutes. Afterward, from each material, these mistakes will later be analysed. From the mistakes, we will evaluate the students’ common mistakes that happen when solving the problems [20, 27]. The data will be grouped based on the mistakes that shown when they doing the test when doing algebra, combinatorics, number theory, and geometry. The tests will be analysed based on Newman Error Analysis that has been mentioned before. 3. Result and Discussion This research consists of three stages, namely the preparation phase, the implementation phase, and the analysis phase. In the preparation stage, researchers determine the topics to be tested, search and select questions for tested based on the criteria of the questions that often arise in the Math Olympics and the difficulty level of the questions, make possible answers and the assessment rubrics, then design the implementation. At the implementation stage, researchers conduct data retrieval with a written test. The implementation is carried out for 4 weeks, starting on August 24th, 2019 until September 14th, 2019. Details of the activities during the implementation process can be seen in Table 1. Table 1. Implementation of taking test value. No 1 2 3 4 Date August 24 , 2019 August 31st, 2019 September 7th, 2019 September 14th, 2019 th Topic Algebra Theory of Numbers Probability and Combinatorics Geometry 2 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 The implementation is carried out for 2 hours every Saturday with the activities carried out namely, 1 hour 15 minutes the first delivery of material conducted by the Olympic teacher, the next 30 minutes the students work on the Olympic questions consisting of 2 questions, and the last 15 minutes the students and the teacher discuss the questions that were tested. In the data analysis stage, the researcher analyses the mistakes made by the research subjects through the results of student test answers. At this stage, the researcher analyses the students' errors based on the Newman error procedure which consists of reading errors, comprehension errors, transformation errors, process skill errors, and encoding errors. The answers of students who experienced errors were analysed according to the descriptors of each Newman procedure that have been described in Table 2. Table 2. Indicator of students error. No. Newman Procedure 1. Reading the problem (Reading) 2. 3. Comprehen the problem (Comprehension) Transformation the problem Transformation 4. Process Skill 5. Writing of the final Answer (Encoding) Indicator a. Students can read or recognize symbols or keywords in question b. Students interpret the meaning of every word, termm or symbols in the matter a. Students understand what is known b. Students understand what is being asked a. Students know what formulas will be used to solve the problem b. Students know the counting operation that will be used c. Students can create a mathematical model of the problem presented a. Student know the procedure or steps that will be used to solve the problem b. Students can explain the procedure or steps used to solve problem c. Students can find the final result according to the procedure or the steps used to solve the problem a. The student can show the final answer of the problem solving b. Students can write the final answer in a accordance with the conclusion in question (source: Jha [21] and Singh [23]) Based on the analysis of students' answers, students make mistakes on almost all questions. Out of the 4 topics and each topic consists of 2 questions given, the most common error is the transformation error. Table 3 shows the percentage of mistakes made by students. Table 3. Percentage of errors made by students based on Newman Error. Category of Newman Error Reading Error Comprehension Error Transformation Error Process Skill Error Encoding Skill Error Geometry 1 0% 28% 39% 6% 0% 2 0% 11% 83% 6% 0% Topic Theory of Algebra Numbers 1 2 1 2 0% 0% 0% 0% 24% 27% 0% 31% 29% 36% 0% 13% 24% 7% 25% 25% 0% 0% 0% 0% 3 Probability and Combinatorics 1 2 0% 0% 0% 0% 100% 95% 0% 0% 0% 0% Average 0% 15% 49% 12% 0% National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 3.1. Comprehension Error Errors in the understanding phase (comprehension error) occur when students cannot understand the given problem. Based on table 1 above, as many as 15% of students make comprehension errors. There are two kinds of mistakes made by students, namely students are wrong in understanding what is known by the problem and students are wrong in interpreting what is desired by the problem. Figure 1 and Figure 2 below show the comprehension error made by students on the topic of algebra and geometry. Figure 2. Student answers on geometry topics that show comprehension error Figure 1. Student answers on algebra topics that show comprehension error Based on the answers in Figure 1, students cannot understand the overall meaning of the problem, in this case the students are wrong in interpreting what the question wants. Students’ answers in Figure 1 above show that students look for the value of f (3). However, what is desired from the problem is to find the value of 𝑓(𝑥). According to [21] the error occurred because students did not understand what was asked by the problem or students incorrectly captured the information contained in the problem he could not solve the problem correctly. While in Figure 2, students misunderstood the picture given to the problem. Learners assume that ∠𝐵𝐶𝐸 and ∠𝐵𝐶𝐴 in the picture are right angles. Even though this is not known from the questions and ∠𝐵𝐶𝐸 and 𝐶𝐴𝐵𝐶𝐴 are not right angles. This is because the teacher usually gives questions with right-angled triangles, so students are also accustomed to thinking that images in the problem are also elbow-shaped -elbow. The teacher only gives structured questions so that when given questions unstructured students’ way of thinking is not developed [28]. 3.2. Transformation Error Errors of transformation occur when students are able to understand the questions from a given problem but students have not been able to change the questions into mathematical form correctly or students fail to choose the right mathematical strategy to solve the problem. Based on table 1 above, transformation error becomes the mistake made by students with the highest percentage of 49% and the largest percentage of transformation errors that occur is on the Geometry topic number 2 that is 83% and the topic of probability and combinatorics about number 1 is 100%. Figure 3 and Figure 4 show successive transformation errors made by students on the topic of geometry and opportunity & combinatorics. Based on the answers in Figure 3, students have not been able to change questions into mathematical form correctly, in these questions students incorrectly interpret a triangle shape into two similar triangles. The students' answers written in Figure 3 indicate that students already understand that ∆DBA ~ ∆DBC as is well known in the problem, but the student made a wrong comparison of the two triangles, he wrote 𝐵𝐶 𝐶𝐷 𝐴𝐵 𝐷𝐵 𝐴𝐷 that 𝐴𝐵 = 𝐴𝐷, while the correct ratio was 𝐶𝐵 = 𝐷𝐶 = 𝐴𝐵. According to [22] transformation errors occur when students have understood the question requirements but fail in identifying the right mathematical operations to successfully solve the problem. Meanwhile, according to [29] transformation errors that often occur in geometry material are due to students difficulty in visual-spatial abilities, namely 4 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 difficulty in understanding geometric shapes, resulting in a lack of students' ability to manipulate geometric shapes. Figure 4 Student answers on topic of opportunity and combinatorics that show transformation error Figure 3. Student answers on Geometry topic which shows transformation error Whereas in Figure 4, students fail to choose the right mathematical strategy, so students cannot solve problems correctly. The students' answers in Figure 4 for problem number 1 regarding probability and combinatorics show that students only make 1 case in the problem, students do not think about other cases that might occur. This is supported by the results of interviews with these students. During the interview, students revealed that the second number he wrote was 10, meaning that he could enter all the numbers because there was a condition that there were two numbers that were the same. In box 3 he writes 9 because he thinks that one of the numbers has entered the second box, he explains that because there are two numbers that are the same and number 1 has been used for the second box then in the box when only nine numbers are left unused. In this step, students do not think that what if number 1 does not appear in the second box, because in the second box there are ten numbers that might appear. As for the fourth box, according to the results of interviews with students, he wrote 6 because the numbers 0, 1, and 2 have appeared in boxes 2 and 3. In this step, students also do not think that other numbers besides 0, 1, 2 can also be appears in boxes 2 and 3. At the interview also students realize that they have written the wrong number in the fourth box, because according to students the number that may appear in the fourth box is 3, 4, 5, 6, 7, 8, 9 he should write 7 possible numbers, but he was not careful enough to write only 6, so the final results he got were not quite right. In Figure 4, students make a mistake of transformation, which is supposed to solve the problem, it is not enough with just one case, to solve the problem it takes 3 cases so that it can cover all possible numbers that can be arranged. According to [30] the problem that often arises when students solve problems regarding combinatorics is that students cannot always consider all the possibilities that can be arranged according to the rules correctly. 3.3. Process Skill Error Process skill errors occur when students have been able to choose operations or determine the strategies needed to solve the problem but are unable to carry out procedures correctly or experience errors in the mathematical calculation process. Based on table 1 above, as many as 12% of students make a process skill error. Figure 5 and Figure 6 show the process skill errors made by students on the topic of number theory. Based on students' answers in Figure 5, students are able to choose the right mathematical strategy to solve the problem, but he made a mistake when doing the addition operation of 1,002,001 + 1,004,004, he wrote the result is 1,006,005, while the answer that should is 2,006,005. This is in accordance with 5 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 the opinion of [23] that mistakes in process skills occur when students do not carry out mathematical operations correctly. Figure 5. Student answers on the topic of theory of number showing errors in mathematical operations Likewise with Figure 6, the student has chosen the right mathematical strategy, but he did not continue the procedure or the working steps. The student only tries factor 507 is 1 and 507, but he does not try again for other factors 507 namely 3 and 169 and 13 and 39, if he tries with another 507 factor, he will find the right answer for the problem Based on research conducted by [31], one of the process skill errors occurs when the student does not continue the procedure or steps to complete it so that the student does not find the right solution. Figure 6. Student answers on the topic of theory of number, students do not continue mathematical procedures 6 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 4. Conclusion Based on the results of the research and analysis above, it can be concluded that there are three things that high school students do when solving Olympic questions based on the type of Newman error with algebraic topics, number theory, probability and combinatorics. These errors are comprehension error (15%), transformation error (49), and process skill error (12%). The biggest percentage of error is transformation error. The error occurs because students have not been able to convert the questions into mathematics correctly and students fail to choose the right mathematical strategy to solve the problem. 5. Acknowledgments Our deepest gratitude for SMAN 1 Palembang who has supported this research and all students who have participated in this study. 6. References [1] Mamlukat I 2009 Menjadi Juara Olimpiade Matematika SMP (Ciracas: Niaga Swadaya) [2] Mairing J P, Budayasa I K and Juniati D 2011 Jurnal Pendidikan dan Pembelajaran 18 65 [3] Mairing J P, Budayasa I K and Juniati D 2012 Jurnal Pendidikan dan Pembelajaran 18 57 [4] Prasetya A and Widodo A T 2012 Lembaran Ilmu Kependidikan 41 1 [5] Diskominfo Sumsel 2016 Mendikbud Resmikan OSN di Sumsel online: http://www.sumselprov.go.id/index.php?module=newsdetail&id=1007 [6] Kemendikbud 2019 Siswa Bersaing di Olimpiade Sains Provinsi Menuju OSN 2019 online: https://www.kemdikbud.go.id/main/blog/2019/04/13525-siswa-bersaing-di-olimpiade-sainsprovinsi-menuju-osn-2019 [7] Kemendikbud 2019 Rekapitulasi peraih mendali osn 2019 online: https://www.kemdikbud.go.id/ [8] Dolinar G 2006 International Mathematical Olympiad Regulation online: https://www.imoofficial.org/documents.aspx [9] Dirjen pendidikan SD, SMP, SMA 2019 Pedoman pelaksanaan osn sma 2019 online: http://www.bangsaku.web.id/2019/02/pedoman-pelaksanaan-osn-sma-2019.html [10] Abdullah A H, Abidin N L Z and Ali M 2015 Asian Soc. Sci. 11 133 [11] Junaedi I, Suyitno A, Sugiarto E and Eng C K 2015 IJE 7 31 [12] Amir A 2015 Logaritma: Jurnal Ilmu-ilmu Pendidikan dan Sains 2 18 [13] Bellanca J 2011 Strategi dan Proyek Pembelajaran Aktif untuk Melibatkan Kecerdasan Siswa Edisi Kedua (Jakarta: Indeks) [14] White A L 2005 Square one 15 15 [15] Idris R 2017 Lentera Pendidikan: Jurnal Ilmu Tarbiyah Dan Keguruan 12 152 [16] Nugroho I A 2014 Analisis, Jenis, Letak dan Faktor Penyebab Kesulitan Belajar Siswa pada Pokok Bahasan Operasi Hitung Aljabar Kelas VIII SMP Negeri 3 Kalimanah melalui Tes Diagnostik Tahun 2013/2014 Doctoral Dissertation (Universitas Muhammadiyah Purwokerto). [17] Kemendikbud 2019 Silabus OSN SMP tahun 2019 online: http://ditpsmp.kemdikbud.go.id/download/silabus-osn-smp-tahun-2019/ [18] Niess M L 2005 Teaching and teacher education 21 509 [19] Setyawan D and Rahman A 2014 Sainsmat: Jurnal Ilmiah Ilmu Pengetahuan Alam 2 140 [20] Valverde G A and Schmidt W H 1997 Issues Sci. Technol. 14 60 [21] Jha S K 2012 IJCAES 2 17 [22] Prakitipong N and Nakamura S 2006 Journal of International Cooperation in Education 9 111 [23] Singh P, Rahman A A and Hoon T S 2010 Procedia Soc. Behav. Sci. 8 264 [24] White A L 2009 Newman's Error Analysis' impact upon numeracy and literacy CoSMEd 2009 (Penang: Southeast Asian Ministers of Education Organization-Regional Centre for Education in Science and Mathematics) p 223 online: https://researchdirect.westernsydney.edu.au/islandora/object/uws:27810 [25] White A L 2010 Journal of Science and Mathematics Education in Southeast Asia 33 129 7 National Conference on Mathematics Education (NaCoME) IOP Conf. Series: Journal of Physics: Conf. Series 1480 (2020) 012039 IOP Publishing doi:10.1088/1742-6596/1480/1/012039 [26] Bishop A, FitzSimons G, Seah W T and Clarkson P 1999 Values in Mathematics Education: Making Values Teaching Explicit in the Mathematics Classroom online: https://files.eric.ed.gov/fulltext/ED453075.pdf [27] Biondi R L, Vasconcellos L, Menezes-Filho N and Cristia J P 2012 Economia 12 143 [28] Araiku J, Parta I N and Rahardjo S 2019 J. Phys.: Conf. Ser. 1166 012020 [29] Karimah R K N, Kusmayadi T A and Pramudya I 2018 J. Phys.: Conf. Ser. 1008 012076 [30] Lockwood E 2013 The Journal of Mathematical Behavior 32 251 [31] Setiawan Y B, Hapizah and Hiltrimartin C 2018 Jurnal Riset Pendidikan Matematika 5 233 8