An Achievement Test in Mathematics in the Modern World Course: The Standardization Process
DOI:
https://doi.org/10.11594/ijmaber.05.07.08Keywords:
Construct and standardize, Achievement test, Instrumentation, Mathematics in the Modern World (MMW)Abstract
This study aimed to construct and standardize an achievement test in Mathematics in the Modern World (MMW) course. Achievement test evaluates a student’s performance after a given period of instruction. Using the instrumentation research design, the data were gathered among 273 tertiary students of Notre Dame University enrolled during the second semester of Academic Year 2020-2021. Among these, 38 pilot tested and 213 tested the reliability of the instrument. This study further utilized the following: a 4-point Likert scale for the validation of the instrument, difficulty value and discrimination index formulas for the analysis of each item, and KR20 reliability for internal consistency. Furthermore, a test manual for the MMW achievement test was also established. The preliminary total number of Items before MMW teachers’ validation was 42 items covering the topics for the first 12 hours of the MMW Syllabus. These items were validated through Aiken’s Item Validity method which resulted in the acceptance of 42 items. After rigorous processes, it resulted in the acceptance of 34 items for the MMW achievement test. The instrument’s average validity is 0.935, and the reliability is 0.701 which means that this tool has high validity and acceptable reliability.
Downloads
References
Beck, K. (2020). How to Calcuate a T-Score. Leaf Group Ltd. / Leaf Group Media. https://sciencing.com/calculate-tscore-5135749.html
Bruce, L. (2021). Module 7: Study Skills - Common Types of Tests in College. Lumenwaymaker. https://courses.lumenlearning.com/waymaker-collegesuccess/chapter/text-common-types-of-tests-in-college/#:~:text=Common%20Test%20Types,tests%2C%20and%20physical%20skills%20tests
Cengage Learning (2021). Understanding Standardized Assessment. https://www.shsu.edu/aao004/documents/15_005.pdf
Cerezo (2021). Técnicas de evaluación: Standardized testing. Universidad de Murcia. https://webs.um.es/lourdesc/miwiki/lib/exe/fetch.php?media=standardized_testing.pdf
Churchill, A. (2015). Bless the tests: Three reasons for standardizes testing. The Thomas B. Fordham Institute. https://fordhaminstitute.org/national/commentary/bless-tests-three-reasons-standardizedtesting
Clay, B. (2001). Is This a Trick Question? A Short Guide to Writing Effective Test Questions. Kansas Curriculum Center of Kansas State University. https://www.k-state.edu/ksde/alp/resources/Handout-Module6.pdf
Commission on Higher Education [CHED], (2017). KWF- Mathematics in the Modern World. https://ched.gov.ph/wp-content/uploads/2017/10/KWF-Mathematics-in-the-Modern-World.pdf
Cortina, J. (1993). What Is Coefficient Alpha? An Examination of Theory and Applications. Journal of Applied Psychology 1993. Vol. 78., No. 1. pp. 98-104. https://www.psycholosphere.com/what%20is%20coefficient%20alpha%20by%20Cortina.pdf
Ebel, R. L., & Frisbie, D. A. (1986). Essentials of education measurement. Englewood Cliffs, NJ: Prentice Hall.
Educational Research Techniques (2017). Developing Standardized Tests.EducationalResearchTechniques.com. https://educationalresearchtechniques.com/2017/06/21/developing-standardized-tests/
Evroro, E. (2015). Item Analysis of Test of Number Operations. Asian Journal of Educational Research Vol. 3, No. 1, 2015 ISSN 2311-6080. http://www.multidisciplinaryjournals.com/wpcontent/uploads/2015/01/ITEM-ANALYSIS-OF-TEST-OF-NUMBER-OPERATIONS.pdf
Faremi, Y. A. (2016). Reliability Coefficient of Multiple Choice and Short Answer Objective Test Items in Basic Technology: Comparative Approach. Journal of Educational Policy and Entrepreneurial Research (JEPER), Vol. 3 (No. 3), 60-61. ISSN: 2408-770X (Print), ISSN: 2408-6231 (Online). https://www.zeetarz.com/Jee/wp-content/uploads/2018/01/Reliability-Coefficient-of-Multiple%E2%80%93Choice-and-Short-Answer-Objective-Test-Items-in-Basic-Technology-Comparative-Approach.pdf
Frey, B. B. (2018). Achievement Tests. SAGE Publications. https://dx.doi.org/10.4135/9781506326139.n16. https://methods.sagepub.com/reference/the-sage-encyclopedia-of-educational-research-measurement-and-evaluation/i1967.xml
Glen, S. (2017). Classical Test Theory: Definition. StatisticsHowTo.com: Elementary Statistics for the rest of us!. https://www.statisticshowto.com/classical-test-theory/
Glen, S. (2020). Z-Score: Definition, Formula and Calculation. StatisticsHowTo.com: Elementary Statistics for the rest of us! https://www.statisticshowto.com/probability-and-statistics/z-score/
Great Schools Partnership (2015). Standardized Test. Edglossary.org. https://www.edglossary.org/standardized-test/
Haladyna, T. M. (2018). Developing Test Items for Course Examinations. IDEA Student Ratings System. https://www.ideaedu.org/Portals/0/Uploads/Documents/IDEA%20Papers/IDEA%20Papers/IDEA_Paper_70.pdf
Ikhsanudin & Subali (2018). Content validity analysis of first semester formative test on biology subject for senior high school. Journal of Physics: Conference Series 1097012039. https://www.researchgate.net/publication/328258459_Content_validity_analysis_of_first_semester_formative_test_on_biology_subject_for_senior_high_school
Irawan, E., & Wilujeng, H. (2020). Development of an online mathematical misconception instrument. Journal of Physics: Conference Series. https://www.researchgate.net/publication/345162423_Development_of_an_online_mathematical_misconception_instrument
Katz, L. J., & Slomka, G. T. (2000). Achievement Testing. Handbook of Psychological Assessment (Third Edition) and Elsevier B. V. https://www.sciencedirect.com/topics/medicine-and-dentistry/achievement-test
Kean, J., & Reilly, J. (2014). Classical Test Theory. https://static1.squarespace.com/static/514fd024e4b0d4d5c3e59e38/t/53bc6138e4b07f64b2496034/1404854584695/Kean+Reilly+%282014+in+press%29+Classical+Test+Design.Pdf
Kpolovie, P. J. (2016). Single-Subject Research Method: The Needed Simplification. British Journal of Education (Vol. 4, No. 6, pp.68-95, June 2016). https://www.eajournals.org/wpcontent/uploads/Kpolovie-Peter-James.pdf
Kumar, N. (2016). Construction and Standardization of an Achievement Test in English Grammar. International Journal of Current Research and Modern Education (Vol. I, Issue II) http://ijcrme.rdmodernresearch.com/wp-content/uploads/2017/01/141.pdf
Lacia, M. (2007). The Notre Dame University Mathematics Qualifying Examination: An Analysis
Logsdon (2020). Different Types of Scores on Standardized Tests. Very Well Family. https://www.verywellfamily.com/what-are-standard-scores-2162891
Math is Fun (2017). Standard Deviation Formulas. MathsIsFun.com. https://www.mathsisfun.com/data/standard-deviation-formulas.html
Metcalf, A. in ResearchGate (2017, October 25). Many sources say above 0.70 is acceptable. 0.80 or greater is preferred. Higher is better. [Comment on the post “What is the acceptable range for Cronbach alpha test of reliability?”]. ResearchGate GmbH. https://www.researchgate.net/post/What-is-the-acceptable-range-for-Cronbach-alpha-test-of-reliability
Mitra N.K., Nagaraja, H.S., Ponnudurai, G., & Judson, J.P. (2009). The Levels Of Difficulty And Discrimination Indices In Type A Multiple Choice Questions Of Pre-clinical Semester 1 Multidisciplinary Summative Tests. IeJSME 2009: 3(1): 2-7. https://www.researchgate.net/publication/227858882_The_Levels_Of_Difficulty_And_DiscriminationIndices_In_Type_A_Multiple_Choice_Questions_Of_Preclinical_Semester_1_Multidisciplinary_Summative_Tests
Nixon, B. (2021). The Pros and Cons of Standardized Testing. WHITBY School. https://www.whitbyschool.org/passionforlearning/the-pros-and-cons-of-standardized-testing
Pam, M. S. (2013). ITEM VALIDITY. PsychologyDictionary.org. https://psychologydictionary.org/itemvalidity/
Patock, J. (2004). Exam Scores: How to Interpret your Statistical Analysis Reports. University Testing Services Arizona State University. https://jcesom.marshall.edu/media/24101/Interpreting-Statistical-Information.pdf
Schuwirth, L. W., & Van Der Vleuten, C. P. (2011). General overview of the theories used in assessment. T. Gibbs, Penyunt. Association for Medical Education in Europe (AMEE). https://www.tandfonline.com/doi/abs/10.3109/0142159X.2011.611022
Sefcik, D. J., Bice, G., & Prerost, F. (2013). How to Study for Standardized Tests. Burlington, United States of America: Jones & Bartlett Learning. http://samples.jblearning.com/9780763773625/73625_FMXX_Final.pdf
Sharma, H. L., & Sarita (2018). Construction and standardization of an achievement test in Science. International Journal of Research and Analytical Reviews. http://ijrar.com/upload_issue/ijrar_issue_1399.pdf
Sharma, H.L., & Poonam (2017). Construction and Standardization of an achievement test in English grammar. International Journal of Advanced Educational Research (Vol. 2, Issue 5). http://www.educationjournal.org/archives/2017/vol2/issue5/2-5-108
Siegle, D. (2021). Educational Research Basics: Standardized Scores. University of Connecticut Nega School of Education. https://researchbasics.education.uconn.edu/standardized-scores/
Taber, K. (2016) The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res Sci Educ (2018) 48:1273–1296 DOI10.1007/s11165-016-9602-2. https://www.researchgate.net/publication/317777374_The_Use_of_Cronbach's_Alpha_When_Developing_and_Reporting_Research_Instruments_in_Science_Education
The Glossary of Educational Reform (2015). Standardized Test. Great Schools Partnership. https://www.edglossary.org/standardizedtest/#:~:text=To%20evaluate%20whether%20students%20have,student%20learning%20and%20academic%20progress
Tookoian, J. (2016). Deciding the length of a test. https://edulastic.com/blog/the-right-number-of-test-questions/
UTHealth (2021) Lesson 1.6 Standard Scores. University of Texas-Houston Health Science Center. https://www.uth.tmc.edu/uth_orgs/educ_dev/oser/L1_6.HTM
Zucker, S. (2003). Fundamentals of Standardized Testing. Hardcourt Assessment, Inc. http://images.pearsonassessments.com/images/tmrs/tmrs_rg/Fundamentals_of_Standardized_Testing.pdf
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See the Effect of Open Access).
