A 41-Year History of Mixed Methods Research in Education: A Mixed Methods Bibliometric Study of Published Works from 1980 to 2021
Abstract views: 1100
/ 
PDF downloads: 642
DOI:
https://doi.org/10.59455/jomes.2022.6.2Keywords:
Educational research methodology, integration, 1 1 = 3 integration, 1 1 = 1 integration, partial integration, full(er) integration, integrated mixed methods research, integrative, integrated, and integral way of thinkingAbstract
Over the last three decades, several researchers have investigated the prevalence of mixed methods research studies across numerous fields and disciplines—known as prevalence rate studies. With the exception of the field of nursing, the field of education in general and the discipline of mathematics education in particular consistently have had the highest prevalence rates of mixed methods research. However, the latest year examined in these education-based prevalence rate studies has been 2010. Yet, the last 12 years have witnessed rapid developments in the field of mixed methods research. Therefore, in this report, we use a mixed methods bibliometric approach—comprising bibliometric quantitative data being integrated with qualitative data—to document the prevalence and use of mixed methods research in the field of education since the paradigm wars of the 1980s, in general, and since 2010, in particular. A systematic review of the ProQuest, ERIC database, via Python coding, revealed that published mixed methods research in education grew exponentially during the first two decades of the 2000s. From 2017 to 2021, the percentage of mixed methods research studies represented within the total number of educational research publications increased yearly, with mixed methods research representing 6% in 2017 to 7.9% in 2021 of the published educational research studies. In 2021, only 78 published articles were identified that included “mixed method(s)” in the title (i.e., mixed methods-declared research studies)—indicating that at least 175 of the 253 indexed education-based journals (69.17%) did not include any mixed methods-declared research articles in any of their 2021 issues. Even more disturbingly, more than two thirds of these 78 education-based mixed methods-declared research articles either involved no integration (9.0%) or minimal integration (i.e., 59.0%) of the quantitative and qualitative components/phases, with only 12.8% involving what could be considered to represent full(er) integration of the quantitative and qualitative components/phases throughout many, if not most or all, stages of the mixed methods research process. Therefore, we call on more educational researchers seriously to consider adopting an integrative, integrated, and integral way of thinking, in order to help the field of mixed methods research grow from its current status of young adulthood to fully fledged adulthood.
References
Abramo, G., D’Angelo, C.A., & Mele, I. (2022). Impact of Covid-19 on research output by gender across countries. Scientometrics. https://doi.org/10.1007/s11192-021-04245-x
Abrams, S. S., Onwuegbuzie, A. J., & Forzani, E. (2021). A call to Re-IMAGINE mixed methods research: Integrative Mixed methods Anti-racist Groundwork for Investigating and Nurturing Equity. International Journal of Multiple Research Approaches, 13(3).
Abrams, S. S., Onwuegbuzie, A. J., Shannon-Baker, P., Hitchcock, J., Hines, M., Harris, A., Fletcher, E. C., Tan, T. X., Holmes, A. E., Bell, D., Decker-Woodrow, L. E., Barfield, D., & Sealy-Ruiz, Y. (2021, April 21-26). A call to re-IMAGINE mixed methods research in the Black Lives Matter era [Symposium]. American Educational Research Association, San Diego, CA, United States.
Abrams, S. S., Schaefer, M. B., & Ness, D. (Eds.) (2020). Child parent research reimagined. Brill.
AD Scientific Index World Scientist and University Rankings. (2022). World Scientist and University Education / Education Rankings 2022.
https://www.adscientificindex.com/?subject=Education+%2F+Education&tit=Education
Al-Rodhan, N. R. F. (2009). Sustainable history and the dignity of man: A philosophy of history and civilisational triumph. LIT.
Alise, M. A., & Teddlie, C. (2010). A continuation of the paradigm wars? Prevalence rates of methodological approaches across the social/behavioral sciences. Journal of Mixed Methods Research, 4, 103-126. https://doi.org/10.1177/1558689809360805
American Psychological Association. (1954). Technical recommendations for psychological tests and diagnostic techniques. Psychological Bulletin, 51, 201-238. https://doi.org/10.1037/h0053479
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (1966). Standards for educational and psychological tests and manuals. American Psychological Association.
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (1974). Standards for educational and psychological tests. American Psychological Association.
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (1985). Standards for educational and psychological testing. American Psychological Association.
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. American Psychological Association.
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Psychological Association.
Balderas, A., Palomo, M., Beardo, J. M. D., & Rube, I. R. (2012, June 1). Qualitative assessment of wiki-based learning processes. https://core.ac.uk/display/19492777
Beck, S. W., Bonner, S., Filkins, S., Landrigan, C., & Yoon, H. (2020, November 11). Expanding formative assessment for equity and agency. National Council of Teachers of English. https://ncte.org/statement/expanding-formative-assessment/
Bennett, J., & Grant, N. S. (2016, May 23). Using an ecomap as a tool for qualitative data collection in organizations. New Horizons in Adult Education & Human Resource Development, 28(2), 1-13. https://doi.org/10.1002/nha3.20134
Berelson, B. (1952). Content analysis in communicative research. Free Press.
Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296-322. https://doi.org/10.1111/j.2044-8295.1910.tb00207.x
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105. https://doi.org/10.1037/h0046016
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Rand McNally.
Christie, C. A., & Fleischer, D. N. (2010). Insight into evaluation practice: A content analysis of designs and methods used in evaluation studies published in North American evaluation-focused journals. American Journal of Evaluation, 31, 326-346. https://doi.org/10.1177/1098214010369170
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.
Cole, J. R., & Zuckerman, H. (1984). The productivity puzzle: Persistence and change in patterns of publication of men and women scientists. Advances in Motivation and Achievement, 2, 217-258.
Coleman, L. J., Guo, A., & Dabbs, C. S. (2007). The state of qualitative research in gifted education as published in American journals. Gifted Child Quarterly, 1, 51-63. https://doi.org/10.1177/0016986206296656
Collins, K. M. T., Onwuegbuzie, A. J., & Jiao, Q. G. (2007). A mixed methods investigation of mixed methods sampling designs in social and health science research. Journal of Mixed Methods Research, 1, 267-294. https://doi.org/10.1177/1558689807299526
Collins, K. M. T., Onwuegbuzie, A. J., & Sutton, I. L. (2007, February). The role of mixed methods in special education. Paper presented at the annual meeting of the Southwest Educational Research Association, San Antonio, TX.
Cope, B., & Kalantzis, M. (2000). Multiliteracies: Literacy learning and the design of social futures. Routledge.
Cowan, C. P. (1988). Working with men becoming fathers: The impact of a couples group intervention. In P. Bornstein & C. P. Cowan (Eds.), Fatherhood today: Men’s changing role in the family (pp. 276-298). John Wiley.
Creamer, E. G. (2018). An introduction to fully integrated mixed methods research. Sage.
Cronbach, L. J. ( 1947). Test "reliability": Its meaning and determination. Psychometrika, 12, 1-16. https://doi.org/10.1007/BF02289289
Cuellar, I., Martinez, C., Jimenez, R., & Gonzalez, R. (1983). Clinical psychiatric case presentation: Culturally responsive diagnostic formulation and treatment in an Hispanic female. Hispanic Journal of Behavioral Sciences, 5(1), 93-103. https://doi.org/10.1177/07399863830051006
Cui, R., Ding, H., & Zhu, F. (2021). Gender inequality in research productivity during the COVID-19 pandemic. Manufacturing & Service Operations Management, 24(2), 691-1260. https://doi.org/10.1287/msom.2021.0991
Davis, T. M., Sellers, P. A., & Johnston, J. M. (1988, March 1). The factor structure and internal consistency of the Self-Concept and Motivation Inventory: What face would you wear? Preschool/kindergarten form. Educational and Psychological Measurement, 48(1), 237-246. https://doi.org/10.1177/001316448804800129
Denzin, N. K. (1978). The research act: A theoretical introduction to sociological methods. Praeger.
Denzin, N. K. (2010). Moments, mixed methods, and paradigm dialogs. Qualitative
Inquiry, 16, 419-427. https://doi.org/10.1177/1077800410364608
Denzin, N. K., & Lincoln, Y. S. (2011). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), Sage handbook of qualitative research (4th ed., pp. 1-25). Sage.
Dwyer, S. C., & Buckle, J. L. (2009). The space between: On being an insider-outsider in qualitative research. International Journal of Qualitative Methods 8(1), 54-63. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.596.4039&rep=rep1&type=pdf
Farrah, G. A., Milchus, N. J., & Reitz, W. (1968). The self-concept and motivation inventory: What face would you wear? SCAMIN manual of direction. Person-O-Metrics.
Fetters M. D., & Freshwater, D. (2015). The 1 + 1 = 3 integration challenge. Journal of Mixed Methods Research, 9, 115-117. https://doi.org/10.1177/1558689815581222
Franklin, C., & Jordan, C. (1995, May). Qualitative assessment: A methodological review. Families in society: The Journal of Contemporary Human Services, 76(5), 281-295. https://doi.org/10.1177/104438949507600502
Gagarina, N., Klop, D., Kunnari, S., Tantele, K., Välimaa, T., Balčiūnienė, I., Bohnacker, U., & Walters, J. (2012). MAIN: Multilingual Assessment Instrument for Narratives. Zentrum fũr Allgemeine Sprachwiss.
Gerber, H. R., Abrams, S. S., Curwood, J. S., & Magnifico, A. (2017). Conducting qualitative
research of learning in online spaces. Sage.
Glaser, B. G. (1965). The constant comparative method of qualitative analysis. Social Problems, 12, 436-445. https://doi.org/10.1525/sp.1965.12.4.03a00070
Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Aldine.
Greene, J. C. (2007). Mixed methods in social inquiry. Jossey Bass.
Hart, L. C., Smith, S. Z., Swars, S. L., & Smith, M. E. (2009). An examination of research methods in mathematics education. Journal of Mixed Methods Research, 3, 26-41. https://doi.org/10.1177/1558689808325771
Hartman, A. (1978). Diagrammatic assessment of family relationships . Social casework, 59, 465-476. https://doi.org/10.1177/104438947805900803
Hartman, A. (1995). Diagrammatic assessment of family relationships. Families in Society, 76, 111-122. https://doi.org/10.1177/104438949507600207
Henry, L. A . ( 2007 ). Exploring new literacies pedagogy and online reading comprehension
among middle school students and teachers: Issues of social equity or social exclusion? (Doctoral dissertation). digitalcommons.uconn.edu/dissertations/AAI3282520
Hertz, M. R. (1934). The reliability of the Rorschach ink-blot test. Journal of Applied Psychology, 18(3), 461-477. https://doi.org/10.1037/h0071281
Hesse-Biber, S., & Johnson, R. B. (2015). Preface. In S. N. Hesse-Biber & R. B. Johnson (Eds.), The Oxford handbook of multimethod and mixed methods research inquiry. Oxford University Press.
Hitchcock, J. H., & Onwuegbuzie, A. J. (Eds.). (2022). Routledge handbook for advancing integration in mixed methods research (pp. 3-27). Routledge.
Howe, K. R. (1988). Against the quantitative-qualitative incompatibility thesis or dogmas
die hard. Educational Researcher, 17(8), 10-16. https://doi.org/10.3102/0013189X017008010
Hutchinson, S. R., & Lovell, C. D. (2004). A review of methodological characteristics of research published in key journals in higher education: Implications for graduate research teaching. Research in Higher Education, 45, 383-403. https://doi.org/10.1023/B:RIHE.0000027392.94172.d2
Ivankova, N & Kawamura, Y. (2010). Emerging trends in the utilization of integrated designs in the social, behavioral, and health science. In A. Tashakkori & C. Teddlie (Eds.), Sage handbook of mixed methods in social & behavioral research (2nd, ed., pp. 581-612). Sage.
Jagsi, R., Guancial, E. A., Worobey, C. C., Henault, L. E., Chang, Y., Starr, R., & Hylek, E. M. (2006). The “gender gap” in authorship of academic medical literature—A 35-year perspective. New England Journal of Medicine, 385, 281-287. https://doi.org/10.1056/NEJMsa053910
Johnson, R. B., & Gray, R. (2010). A history of philosophical and theoretical issues for mixed methods research. In A. Tashakkori & C. Teddlie (Eds.), Sage handbook of mixed methods in social and behavioral research (2nd ed., pp. 69-94). Sage.
Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26. https://doi.org/10.1177/1558689806298224
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1, 112-133. https://doi.org/10.1177/1558689806298224
Justice, L. M., Bowles, R., Pence, K., & Gosse, C. (2010). A scalable tool for assessing children’s language abilities within a narrative context: The NAP (Narrative Assessment Protocol). Early Childhood Research Quarterly, 25(2), 218-234. https://doi.org/10.1016/j.ecresq.2009.11.002
Kress, G., & Jewitt, C. (2003). Introduction. In C. Lankshear, M. Knobel, C. Bigum, & M.
Peters (Series Eds.) & C. Jewitt & G. Kress (Vol. Eds.), New literacies and digital epistemologies: Multimodal literacy (Vol. 4, pp. 1-18). Peter Lang.
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.
Krukowski, R. A., Jagsi, R., & Cardel, M. I. (2021). Academic productivity differences by gender and child age in science, technology, engineering, mathematics, and medicine faculty during the COVID-19 pandemic. Journal of Women's Health, 30(3), 341-347. https://doi.org/10.1016/j.respol.2011.09.007
Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151-160. https://doi.org/10.1007/BF02288391
Kuhn, T. S. (1962). The structure of scientific revolutions. University of Chicago Press.
Ladson-Billings, G. (2014). Culturally relevant pedagogy 2.0: Aka the remix. Harvard
Educational Review, 84(1), 74-84. https://doi.org/10.17763/haer.84.1.p2rj131485484751
Ladson-Billings, G. (2017). The (r) evolution will not be standardized: Teacher education, hip hop pedagogy, and culturally relevant pedagogy 2.0. In D. Paris & H. S. Alim (Eds.), Culturally sustaining pedagogies: Teaching and learning for justice in a changing world. Teachers College Press.
Lambert, Z., & Durand, D. (1975). Some precautions in using canonical analysis. Journal of Market Research, XII(4), 468-475. https://doi.org/10.2307/3151100
Leech, N. L., & Onwuegbuzie, A. J. (2008). Qualitative data analysis: A compendium of techniques and a framework for selection for school psychology research and beyond. School Psychology Quarterly, 23, 587-604. https://doi.org/10.1037/1045-3830.23.4.587
Leech, N. l., & Onwuegbuzie, A. J. (2023). School psychologists’ use of mixed methods research in the field: A call for more mixed methods research and mixed methodological articles. Manuscript submitted for publication.
Leu, D. J., Forzani, E., Rhoads, C., Maykel, C., Kennedy, C., & Timbrell, N. (2015). The new literacies of online research and comprehension: Rethinking the reading achievement gap. Reading Research Quarterly, 50(1), 37-59. https://doi.org/10.1002/rrq.85
Mason, J. (2006). Mixing methods in a qualitatively driven way. Qualitative Research, 6(1), 9-25. https://doi.org/10.1177/146879410605-8866
Meyer, A. E. (1965). Educational history of the western world. McGraw Hill.
Mislevy, R. J. (2016). How development in psychology and technology challenge validity argumentation. Journal of Educational Measurement, 53(3), 265-292. http://dx.doi.org/10.1111/jedm.12117
Mislevy, R. J. (2019). Advances in measurement and cognition. The ANNALS of the American Academy of Political and Social Science, 683, 164-182. https://doi.org/10.1177/0002716219843816
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G., and PRISMA Group. (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Annals of Internal Medicine, 151, 264-269. https://doi.org/10.7326/0003-4819-151-4-200908180-00135
Natesan, P., Onwuegbuzie, A. J., Hitchcock, J., & Newman, I. (2019). Fully Integrated Bayesian thinking: A mixed methods approach to the 1 + 1 = 1 formula. AERA Division D Newsletter, 10-12. http://www.aera.net/Portals/38/docs/DivD/DNews_current/DivDNewsletter_Spring19.pdf
Neimeyer, R. A. (1993). Constructivist approaches to the measurement of meaning. In G. J. Neimeyer (Ed.), Constructivist assessment (pp. 58-103). Sage.
Newman, I., Onwuegbuzie, A. J., & Hitchcock, J. H. (2015). Using the general linear model to facilitate the full integration of qualitative and quantitative analysis: The potential to improve prediction and theory building and testing. General Linear Model Journal, 41(1), 12-28. http://www.glmj.org/archives/articles/Newman_v41n1.pdf
Niglas, K. (2004). The combined use of qualitative and quantitative methods in educational research. Unpublished doctoral dissertation, Tallinn Pedagogical University, Tallinn, Estonia.
O’Callaghan, D., Greene, D., Carthy, J., & Cunningham, P. (2015). An analysis of the coherence of descriptors in topic modeling. Expert Systems with Applications, 42(13), 5645-5657. https://doi.org/10.1016/j.eswa.2015.02.055
Ojo, E. O., Onwuegbuzie, A. J., Bergsteedt, B. J., Adams, S. P., Crowley, T., & Burger, A. (2022). A meta-methods analysis of academics' challenges affecting research productivity during COVID-19: Insights from a South African university. Manuscript submitted for publication.
Onwuegbuzie, A. J. (2012). Introduction: Putting the mixed back into quantitative and qualitative research in educational research and beyond: Moving towards the radical middle. International Journal of Multiple Research Approaches, 6(3), 192-219. https://doi.org/10.5172/mra.2012.6.3.192
Onwuegbuzie, A. J. (2017, March). Mixed methods is dead! Long live mixed methods! Invited keynote address presented at the Mixed Methods International Research Association Caribbean Conference at Montego Bay, Jamaica.
Onwuegbuzie, A. J. (2020). Child-parent research: Towards an ethical process for avoiding being PRICED out of research. In S. S. Abrams, M. B. Schaefer, & D. Ness (Eds.), Child parent research reimagined (pp. 205-234). Brill.
Onwuegbuzie, A. J., Abrams, S. S., & Forzani, E. (in press). The many SIDES of critical dialectical pluralism: A meta-philosophy—comprising a research philosophy, educational philosophy, and life philosophy—for addressing social justice, inclusion, diversity, and equity, and social responsibility. International Journal of Multiple Research Approaches.
Onwuegbuzie, A. J., & Combs, J. P. (2010). Emergent data analysis techniques in mixed methods research: A synthesis. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (2nd ed., pp. 397-430). Sage.
Onwuegbuzie, A. J., & Corrigan, J. A. (2014). Improving the quality of mixed research reports in the field of human resource development and beyond: A call for rigor as an ethical practice. Human Resource Development Quarterly, 25, 273-299. https://doi.org/10.1002/hrdq.21197
Onwuegbuzie, A. J., & Corrigan, J. A. (2018). What is happening now? A meta-prevalence study of mixed methods applications in special education. Research in the Schools, 25(2), 1-22.
Onwuegbuzie, A. J., & Daniel, L. G. (2003, February 12). Typology of analytical and interpretational errors in quantitative and qualitative educational research. Current Issues in Education [On-line], 6(2). https://cie.asu.edu/ojs/index.php/cieatasu/article/view/1609/651
Onwuegbuzie, A. J., Forzani, E., & Abrams, J. (2022). History of quantitative, qualitative, mixed methods research, and educational assessment: A review. Unpublished manuscript, University of Cambridge, Cambridge, England.
Onwuegbuzie, A. J., & Frels, R. K. (2013). Introduction: Towards a new research philosophy for addressing social justice issues: Critical dialectical pluralism 1.0. International Journal of Multiple Research Approaches, 7, 9-26. https://doi.org/10.5172/mra.2013.7.1.9
Onwuegbuzie, A. J., & Frels, R. K. (2016). Seven steps to a comprehensive literature review: A multimodal and cultural approach. Sage.
Onwuegbuzie, A. J., Frels, R. K., Hwang, E., & Slate, J. R. (2013). Editorial: Evidence-based guidelines regarding the number of citations used in manuscripts submitted to journals for review for publication and articles published in journals. Research in the Schools, 20(2), i-xiv.
Onwuegbuzie, A. J., Gerber, H. R., & Abrams, S. S. (2017). Mixed methods research. In J. Matthes (Ed.), The International Encyclopedia of Communication Research Methods (pp. 1-33). Wiley. htpp://doi:10.1002/9781118901731.iecrm0156
Onwuegbuzie, A. J., & Hitchcock, J. H. (2019a). Toward a fully integrated approach to mixed methods research via the 1 + 1 = 1 integration approach: Mixed Research 2.0. International Journal of Multiple Research Approaches, 11(1), 7-28. https://doi.org/10.29034/ijmra.v11n1editorial1
Onwuegbuzie, A. J., & Hitchcock, J. H. (2019b). Using mathematical formulae as proof for integrating mixed methods research and multiple methods research approaches: A call for multi-mixed methods and meta-methods in a mixed research 2.0 era. International Journal of Multiple Research Approaches, 11(3), 213-234. https://doi.org/10.29034/ijmra.v11n3editorial2
Onwuegbuzie, A. J., & Hitchcock, J. H. (2022). Towards a comprehensive meta-framework for full integration in mixed methods research. In J. H. Hitchcock & A. J. Onwuegbuzie (Eds.), Routledge handbook for advancing integration in mixed methods research (pp. 565-606). Routledge.
Onwuegbuzie, A. J., Hitchcock, J. H., Natesan, P., & Newman, I. (2018). Using fully integrated Bayesian thinking to address the 1 + 1 = 1 integration challenge. International Journal of Multiple Research Approaches, 10(1), 666-678. https://doi.org/10.29034/ijmra.v10n1a43
Onwuegbuzie, A. J., & Johnson, R. B. (Eds.). (2021). The Routledge reviewer’s guide to mixed methods research analysis. Routledge.
Onwuegbuzie, A. J., Leech, N. L., & Collins, K. M. T. (2010). Innovative data collection strategies in qualitative research. The Qualitative Report, 15(3), 696-726. http://www.nova.edu/ssss/QR/QR15-3/onwuegbuzie.pdf
Onwuegbuzie, A. J., Leech, N. L., & Collins, K. M. T. (2011). Innovative qualitative data collection techniques for conducting literature reviews. In M. Williams & W. P. Vogt (Eds.), The Sage handbook of innovation in social research methods (pp. 182-204). Sage.
Onwuegbuzie, A. J., Wilcox, R., Gonzales, V., Hoisington, S., Lambert, J., Jordan, J., Aleisa, M., Benge, C. L., Wachsmann, M. S., & Valle, R. (2018). Collaboration patterns among mixed researchers: A multidisciplinary examination. International Journal of Multiple Research Approaches, 10, 437-457. https://doi.org/10.29034/ijmra.v10n1a30
Onwuegbuzie, A. J., & Wisdom, J. P. (2014). Quantitative versus qualitative methods and beyond. In D. C. Phillips (Ed.), Encyclopedia of educational theory and philosophy (pp. 678-682). Sage. https://doi.org/10.41.35/9781483346229
Paris, D., & Alim, H. S. (2014). What are we seeking to sustain through culturally
sustaining pedagogy? A loving critique forward. Harvard Educational Review, 84(1), 85-100. https://doi.org/10.17763/haer.84.1.982l873k2ht16m77
Paris, D., & Alim, H. S. (Eds.). (2017). Culturally sustaining pedagogies: Teaching and learning for justice in a changing world. Teachers College Press.
Parkhurst, P. E., Lovell, K. L., Sprafka, S. A., & Hodgins, M. (1972). Evaluation of videodisc modules: A mixed methods approach. (ERIC Document Reproduction Service No. ED348014)
Plano Clark, V. L., Huddleston-Casas, C. A., Churchill, S. L., O’Neil Green, D., & Garrett, A. L. (2008). Mixed methods approaches in family science research. Journal of Family Issues, 29, 1543-1566. https://doi.org/10.1177/0192513X08318251
PRISMA. (2009). PRISMA 2009 checklist. http://www.prisma-statement.org/documents/PRISMA%202009%20checklist.pdf
PRISMA. (2021). PRISMA statement. http://www.prisma-statement.org/PRISMAStatement/PRISMAStatement
Provalis Research. (2014). WordStat 7 User’s Guide. Montreal, QC: Provalis Research. https://provalisresearch.com/Documents/WordStat7.pdf
Provalis Research. (2020). WordStat (Version 8.0.28) [Computer software]. Author.
Randall, J., Poe, M., Slomp, D., & Oliveri, M. E. (2022). Disrupting white supremacy in assessment: Toward a justice-oriented antiracist validity framework. Educational Assessment. Advance online publication. https://doi.org/10.1080/10627197.2022.2042682
Research.com. (2022). Best social sciences and humanities scientists. https://research.com/scientists-rankings/social-sciences-and-humanities
Rigg, L. S., McCarragher, S., & Krmenec, A. (2012). Authorship, collaboration, and gender: Fifteen years of publication productivity in selected geography journals. Professional Geographer, 64(4), 491-502. https://doi.org/10.1080/00330124.2011.611434
Ross, A., & Onwuegbuzie, A. J. (2010). Mixed methods research design: A comparison of prevalence in JRME and AERJ. International Journal of Multiple Research Approaches, 4, 233-245. https://doi.org/10.5172/mra.2010.4.3.233
Ross, A., & Onwuegbuzie, A. J. (2012). Prevalence of mixed methods research in mathematics education. The Mathematics Educator, 22(1), 84-113.
Ross, A., & Onwuegbuzie, A. J. (2014). Complexity of quantitative analyses used in mixed research articles published in a flagship mathematics education journal. International Journal of Multiple Research Approaches, 8, 80-90. https://doi.org/10.5172/mra.2014.8.1.63
Sandelowski, M. (2014). Unmixing mixed-methods research. Research in Nursing & Health, 37(1), 3-8. https://doi.org/10.1002/nur.21570
Schneider, P., Dubé, R., & Hayward, D. (2005). The Edmonton Narrative Norms Instrument; University of Alberta Faculty of Rehabilitation. http://www.rehabresearch.ualberta.ca/enni/about
Sombatsompop, N., & Markpin, T. (2005). Making an equality of ISI impact factors for different subject fields. Journal of The American Society for Information Science and Technology, 56(7), 676-683. https://doi.org/10.1002/asi.20150
Spradley, J. P. (1979). The ethnographic interview. International Thomson Publishing.
Spradley, J. P. (1980). Participant observation. Holt, Ainehart, and Winston.
Starczewski, H., & Lloyd, H. (1999). Using the Stories/Narrative Assessment Procedure (SNAP) to monitor language and communication changes after a cochlear implant: A case study, Deafness & Education International, 1(3), 137-154, https://doi.org/1179/146431599790561325
Strayer, G. D. (1913). Standards and tests for measuring the efficiency of schools or systems of schools. Bulletin, United States Bureau of Education. Whole No. 13: Report of the Committee of the National Council of Education.
Strong, C. J., Mayer, M., & Mayer, M. (1998). The Strong Narrative Assessment Procedure (SNAP). Thinking Publications.
Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Applied Social Research Methods Series (Vol. 46). Sage.
Tashakkori, A., & Teddlie, C. (Eds.). (2003). Handbook of mixed methods in social and behavioral research. Sage.
Tashakkori, A., & Teddlie, C. (Eds.). (2010). Sage handbook of mixed methods in social and behavioral research (2nd ed.). Sage.
Taylor, S. S., & Abernathy, T. V. (2014, April). Mixed methods research: Is it valued in special education research? Paper presented at the annual meeting of the Council for Exceptional Children, Philadelphia, PA. https://www.academia.edu/9353219/Mixed_methods_research_Is_it_valued_in_special_education_research
Teddlie, C., & Johnson, R. B. (2009). Methodological thought since the 20th century. In C. Teddlie & A. Tashakkori, Foundations of mixed methods research: Integrating quantitative and qualitative techniques in the social and behavioral sciences (pp. 62-82). Sage.
Teddlie, C., & Tashakkori, A. (2003). Major issues and controversies in the use of mixed methods in the social and behavioral sciences. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 3-50). Sage.
Tracy, E. M., & Whittaker, J. K. (1990). The social network map: Assessing social support in clinical practice. Families in Society, 71, 461-470. https://doi.org/10.1177/104438949007100802
Truscott, D., Swars, S., Smith, S., Thornton-Reid, F., Zhao, Y., & Dooley, C. (2010). A cross-disciplinary examination of the prevalence of mixed methods in educational research: 1995-2005. International Journal of Social Research Methodology, 13, 3317-328. https://doi.org/10.1080/13645570903097950
Van Haneghan, J. (2021). Exploratory factor analysis of text. In A. J. Onwuegbuzie & R. B. Johnson, The reviewer’s guide to mixed methods research analysis (pp. 25-35). Routledge.
Walters, C., Bam, A., & Tumubweinee, P. (2022). The precarity of women’s academic work and careers during the COVID-19 pandemic. South African Journal of Science, 118(5/6). https://doi.org/10.17159/sajs.2022/13176
Walters, C., Ronnie, L., Jansen, J., & Kriger, S. (2021, September). “Academic guilt”: The impact of the pandemic-enforced lockdown on women's academic work. In Women's Studies International Forum (Vol. 88, p. 102522). Pergamon.
Wang, Y., Bowers, A. J., & Fikis, D. J. (2017). Automated text data, mining analysis of five, decades of educational, leadership research literature: Probabilistic topic modeling of EAQ articles from 1965 to 2014. Educational Administration Quarterly, 53(2), 289-323. https://doi.org/10.1177/0013161X16660585
Webb, E. J., Campbell, D. T., Schwartz, R. D., & Sechrest, L. (1966). Unobtrusive measures. Rand McNally.
Wilcox, R., Onwuegbuzie, A. J., Benge, C. L., Jordan, J., Wachsmann, M. S., Hoisington, S., & Gonzales, V. (2019). Authorship, collaboration, and gender: A multidisciplinary examination of trends among mixed researchers. Research in the Schools, 26(2), xxvii-xxxvii.
World Health Organization. (2020). WHO announces COVID-19 outbreak a pandemic. https://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-annou-n-ces-covid-19-outbreak-a-pandemic
Witte, S., Bass, B., O’Byrne, W. I., Price-Dennis, D., & Sibberson, F. (2019, November 7). Definition of literacy in a digital age. National Council of Teachers of English. https://ncte.org/statement/nctes-definition-literacy-digital-age/
Yancey, K. B., McCraw, B., & Filkins, S. (2018, October 25). Literacy assessment: Definitions, principles, and practices. National Council of Teachers of English. https://ncte.org/statement/assessmentframingst/
