CRITERIA FOR ASSESSING THE SCIENTIFIC AND METHODOLOGICAL POTENTIAL OF TEACHER-RESEARCHERS
Keywords:
scientific and methodological potential, teacher-researchers, assessment criteria, research competence, responsible research assessment, indicators, teacher educationAbstract
Efforts to modernize the research capacity of teacher-educators depend on the ability to assess it validly. Existing assessment practices, however, tend to rely on publication counts and formal qualifications, which capture outputs rather than the underlying and developable capacity of teacher-researchers. This article develops a theoretically grounded system of criteria, indicators and levels for assessing the scientific and methodological potential of teacher-researchers, aligned with international standards of responsible research assessment. The study employs a qualitative theoretical design combining an integrative review of research on competence assessment and research capacity with a document analysis of international researcher-development and research-assessment frameworks, including the European Framework for Research Careers, the Vitae Researcher Development Framework, ResearchComp, DORA, the Leiden Manifesto, the Hong Kong Principles and the CoARA Agreement. Criteria were derived through a construct-centred approach to validity. Six assessment principles, six criteria with 24 indicators, four developmental levels with descriptors, and a multi-method assessment matrix are proposed. The criteria are motivational-agentive, epistemological-cognitive, methodological-technological, reflexive-metacognitive, axiological-ethical and communicative-impact. An integral index and a profile-based interpretation are suggested, together with a validation agenda. The article provides a comprehensive, theory-based assessment framework that moves beyond output metrics and can serve as a basis for diagnostic instruments, professional development planning and institutional quality assurance in teacher education.
References
Bieschke, K. J., Bishop, R. M., & Garcia, V. L. (1996). The utility of the Research Self-Efficacy Scale. Journal of Career Assessment, 4(1), 59–75.
Blömeke, S., Gustafsson, J.-E., & Shavelson, R. J. (2015). Beyond dichotomies: Competence viewed as a continuum. Zeitschrift für Psychologie, 223(1), 3–13.
Borg, S. (2010). Language teacher research engagement. Language Teaching, 43(4), 391–429.
Böttcher, F., & Thiel, F. (2018). Evaluating research-oriented teaching: A new instrument to assess university students' research competences (R-Comp). Higher Education, 75(1), 91–110.
Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40.
Boyer, E. L. (1990). Scholarship reconsidered: Priorities of the professoriate. Carnegie Foundation for the Advancement of Teaching.
Cochran-Smith, M. (2005). Teacher educators as researchers: Multiple perspectives. Teaching and Teacher Education, 21(2), 219–225.
CoARA. (2022). Agreement on reforming research assessment. Coalition for Advancing Research Assessment.
Decree of the President of the Republic of Uzbekistan No. UP-5847. (2019, October 8). On approval of the Concept for the development of the higher education system of the Republic of Uzbekistan until 2030.
DORA. (2012). San Francisco declaration on research assessment.
Dreyfus, H. L., & Dreyfus, S. E. (1986). Mind over machine: The power of human intuition and expertise in the era of the computer. Free Press.
ENQA, ESU, EUA, EURASHE, et al. (2015). Standards and guidelines for quality assurance in the European Higher Education Area (ESG). Brussels.
European Commission. (2011). Towards a European framework for research careers. Directorate-General for Research and Innovation.
European Commission. (2023). ResearchComp: The European competence framework for researchers. Publications Office of the European Union.
Gess, C., Wessels, I., & Blömeke, S. (2017). Domain-specificity of research competencies in the social sciences: Evidence from differential item functioning. Journal for Educational Research Online, 9(2), 11–36.
Hattie, J., & Marsh, H. W. (1996). The relationship between research and teaching: A meta-analysis. Review of Educational Research, 66(4), 507–542.
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature, 520(7548), 429–431.
Hsu, C.-C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research & Evaluation, 12(10), 1–8.
Jaakkola, E. (2020). Designing conceptual articles: Four approaches. AMS Review, 10(1–2), 18–26.
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73.
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575.
Macháček, V., & Srholec, M. (2022). Predatory publishing in Scopus: Evidence on cross-country differences. Quantitative Science Studies, 3(3), 859–887.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.
Miller, G. E. (1990). The assessment of clinical skills/competence/performance. Academic Medicine, 65(9), S63–S67.
Moher, D., Bouter, L., Kleinert, S., et al. (2020). The Hong Kong Principles for assessing researchers: Fostering research integrity. PLoS Biology, 18(7), e3000737.
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467.
Shavelson, R. J. (2010). On the measurement of competency. Empirical Research in Vocational Education and Training, 2(1), 41–63.
Tack, H., & Vanderlinde, R. (2014). Teacher educators' professional development: Towards a typology of teacher educators' researcherly disposition. British Journal of Educational Studies, 62(3), 297–315.
Torraco, R. J. (2005). Writing integrative literature reviews: Guidelines and examples. Human Resource Development Review, 4(3), 356–367.
Vitae. (2010). Researcher development framework. Careers Research and Advisory Centre (CRAC).
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Wilsdon, J., Allen, L., Belfiore, E., et al. (2015). The metric tide: Report of the independent review of the role of metrics in research assessment and management. HEFCE.





