EXPERT ASSESSMENT METHOD IN TRAINING LECTURERS FOR WORK IN INTERNATIONAL GROUPS OF STUDENTS

Вестник ЮУрГУ. Серия «Образование. Педагогические науки». 2020. Т. 12, No 1. С. 83–89 Introduction At present, almost all types of professional activity are somehow related to the examination or assessment. Doctors and teachers, managers and engineers, lawyers and economists and other specialists, to one degree or another, act as experts and/ or those who are being assessed or examined. As a result of the examination (assessment), experts determine the winners of contests and competitions, create ratings of organizations (enterprises, banks), politicians, businessmen and athletes, approve indices (Dow Jones and other.) etc. The system of Higher Education is not an exception. Speaking about examination/ assessment in education, it should be mentioned that examination is the word of Latin origin, meaning research, resolution with the help of knowledgeable, experienced people in any field of science and technology that requires special knowledge. In turn, an expert means an experienced person invited in controversial or difficult cases for examination or assessment [20]. In pedagogy, the scope of scientific and pedagogical expertise is very extensive: competent assessment of new textbooks and manuals, expert assessment of the achievement test, expert evaluation of projects and creative works, etc. The number of expert assessments today is increasing, since this method helps in solving complex scientific, technical and socio-economic problems in conditions where there is no information about solving similar problems in the past. Subject of the study The subject of our study is the process of training lecturers who are going to work with international groups of students. In our article we try to identify problems associated with foreign students teaching that may be faced by lecturers, who are just starting to work in international groups of students, using the expert assessment method. Teaching in international group of students in the situation of global changes in the system of Higher Education is rather new due to the fact that Russia has signed the Bologna Declaration in 2003. And since then the programs as well the methods of teaching have changed drastically. Although Russia has a very rich experience in teaching foreign students during the years of the Soviet Union era, the “imperatives of internationalization” demand absolutely new approach to the process of education in international groups of students at our universities. Methods We apply the method of expert assessments as it is rather popular and deeply studied in modern science. To prove it, we would like to mention briefly what has been done in this area. Nowadays, there is not only a great number of scientists, like L.G. Evlanov [9], A.A. Frenkel [11], DOI: 10.14529/ped200108


Introduction
At present, almost all types of professional activity are somehow related to the examination or assessment. Doctors and teachers, managers and engineers, lawyers and economists and other specialists, to one degree or another, act as experts and/ or those who are being assessed or examined. As a result of the examination (assessment), experts determine the winners of contests and competitions, create ratings of organizations (enterprises, banks), politicians, businessmen and athletes, approve indices (Dow Jones and other.) etc. The system of Higher Education is not an exception.
Speaking about examination/ assessment in education, it should be mentioned that examination is the word of Latin origin, meaning research, resolution with the help of knowledgeable, experienced people in any field of science and technology that requires special knowledge. In turn, an expert means an experienced person invited in controversial or difficult cases for examination or assessment [20]. In pedagogy, the scope of scientific and pedagogical expertise is very extensive: competent assessment of new textbooks and manuals, expert assessment of the achievement test, expert evaluation of projects and creative works, etc.
The number of expert assessments today is increasing, since this method helps in solving complex scientific, technical and socio-economic problems in conditions where there is no information about solving similar problems in the past.
Subject of the study The subject of our study is the process of training lecturers who are going to work with international groups of students. In our article we try to identify problems associated with foreign students teaching that may be faced by lecturers, who are just starting to work in international groups of students, using the expert assessment method. Teaching in international group of students in the situation of global changes in the system of Higher Education is rather new due to the fact that Russia has signed the Bologna Declaration in 2003. And since then the programs as well the methods of teaching have changed drastically. Although Russia has a very rich experience in teaching foreign students during the years of the Soviet Union era, the "imperatives of internationalization" demand absolutely new approach to the process of education in international groups of students at our universities.

Methods
We apply the method of expert assessments as it is rather popular and deeply studied in modern science. To prove it, we would like to mention briefly what has been done in this area. Nowadays, there is not only a great number of scientists, like L.G. Evlanov [9] [14] etc., who contributed articles and books on the methods of expert assessments, but also the authors [10, p. 14], who provide an overview of what has been done in this area. Such a review is presented in the works of G.G. Azgaldov [1], as well as in G.G. Azgaldov and E.P. Raikhman's work [2], D.S. Schmerling [18], V.S. Cherepanov [6] and others. As the first steps in the development of expert assessment methods, one can consider the work of a group of American psychologists who began to study the influence of the expert's interest on the nature of his/her judgment on future socio-political events in 1930. Studies have shown that the level of expert's special knowledge has the greatest impact on the reliability of his/her statements [3, p. 8].
It can be stated that at present the statistical and mathematical foundations of this method are substantiated in sufficient detail [5], as well as its role and place in the pedagogical expertise [12,13] etc. Fundamental research in this area was conducted by V.S. Cherepanov [6].
In addition, there has been a tendency abroad not to explore the expert method itself, but the expert systems, such as Artificial Intelligence.
A few years later the study of expert systems done by R. Benfer, E. Brenta, L. Furbi (R.A. Benfer, E.E. Brent, L. Furbee, 1991) becomes fundamental [4]. In their book, the authors have presented a detailed model for developing expert systems. This model involves the acquisition, storage, presentation of knowledge, as well as the assumption that this knowledge is limited in diagnosing and predicting of human behavior.
G. Strube, D. Janetzko, M. Knauff (1996) investigated the structure of generalized expert knowledge [19]. This study also outlined a transition from the analysis of the knowledge of individual experts to the analysis of their generalized opinion, which is permeated by psychological laws. The authors proposed a technique for collecting knowledge of experts.
Methods of expert assessments are continuously developed and improved.
Expert methods, including the method of group expert assessments have been increasingly used in pedagogical research in recent years [15,17]. The method of group expert assessments is fundamental in pedagogical qualimetrythe science of measuring and assessing the quality of pedagogical objects and processes [2]. We have chosen this method for conducting our ascertaining experiment (at the beginning of our study).
Expert assessment is a procedure for obtaining an assessment of a problem based on the opinion of specialists-experts in order to come to a certain decision / conclusion [7, p. 183-187]. The method of expert assessment allows to get the most reliable results and conduct an analysis on the problem we are studying: the problem that lecturers (who are just beginning to teach in international groups of students) may come across. Experts are the competent colleagues who have been working in international groups of students and can point out such problems.
From the standpoint of pedagogical qualimetry, the validity of the expert assessment method application is confirmed by the fact that the methodologically correctly obtained expert judgments satisfy the criteria of accuracy and reproducibility of the examination result [2]. Moreover, a technology for the transition from individual expert to collective assessments has been developed within the framework of this method.
The competence of an expert in the field of pedagogical research was determined by such requirements to him/ her as: awareness, objectivity, skill level, creativity, etc. The more experts' qualities are taken into account, the less is the variance of their individual assessments. And this (small variance), in turn, improves the quality of pedagogical expertise. All of the experts were lecturers from the South Ural State University (SUSU) with the sufficient experience of working in groups with foreign students.

Discussion
The selection of experts with the necessary qualities was carried out using the following methods: mutual recommendations, self-assessment, assessment of argumentation, personal data, and assessment of consistency [16].
The method of mutual recommendations is similar to the method of voting. Each expert had to give information about his/her place of employment, position, academic degree and rank, teaching experience and other personal data. The experts were also asked to answer the question: "Who would you choose as an expert from the proposed list?" The coefficient of mutual recommendations was determined on the basis of the questionnaire. The more votes were given for an expert, the greater was his coefficient of mutual recommendations [3].
The method of self-assessment is based on the subjective assessment of an expert candidate himself/ herself as a specialist in the pedagogical problem under consideration. Candidates for experts needed to rank the indicators of the questionnaire and assess themselves on the following proposed scale (table 1).
1. I have been working in groups with international students: for 1-3-5 years.
3. I am familiar with the problem of applicants'(who arrived from different countries) different levels of knowledge 1-2-3 point-scale; (1 -is minimum; 3 -is maximum).
4. I am familiar with the problem of a different attitude towards the educational process of students from various countries. 1-2-3 pointscale; (1 -is minimum; 3 -is maximum).
From the number of experts selected by us for this survey, all candidates chose maximum scores/points (2 and 3). This result allowed us to conclude that the choice of experts was correct as the main selection bias is the competency in the research field. The specialist involved as an expert should be a person who himself/herself has experienced the difficulties of problem situations in the subject area of social reality, who has judgments about the nature of these problem situations, and what, in his/her opinion, is necessary to do to find a solution of the problem.
The methods for assessing competence include collection of personal data, which takes into account the relationship between the individual documented characteristics of an expert candidate and the properties that determine his/her quality as an expert (academic degree, title, number of methodical works, etc.). All the experts who took part in the assessment have academic degrees (six lecturers holding a PhD degree) (two lecturers holding a title of a Full Professor). All the experts have scientific, methodological and educational publications on the problem under review for this study.
The main types of expert interviews are: questioning, interviewing, Delphi method, brains-torming, and discussion. For our study, we chose a questionnaire. The main advantages of the questionnaire survey method are the ability to collect a large amount of information for a sufficiently short period and the independence of expert judgments. The disadvantages include the difficulty of developing an effective questionnaire that contains a reasonable list of questions.
The procedure for interviewing experts excluded the possibility of exchanging views between them in order to avoid mutual influence on the final decision on a particular issue. During the ascertaining (stating) experiment we used questionnaires, to which a number of requirements were presented: -the questionnaires had to be valid. We adhere to the concept of "validity" after I.F. Devyatko and we consider that the validity of a measurement, in the most general sense, characterizes the conformity of a measurement to its purpose. The empirical indicator is valid to the extent that it accurately reflects the value of the theoretical variable that was supposed to be measured [8]. The measurement is valid as it characterizes the conformity of our measurement to its purpose. Besides, we have conducted a pilot study among the lecturers and asked them to answer the question: "What are main difficulties of working in international groups of students?" They all understood the question and found it correct.
-the questionnaires had to have measuring properties, which ensure the inclusion of important factors of indicators and the choice of scale for assessing the quality of the object being assessed.
There were eight experts (lecturers from the SUSU) who took part in the survey. The questionnaire consisted of two parts: Part 1 -information about the expert (work experience at a university, academic degree / title, availability of scientific, educational and methodological publications on topics under review in this study, and experience in international groups); Part 2questions regarding the clarification of the state of the problem in practice, i. e. questions regarding  1  5  5  3  5  3  5  5  5  2  3  3  2  3  2  3  3  3  3  3  3  3  3  3  3  3  3  4  3  3  3  3  3  3  3  3 Bulletin of the South Ural State University. Ser. Education. Educational Sciences. 2020, vol. 12, no. 1, pp. 83-89 the main problems that the lectures (who will start working in international groups of students) may come across.
In the course of administrating the survey to the experts (ascertaining/stating experiment) we obtained the following results of the state of the problem (pedagogical assistance in the development of professional competence of lecturers in groups with foreign students): 1. Differences in educational process in general.
1.1. Students enter the SUSU with different levels of knowledge obtained at the previous stage of education. (Upon admission to SUSU, foreign students do not pass entrance exams.) 1.2. Adaptation to the requirements of lecturers, living and weather conditions, and cultural traditions etc. is different and takes a long time, despite the fact that SUSU holds an annual information day for foreign students. There is also an association of foreign students and other events that help foreign students to get used to living in Russia.
1.3. Differences in behavior -the intolerance of some nations in relation to others.
2. Different behavior in the classroom (from complete "inaction" to "excessive activity"). Students' attitudes on educational process are divergent. To a greater extent, this indicator is affected by the social status, as well as the level of knowledge (+ self-organization) obtained at the previous stage of education and nationality; (age has a lesser degree of effect).
3. Lecturers who conduct classes with foreign students communicate with their students after classes as well, helping to solve organizational issues, helping to adapt, and also advising on their academic discipline. (Some of the students are embarrassed to ask questions on academic discipline during the lesson.) After conducting the survey we processed the results. The initial information for processing was numerical data expressing the preferences of experts, and substantiation of their preferences. The purpose of the processing was to obtain generalized data and new information contained in a hidden form in expert assessments. Based on the processing results, we formed the solution to the problem.
During the ascertaining (stating) experiment, we evaluated the consistency of experts' opinions. The collected expert opinions were processed both quantitatively (numerical data) and qualitatively (meaningful information). III. What, in your opinion, is the most important problem. Arrange the numbers of the previous questions in descending order of importance (1-7).  From table 2 we observe that the most important issues are the ones of intercultural and language training.  1  6  5  5  5  5  5  5  5  2  5  6  6  6  6  6  6  6  3  3  3  1  3  3  1  3  1  4  1  4  3  1  4  4  1  3  5  4  1  4  4  1  3  4  4  6  2  2  2  2  2  2  2  2 For our study, questions 5 and 6 are the most important (table 3). After processing the data, we conclude that knowledge of the main cultural features and good command of a foreign language (+ EMI) are the most important aspects in preparing lecturers for working in international groups.

Results
After conducting the ascertaining (stating) experiment, we identified the main problems that the lecturers who are going to teach in international groups of students may come across. We also suggest the solution of these problems: lecturers newly embarking on work with foreign students should be able to conduct conversations on the taught course in a foreign (English) language (the level of the language cannot be lower than B2); lecturers should also know the EMI course for conducting classes in international groups, as well as to understand the intercultural peculiarities of communication with students from different countries.