New registrations are now closed for the 2009 IATEFL site. The forum content is for reference only.
Can research actually 'proove' anything about learning?
- Login to post comments
I was recently interviewed about language learning in Second Life (a virtual world). After the interview was published a comment was posted about the interview saying that learning in Second Life hadn't yet been proven by research to be effective.
It started me wondering if research can ever really 'prove' one method, approach or means of learning more effective than another.
In order to 'prove' something through empirical research don't we need to be working with stable constant factors? In a kind of 'controlled' environment?
As we know people are neither constant, stable nor easy to control. So how can we do research that delivers generalizable proofs?
We can maybe say that this group of people did better at this time with this means of learning than they did at another time with another means of learning, but does that even prove anything? Is it due to the means of learning or is it down to what was happening with these people's lives at that time, how busy they were, how happy they were, how much they liked the person teaching them etc.
Don't get me wrong, I think research is great and that as teachers we must continuously observe, consider and learn, but prove???
I have serious doubts about being able to prove anything much.
Best
Nik
Hi Nik
What on earth does "proven ... to be effective" mean? How is it measured? I think we need some kind of scale / unit of measurement. What shall we call it?
Anyway, if we wait for research to prove something in ELT we had all better find something else to do; but, since there are actually people in real life looking for the holy grail, I guess there will also be others looking for proof that task based learning is "better" than grammar translation.
Pete
Nik,
It occurs to me that it could be an eponymous scale - somehow I like the sound of it:-
"Well Second Life scores six and a half on the Peachey scale so why haven't we started using it?"
Pete
I think the simple answer is no. The best that research can do is "prove" that something is worth trying in the arena where the real proof is.... with real students.
Can the notion of "proof" that was used in this context be considered as a "scientific feedback" on what has been done? How do you see it? Helga
HI Nic, everyone
'Science' can and does prove many things to be 'true', every day.
So maybe it has more to do with individuals accepting that something has been proven true or not?
You have the right to reject whether proof has been provided or not. If you're not a scientist or investigator yourself you are put in a position of 'faith' rather than onus.
To be continued...
robert
Hi Nik:
Different teaching methods cannot be compared, but the outcomes of different teaching methods can be measured and compared assuming the constructs are properly operationalized (J. D. Brown, personal communication). Comparing teaching/learning methods would be like comparing apples and oranges. Also, if by the terms "method," "approach," and "means," you are referring to a way of teaching/learning that is supported by a theory, then it cannot be proven to be correct/true since a theory can only be falsified and not proven to be true (refer to Popper, Karl R. (1983). The aim of science). Along this same line, a medical researcher once remarked, in reference to double-blind studies, that if research involves human beings, then nothing can be proven to be true because there are to many variable (and there is no reason to believe that they have all been identified).
Dan Jenkins (Foreign Expert, English Department, China University of Mining and Technology, Beijing, China)
Dear Dan
Firstly, tell me why you called yourself a 'foreign expert'?
And secondly, tell me what exactly you are a 'foreign expert' of?
curios
robert
Hi Robert:
Firstly, I don't call myself a Foreign Expert, the Government of the Peoples Republic of China calls me a Foreign Expert. I have never in my entire life referred to myself as a Foreign Expert or even an Expert. That would be like referring to myself as Mr. Jenkins. Doing something like that where I come from would get me laughed out of the pool hall, or worse. When I posted my self-introduction in one of the forums (I just checked and discovered that it is not this forum, but I can't remember which one it was), it asked for some personal information and the context in which I work. The context in which I work is as a Foreign Expert. The term Foreign Expert is a designation used by the State Administration of Foreign Experts Affairs, People's Republic of China. Another designation is "Foreign Teacher." The designation of "Foreign Expert" requires a higher level of expertise than that of "Foreign Teacher." My Foreign Experts Certificate classifies me under the title: "Foreign Experts Working in the Fields of Culture and Education." Culture and education is not the only Foreign Expert field. So, since these forums want to know my working context, I decided to state the context with each post. My personal opinion is that with that bit of information and 100 RMB, I can buy a cup of tea anywhere in Beijing (Note that I place my working context in parentheses, which is an indication of the small importance that I attach to it, and that I don't state my degrees).
Secondly, regarding what I am "a 'foreign exgert' of," I am a "Foreign Expert Working in the Fields of Culture and Education." That probably doesn't provide you with the information you want. So, some additional information is:
1. I have a background in nuclear engineering with specialties in nuclear chemistry, pure water chemistry, steam generator chemistry, radiation health physics, quality assurance programs, quality control programs, and preventive maintance programs. I have made contributions in each of these subfields. These descriptions are intentionally vague because the specifics are classifed. When I was actively working in these fields, I was considered by my collegues to be an expert and I considered my collegues to be experts as well, but that term was never used as a title or otherwise. Usually, I was addressed as "Hey, you! What are you up to now!?"
2. Excluding the educational background and training related to No. 1 above, which is classified, I have a BA TESL, BA Chinese, BA Asian Studies with a concentration on China, and an MA in Second Language Studies with dual concentrations in Second Language Acquisition and Pedagogy (i.e., theory construction and application). I specialize in teaching American English to native speakers of Mandarin with an emphasis on pronunciation and listening (grammar is pretty much a done deal, but I find the problems in the areas of pronunciation and listening to be interesting). I have been told that those familiar with my research refer to me as an expert in the fields of adult acquisition of L2 pronunciation (my research was the first to demonstrate that an adult learner is able to acquire the pronunciation of the segmentals of an L2 to the level of accuracy of a native speaker as a result of instruction) and in listening comprehension (I identified the reason why adult L2 learners listen "too slow" and developed a solution to the problem). I think they do it just to make me feel uncomfortable. My attitude regarding titles is like that of a good friend of mine who has a PhD in History: he refers to himself as a teacher. Likewise, when someone asks me what I do to pay the bills, I answer, "teach English as a foreign langauge."
So, in summary it is my understanding that this forum prefers participants to state their working context and the context in which I work is as a Foreign Expert in the English Department of the China University of Mining and Technology in Beijing, China.
I would suggest, if I may, that you do what others do in a forum such as this: focus on people's ideas and not their educational backgrounds or titles. I am willing to learn from a 1-year-old if the rug rat has something to teach me. As a female aquaintance of mine once said, she liked internet chat rooms because people had no choice but to judge her based on what she had to say rather than on her physical appearance and choice of attire.
Finally, I did take note of the fact that your orientation is qualitative in nature. Mine is quantitative. So, although I agree with most of what you have said in various forums, and I am glad you said it because it saved me a whole lot of key strokes, I have not engaged you in conversation on the topics that we disagree on (and there would be no point in talking to you about what we do agree on). I have no interest in engaging you in a discussion involving topics on which we would natural disagree because of our different philosophical positions. Philosophical debates don't resolve anthing, they just generate more philosophy. We would accomplish nothing more than identifying the unproven and unprovable assumptions that we each rely on. Nonetheless, I am fairly sure that I will continue to enjoy your postings.
I hope this answers your questions.
Dan Jenkins (Foreign Expert, English Department, China University of Mining and Technology, Beijing, China)
Hi Dan
First, let me say thank you very much for indulging me. And second, I really appreciate what you have shared.
Thirdly, please excuse the way I queried your 'credentials'. I'm a cynic. I've grown very cynical of EFL teaching in China. I have worked in China for about 8.2 years now and constantly meet Englishers and other English as L2 speakers who use the title 'foreign expert' or 'foreign teacher' in such a 'gin rummy' kind of way that I just have to respond to it. Not that you did.
It's a habit of mine because, quite frankly, I meet so few EFL 'experts' and/or actual EFL 'teachers' in China that whenever I hear someone say (or read that they work in China as an EFL teacher) that I respond with some degree of incredulousness. And all it takes is a brief chat with them to discover just how intuitive I am. Yet others wouldn't think about it like that, preferring instead to think that one needn't be 'qualified' to be an EFL teacher.
I focused on you because I hadn't seen your name in the forum before, or until recently. And, because you indicated that you were working in China. Apologies for making you think you being 'singled out' for criticism.
As to your suggestion that I focus on people's ideas and not their educational backgrounds in this forum is fair and reasonable, but I'm not one of those people; I'm interested in both. I'm a curious person and want to know things. And I say again that I appreciate the way you have indulged my curiosness.
Lastly, but not least, I think it is highly important that people know why people call themselves an EFL teacher ('expert') and/or how they came to be an EFL teacher ('expert') (like yourself). More importantly, I think people need to know how and why the China State Administration of Foreign Experts Affairs (or any other country) categorizes and labels the 'foreigners' working within its borders as EFL 'experts' and/or 'teachers'. 1. It makes for interesting reading. 2. It raises some interesting points of discussion. I think this could have easily been a forum discussion topic!
thanks again
robert m. easterbrook
Foreign Expert, English Department, Harbin University, Harbin, Heilongjiang Provence, P. R. China
Hi Nik:
In a previous post on 4/17/09 in response to your questions, I referred to "Popper, Karl R. (1983). The aim of science." The correct citation is, "Popper, Karl R. (1983). Realism and the aim of science." My apology for the error.
Dan Jenkins (Foreign Expert, English Department, China University of Mining and Technology, Beijing, China)

Hi Nick,
this has to do with a previous post of yours. I believe that in the field of education, research is not about quantity but about quality. Therefore, prooving something is just not the point :)
best
Carla