Register  Login  Active Topics  Maps  

Is comprehension measurable?

 Language Learning Forum : General discussion Post Reply
211 messages over 27 pages: << Previous 1 2 3 4 5 6 7 ... 19 ... 26 27 Next >>
Medulin
Tetraglot
Senior Member
Croatia
Joined 4478 days ago

1199 posts - 2192 votes 
Speaks: Croatian*, English, Spanish, Portuguese
Studies: Norwegian, Hindi, Nepali

 
 Message 145 of 211
22 August 2014 at 3:08am | IP Logged 
What about European languages which lack the C2 exam?

For Swedish, the highest level is TISUS (a C1 exam),
For Norwegian, the highest level is Bergenstesten (between B2 and C1, but more like a solid ''B2"" test, according to those who took it).

If we were to be test-centered, that would mean near native-fluency in these languages is never achievable.

Edited by Medulin on 22 August 2014 at 3:10am

1 person has voted this message useful



James29
Diglot
Senior Member
United States
Joined 5185 days ago

1265 posts - 2113 votes 
Speaks: English*, Spanish
Studies: French

 
 Message 146 of 211
22 August 2014 at 3:12am | IP Logged 
I'd think of it like this... when someone is explaining how well they understand something the following sequence of terms makes sense:

I understand 1 really well.
I understand 2 really really well.
I understand 3 really really really well.
I understand 4 really really really really well.

When they use percentage terms they are not really saying anything different except it allows them to have a lot of "reallys" to play with and classify where on their scale of understanding it is.




Edited by James29 on 22 August 2014 at 3:14am

2 persons have voted this message useful



YnEoS
Senior Member
United States
Joined 4064 days ago

472 posts - 893 votes 
Speaks: English*
Studies: German, Russian, Cantonese, Japanese, French, Hungarian, Czech, Swedish, Mandarin, Italian, Spanish

 
 Message 147 of 211
22 August 2014 at 3:14am | IP Logged 
(psst, incase you missed it while you were typing, I deleted my old post and posted something new, that's hopefully more constructive)

s_allard wrote:

When someone writes that they have read a document or listened to something with a certain percentage comprehension, what am I supposed to think? If the figure is not really a true value, then what is it? I get that it's some sort of handy tool that people used to supposedly indicate their progress.

The other thing that made me think about this is that nowhere in the world of applied linguistics and second language acquisition is their anything remotely resembling this idea of percentage measurement of comprehension. This is not to confused with the vast world of vocabulary size assessment. For example, does Krashen ever speak of percent comprehension?

I also note that some people here used percentages extensively and others very rarely, if at all.

My initial interest in this topic stemmed from my own attempts at measuring my comprehension of Spanish texts and television. When I attempted of quantify how much I understood of Gabriel García Marquéz's Cien años de soledad, I saw major methodological uses that led me to abandon the whole project. So, I basically stopped
worrying about how much I was understanding.

Since I couldn't do it myself, I decided to see how other people did it. And that's why I'm here, kicking up the dust. I'm obviously not going to be satisfied if somebody tells me it's just a matter of feeling. As I sit here contemplating my Spanish book, I don't feel anything coming on me. How much longer do I have to wait?

Although I believe measuring comprehension directly is impossible, I am open to looking at possible markers or indices. This is why I have adamantly asked for people to show me how to calculate that famous 75% comprehension of Harry Potter.

Mention was made of understanding 2/3 rds of the sentences of a Jules Verne novel. I went to have a look at the novel and didn't really understand how this calculation worked.

I am fully cognizant of that fact that we have different levels of understanding in our target languages. That's not the issue. The issue is how and why put a percentage on something that seems so difficult to measure.


In response to your recent post: I think the issue is that words have flexible usage, and people use vague words to refer to specific things, human conversation is murky and inexact. You can guess what someone means based on the situation, but asking what words mean in the abstract, you often find that the words themselves don't refer to anything specific.

Take the word "big" it doesn't really mean anything that's actually out there, but in situations of communicating its useful. If I say "wow I just saw a really big pig" you assume I mean big compared to the average pig. And you might say "how big is a big?" and I might say "I dunno, maybe 50% bigger", if I think that gives you an idea. And it can get further complicated if I'm visiting another country and in their pigs are a lot bigger than where I'm from, so what's big to me is not big to them.

Enter the realm of science and "big" is useless, now we have to use weight, length, height, volume, and compare the animal's specif statistics to average statistics. The conversational phrases are mean to highlight situational distinctions, science is about making measurements that someone else can verify, but situationally scientific language may be harder to picture if the listener doesn't have a frame of reference.


Again I think people use "understand" to refer to a lot of different things, and so its difficult to discuss these things in the abstract like it's difficult to discuss "what does the word big in itself refer to".

Personally when I communicate my comprehension I like to say statements like "I ran into about 1 or 2 words I didn't know per sentence" which is less likely to produce ambiguities, but still isn't terribly scientific.

In terms of measuring personal comprehension, I don't really have a specific system, I keep reading a book if I can follow the story, and if I feel I'm recognizing new words I assume my comprehension is growing. I can't really see how I've improved until i re-read it and understand more that I previously didn't.

Edited by YnEoS on 22 August 2014 at 3:18am

2 persons have voted this message useful



hrhenry
Octoglot
Senior Member
United States
languagehopper.blogs
Joined 4940 days ago

1871 posts - 3642 votes 
Speaks: English*, SpanishC2, ItalianC2, Norwegian, Catalan, Galician, Turkish, Portuguese
Studies: Polish, Indonesian, Ojibwe

 
 Message 148 of 211
22 August 2014 at 3:15am | IP Logged 
Medulin wrote:

If we were to be test-centered, that would mean near native-fluency in these languages is never achievable.

No, all it means is that a B2 (or C1) level is all that is needed to function in a job or university.

That is, after all, the reason the CEFR-based tests were created.

R.
==
3 persons have voted this message useful



James29
Diglot
Senior Member
United States
Joined 5185 days ago

1265 posts - 2113 votes 
Speaks: English*, Spanish
Studies: French

 
 Message 149 of 211
22 August 2014 at 3:20am | IP Logged 

Edited because I either misread a previous post or it was changed.

Edited by James29 on 22 August 2014 at 3:22am

1 person has voted this message useful



Cavesa
Triglot
Senior Member
Czech Republic
Joined 4819 days ago

3277 posts - 6779 votes 
Speaks: Czech*, FrenchC2, EnglishC1
Studies: Spanish, German, Italian

 
 Message 150 of 211
22 August 2014 at 5:56am | IP Logged 
I had already posted why the cefr levels aren't a good way to assess one's skill at times:

1.the purpose of the CEFR is to rate your overall skill with high focus on application useful for an employer while things like enjoyment are not a priority. You either get one grade or at most there is a note about level at each four basic skills. Reading of books, which is the main point of this thread, is just one of many subskills to the reading comprehension. Therefore a person with B1 certificate with B1 grade to the reading comprehension part of the exam may read the Harry Potter book with complete comprehension or struggle to make any sense of it or anything in between.

2.The descriptions of cefr skills related to reading books in particular are vague. You are not supposed to assess your skill based on one such subskill alone. So even self assessing your CEFR level isn't that reliable.

3.The gaps between the CEFR levels are quite wide, which is why the scale is totally useless for someone wishing to make note of their progress in between the levels. Like it or not, people are not at B1 until the 22 August midnight and at B2 from the 23 August. It is a gradual process and learners in general need to express their progress somehow. Without this need, no % guesses would have ever begun to appear. But they are here and they obviously serve their main purpose: expression of ones self assessment of a passive skill, based on scale of their own experience and goals.
6 persons have voted this message useful



s_allard
Triglot
Senior Member
Canada
Joined 5240 days ago

2704 posts - 5425 votes 
Speaks: French*, English, Spanish
Studies: Polish

 
 Message 151 of 211
22 August 2014 at 2:22pm | IP Logged 
I won't bother to argue over the appropriateness of the CEFR system for measuring comprehension. That's
another debate.

But I did have an interesting experience last night. A German-speaking friend and I watched the film Das Boot in
German but with English subtitles. I had studied German some years ago and could catch the odd word and
phrase here and there. As I was watching the film, from time to time I would ask myself how can I estimate my
level of comprehension. I would normally say Some, of course, but for this debate I decided to think in terms of
percentages. As the images and the words were flitting by, I kept trying to imagine what figure would best
reflect my experience.

I tried to "feel" a number. Nothing happened. No magic number popped up in my head.

The words were going by too fast for me to even begin to think about estimating what percentage of the words I
could understand.

What number should I put down? 1%, 2%, 3%, 4%, 5%, 6%, 7%? Pick any number.

And how did this number compare to the experience of the native German speaker sitting next to me? Can I put
a figure on the difference between our perceptions of the same thing?

Edited by s_allard on 22 August 2014 at 3:18pm

1 person has voted this message useful



luke
Diglot
Senior Member
United States
Joined 7015 days ago

3133 posts - 4351 votes 
Speaks: English*, Spanish
Studies: Esperanto, French

 
 Message 152 of 211
22 August 2014 at 4:48pm | IP Logged 
s_allard wrote:
The words were going by too fast for me to even begin to think about estimating what percentage of the words I could understand.

What number should I put down? 1%, 2%, 3%, 4%, 5%, 6%, 7%? Pick any number.

And how did this number compare to the experience of the native German speaker sitting next to me? Can I put a figure on the difference between our perceptions of the same thing?


100% - 1% = 99%
100% - 7% = 93%


1 person has voted this message useful



This discussion contains 211 messages over 27 pages: << Prev 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27  Next >>


Post ReplyPost New Topic Printable version Printable version

You cannot post new topics in this forum - You cannot reply to topics in this forum - You cannot delete your posts in this forum
You cannot edit your posts in this forum - You cannot create polls in this forum - You cannot vote in polls in this forum


This page was generated in 0.4844 seconds.


DHTML Menu By Milonic JavaScript
Copyright 2024 FX Micheloud - All rights reserved
No part of this website may be copied by any means without my written authorization.