Earlier this month, the “Our Leadership” section of the ETS website was reshuffled.  The most notable change was the removal of Chief Diversity Officer Ida Jackson Woods from the public leadership roster.  An individual holding that position had been included on the leadership page since at least 2019.

Two days ago, all content on the ETS website describing its commitment to Diversity, Equity, Inclusion and Belonging were removed.  It appears that no references to DEIB policies remain on the website.  Indeed, even a single-sentence reference to DEI on the “About ETS” section of the site has been removed.

To view the DEI content as it existed before its removal, you can check out this archive.

Here’s an article from the PIE by Polly Nash about the increased cost of taking the TOEFL iBT in the European Union. It includes this quote from an ETS rep:

“We recognise the importance of affordability for our test takers and remain committed to delivering the highest value through our assessments and services.”

That’s nice to hear.

My impression is that while Pearson, the British Council and IDP Education have all been remitting sales taxes to the relevant authorities for some time, ETS has only just started doing so.

But I could be wrong.

Here’s a digression:

The pricing of tests that operate on a global scale is a tricky thing. Test takers in some markets have to deal with price hikes every year. Sometimes they see the cost of a given test increase two or three times in a single calendar year. Test takers in other markets are mostly immune to price hikes. Accordingly, students occasionally feel like they are subsidizing test takers in more competitive and lucrative markets. I have a lot of admiration for companies that have implemented a single fixed price for everyone on the planet.

I was sent the actual testimony of British Council CEO Scott McDonald before the Foreign Affairs committee.  The situation over at the BC seems even worse than the Times article made it out to be.  Here are a few highlights:

  1. The British Council owes £200 million (from an original loan of £250 million) to the Foreign Office.  At the end of each year this loan is rolled over to the next year.  This is the reason for the regular delays in getting the British Council’s annual reports.  Regarding the delay, McDonald said:  “we cannot file our accounts until we have that rolled over, because without it we would be insolvent.”  This is the problem of the moment.

 

  1. A lot of interest is paid.  Noted McDonald:  “Based on the way that it is structured at the moment, it is a high interest rate. It is pretty onerous. We pay £14 million a year in interest. Every year when we roll it over, there are a couple of million in admin costs for rolling it over.”

 

  1. BC is seeking a 20-25 year repayment plan for the loan, beginning 2-4 years from now.

 

  1. There are plans to reduce costs by £250 million over the next five years. So far, headcount has been reduced by 17%, and the BC has pulled out of 18 countries.  All back-office functions have been outsourced.

 

  1. And BC’s IELTS operations in India have been sold. Regarding this sale:  “When we first took the loan, which was in the middle of covid, it was £250 million. The first thing we did was sell one of our really good businesses, the English assessment business in India, so we could pay back some of the money and show goodwill right away. We sold that business and paid back £50 million of the loan right away and brought it down to £200 million.

 

  1. Aside from the loan, the BC gets £165 million yearly from the British government to support its operations.  They are asking for an additional £75 million (plus support on the loan).

 

  1. Without the above bump-up (and loan support), the BC would likely pull out of 30-40 more countries.

 

  1. There is a weird dance between McDonald and the Chair about why and how the BC was 53 million in the red post-Covid (‘22-’23).

 

  1. Some of the BC art collection can be sold.  Some of the 40 buildings owned by the BC can also be sold.

 

  1. McDonald:  “There is lots of organised crime that tries to access those [IELTS] exams.”

I’m traveling in Indonesia this month, so the column will be somewhat abbreviated.  But I did read a few interesting things.

First up, I read Martin Hajek’s “More than a Gap Year Adventure,” a book about making a long-term career out of TEFL.  That’s something I’ve accomplished, to some extent.  But when people ask me for advice about how they might do the same, I’m often at a loss.  I’m quite aged now, and my anecdotes are decades out of date.  So I’ll send people to Amazon to buy the book, or perhaps even gift a few copies myself.  Readers will find a general introduction to the field by Hajek, and a lengthy collection of essays by contributors who have found success.  There isn’t anything in here about working in the test prep industry, but there is a fine essay about being a test examiner.

(By the way, just a few days ago someone asked me about working in the test prep industry.  Since my earlier musings are all out of date, I’ll try to pen a few words when I return from my travels.  But even this is hard for me.)

Next, I read Angela Nagle’s “Kill All Normies.”  This one is a short history of the online countercultures that memed Donald Trump into office back in 2015/16.  It’s an interesting read, especially in light of the very different path Trump just took to get back into office.  I’ll add it to the “Test Resources Left Book Club” index when that next gets updated…

Finally, I read the 14 December 2023 issue of the London Review of Books.  A few fine articles stood out that could help people practice their academic reading skills.  They are:

  • I Don’t Know What it Looks Like,” which is about the less-studied modern architecture found in Paris.  Architecture comes up now and then in the TOEFL reading section, and I don’t share nearly enough content about it on the site.  Check out the article.
  • Hickup over the Littany,” which is about efforts to figure out what music from the past actually sounded like.  That’s probably impossible to do, but some people have dedicated their lives to it.  Again, music is a topic that appears often enough in the TOEFL reading section, but it is often ignored by people who make prep materials for the test.
  • Friend or Food,” an article about how European exploration of the new world influenced thinking about animals and pets.  A fascinating read.  History, as you know, is a topic often explored on the test.

I’m now seeing big TOEFL price hikes across the board.  Below find a list of increases in the countries I track (minus EU countries, which I wrote about a few days ago).

A few things stand out.  The biggest hike was a $35 increase in Iran, where the test now costs $300.  Neighboring Iraq saw a $15 increase and a new total price of $295.  The test now costs a whopping $470 in Switzerland (a $20 increase).

Note that the cost is the same whether the test is taken at a test center, or at the test taker’s home.

The full list of increases is as follows:

  • Afghanistan  – $10
  • Argentina – $15
  • Australia – $15
  • Azerbaijan – $20
  • Brazil – $5
  • Canada – $9
  • Colombia – $13
  • Congo (DR) – $10
  • Georgia – $10
  • Ghana – $5
  • Guatemala – $15
  • Hong Kong – $10
  • Iceland – $10
  • Iran – $35
  • Iraq – $15
  • Israel – $10
  • Jordan – $9
  • Kenya – $15
  • Kosovo – $10
  • Mexico – $5
  • Mongolia – $15
  • Morocco – $15
  • New Zealand – $5
  • Pakistan – $25
  • Palestinian Territories – $9 (Amit, why?)
  • Peru – $15
  • Switzerland – $20
  • Tajikistan – $5
  • Thailand – $10
  • Turkey – $13
  • UAE – $15
  • UK – $10

Prices surely increased elsewhere, but I don’t track the whole planet.

A startling article this week in the Times laid bare the precarious financial state of the British Council. The organization is seeking to sell assets – including its famous art collection – to repay  £200 million of debt, most of which appears to be owed to the UK’s Foreign Office.

According to CEO Scott McDonald, the British Council faces “a constant threat of insolvency.”  The Times notes that in addition to the possible sale of its massive art collection, its leadership is “eyeing up which of the organisation’s foreign outposts can be put on the market.”

This all comes as one of the British Council’s biggest revenue generators – the IELTS test – faces stiff competition from new test makers at home and abroad.  Some observers have suggested that competing test makers are somewhat more nimble and responsive to changes in technology and consumer tastes than the venerable IELTS partnership. Test volumes have also been impacted by the loss of longstanding monopolies in major score receiving markets.

Note that in 2021 the British Council sold its Indian IELTS operations to IDP Education for a cool £130 million (cash) and exited the testing industry in that key market. One wonders if similar deals could be reached in other important sending markets.

The British Council is not alone as it struggles with its finances.  Several of the so-called legacy English testing companies have faced tough times in recent years.  IDP Education announced massive layoffs in June of last year, while ETS offered buyouts to virtually every employee in the United States around the same time.

The British Council’s next annual report is due to be published by the end of this month, but it could be delayed.

As a sort of followup to my earlier post about VAT being added to TOEFL fees in the EU, Here’s what it costs to take some of the most popular English tests in France (all prices USD):

  • IELTS Academic: $269 (inclusive of tax)
  • PTE Academic: $270 (inclusive of tax)
  • TOEFL: $324 (inclusive of tax)

Prices look similar across the EU.  The TOEFL is much more expensive in pretty much every EU country now that ETS has started collecting VAT (and passing the additional cost on to test takers).

I love my friends at ETS, but gee whiz the TOEFL is going to be a tough sell moving forward.  Is it providing some special sauce that makes it worth the added expense?  I’m not sure.

Anecdotally, it seems like ETS has begun 2025 with a really big promotional spend via Google Ads.  I’m seeing a ton of banners promoting the TOEFL as a test for destinations outside the USA.  TOEFL is also the headline sponsor of the upcoming PIE Live event in March.  Setting aside the fact that the audience there is exactly who the TOEFL team doesn’t need to influence, that sponsorship must cost a pretty penny.  Why bother spending so much money on promoting a test when you’ve got corporate policies kneecapping your potential in one of the biggest sending markets?

Who knows, who knows.

I suppose it is also worth mentioning that there are a bunch of new-ish tests (Password, LanguageCert, Kaplan, etc) with an average price somewhere close to $200.  The DET costs $65.

So here’s my LANGUAGECERT statement of results along with a separate certificate I was issued.  As you can see, the statement of results provides the sorts of details one normally finds in such a document, while the certificate is more concise and better suited for sharing online.  The certificate is a nice touch as traditional score reports necessarily contain a lot of clutter, including certain personal information that some test takers would rather not share publicly.

The results took nine days to reach me, including the January 1 holiday.  That’s a bit longer than the category average.

If my reading of the LANGUAGECERT website is correct, a paper version of the statement of results is sent automatically to all test takers.  That’s nice too.

You can also read part one of my experience taking this task, and part two.

 

 

Some new error messages are showing up in some people’s TOEFL accounts a few days after they complete the test. Sometimes the message says:

“Due to an administrative issue, we are not able to provide a score report, please contact customer support.”

As far as I can tell, this means that no score will be provided.

Other times the message says:

“Test administration is delayed due to an administrative review, typically completed in 2-4 weeks; for updates please contact customer support”

This means what it says – a score cannot be provided right now, but it might be provided when the review is finished.

These seem to be replacements for the “Scores Cancelled” and “Scores Not Available” error messages people used to get. 

Needless to say,  folks who get these messages are not able to see their scores and feel some anxiety.  If you see the message you should contact ETS customer support, as indicated.

Let me know in the comments if you are dealing with this issue.

Here’s a challenging but fascinating article from ETS (Jodi M. Casabianca, Dan McCaffrey, Mathew S. Johnson, Naim Alper, Vladimir Zubenko) about using generative AI to score constructed responses.  Test watchers might enjoy the included “Demonstrative Study Using GPT4 for Scoring” in which 1,581 responses (TOEFL, GRE and Praxis) previously scored by trained human raters and ETS’s e-rater (which scores responses based on features they contain) were submitted to GPT4 for scoring.  GPT4 was provided the response, the question and the rubric.  The scores produced were compared to those provided earlier by e-rater.  In an earlier draft of this post I attempted to summarize the results.  Alas, that is somewhat beyond my meager abilities.  Do check out the article for yourself (beginning on page 20).

Also mentioned is the possibility of combining a human rater’s score with both of the AI scores, and (more interestingly) the possibility of replacing human raters with GPT4.  But, as is mentioned by the authors, “In this case, the three tests are all high stakes and the evidence is too weak to support the use of these scores in operational score reporting unless they are used in combination with e-rater scores and/or human ratings.”  And furthermore:  “Based on the small sample sizes, the concordance with human ratings was borderline, especially for the TOEFL task. e-rater outperformed GPT4 for the three tests (GRE, TOEFL, Praxis). In these cases, without additional evidence we would retain the e-rater model.”

Effective immediately, if you want to register for the IELTS paper test in a country you must be a resident of that country.  Exceptions are granted for individuals from countries where the IELTS is not offered, and those with refugee status. Per this notice from IDP India, exceptions may be granted for those in free-movement zones (for instance, residents of an EU country may be able to take the test in any EU member state).

The computer delivered IELTS is not impacted by this.  People can travel the globe to take that version of the test.

Some have speculated that this move is a response to the oft-rumored “IELTS Field Trip” wherein students from a certain country quickly pile into a test center where security of the paper-delivered test has been compromised.  If that is the case, perhaps it is time to retire the paper-delivered test altogether.

Below is a message that pops up when attempting to register for the test via the British Council.  Check the link above for additional details.

This article by Daniel Lam and Angela Gayton is the best thing I’ve read all year. It explores gaps in knowledge about what test scores mean and how they can and ought to be used.

The authors interviewed personnel at a number of universities and illuminating excerpts are shared. I’d like to paste all of the quotes here, but I’ll limit myself to just a few.

Said one program director:

“If you say 6 and then somebody says 6.5, what is the actual difference, other than [that] 6.5 sounds a bit better, or higher, or more proficient if you like? […] So yeah, to me, it’s a fairly heuristic kind of process. People just come up with a number that’s either traditional that they’ve experienced or heard of before. ‘Oh, if this programme has this number, then maybe our programme should have this number.’”

And one EAP coordinator:

“I just find that sometimes it’s not consistent. So sometimes an IELTS 5 for one student, that student does not have the same standard or level of English as another one with an IELTS 5. So there are discrepancies, and I don’t know where that comes from – whether it comes from the assessor who assessed them, or there’s something in the guidelines that allows this sort of discrepancy.”

And:

“Sometimes the language level is not too bad, but because there is nothing behind, like in the thought processes, […] the student doesn’t perform well. And sometimes I think departments may mistake it for language inadequacy, but I don’t think it always is.”

A program director noted:

“I do think someone with a good IELTS score that comes here is a good user of English. But they may not be a good user of the particular type of discourse on which they will be assessed, which is a completely different matter. And I think this expectation or understanding is not there.”

One interviewee “laments” how an IELTS score can be used to make up for a failed assessment in a pre-sessional EAP program.

I could go on! The authors note that some of the comments “reflect the complexity of disentangling general language proficiency from academic literacy skills, and point to the need for a more nuanced understanding of this relationship, as well as, again, what language test scores are (un)able to indicate.”

In light of the recent “File on Four” report, there has been much discourse about how some students lack the language skills needed to excel in their studies. Much has been said about possible cheating. The folks behind IELTS seem to think that acceptance of a wider range of tests is problematic. But the issue is obviously more nuanced. All test scores are valuable, but they have certain shared limitations. Perhaps in 2025, when test prep is more sophisticated than ever and cool down periods between tests have been largely eliminated, yet more attention should be paid to the limitations.

Scroll down to the “discussion” section for tips that university staff should keep in mind.