Stop everything.  The annual audit of ETS is now available via the Federal Audit Clearinghouse!  This is my favorite day of the year.  The audit covers the year ending September 30, 2024.  Since there is no time to waste, here are a few highlights:

 

  1. Operating revenues are up 139 million dollars compared to 2023. They now total 1.16 billion dollars.

 

  1. Operating expenses are also up, resulting in an operating loss of 146 million dollars.  Last year, the operating loss was 84 million dollars.

 

  1. Net assets are 1.4 billion dollars, down about 88 million dollars from last year.

 

  1. Of the contract ETS once had with the College Board, the audit says:

 

“The Enterprise had a significant client under contract that ended on June 30, 2024. A contract was renewed with this same client on July 1, 2024, which expires June 30,  2029. Under the new contract, new terms were negotiated that resulted in a significant decrease in the level of services to be provided to this customer.”

 

        For the last full year of the contract, it accounted for 30% of ETS’s operating revenue.  We shall see the impact in next year’s audit.

 

  1. ETS spent 18 million dollars on advertising, down about 6 million dollars.

 

  1. ETS spent 530 million dollars to purchase PSI Services.  Wow.

 

  1. ETS spent 12 million dollars to acquire an unnamed thing in September of 2023.  That thing was Wheebox.

 

  1. The cost of this year’s employee buyout will come to 88.7 million dollars.  $49.5 million will be on the books this year, and 39.2 million dollars next year.

 

You can read the whole thing by searching the Federal Audit Clearinghouse. Let me know if you are unsure about how to do that.

According to reports out of Europe this evening, the Educational Testing Service has begun adding sales tax  (VAT) to the cost of taking the TOEFL iBT Test in the European Union.  This means higher bills for test takers – for instance, those taking the test in Germany will pay an additional $50.35, those in France an additional $54.00, and those in Sweden an additional $80.00.

Industry watchers* have speculated that the change could make the TOEFL iBT Test less attractive to students in the key European market.  This comes as the venerable American non-profit has increased efforts to widen its appeal and attract students heading to a broader range of study destinations.

*Just me, actually

In an interview with the Free Press Journal, ETS India head Sachin Jain noted that 90% of people who take the TOEFL opt to study in the USA.  According to Jain:

“Approximately 90% of TOEFL test takers choose to study in the United States, highlighting its status as the most sought-after destination for higher education. The remaining 10% diversify their academic paths by pursuing opportunities in other leading countries, including the United Kingdom, Canada, Australia, and Germany.”

The figure is a bit higher than I supposed it would be.  Perhaps efforts to crack the lucrative Canadian and Australian markets remain a work in progress.

With such a high percentage of test takers heading to the USA, the test could be at risk of losing market share to competing products that have gained more acceptance in that country in recent years.

It may be worth mentioning that while the USA is the most sought-after destination for higher education, it is only just barely so.  There were 1.1 million international students in the USA in 2023/24, compared to 1.04 million in Canada (2023) and 825,000 in Australia (2024).  For testing firms, appealing to students heading to a range of destinations is the key to financial success and security.

Beginning March 29, all IELTS tests in Vietnam will be delivered via computer. There will be no more paper tests.

Vietnam is a large market for IELTS, as the test is widely used in the admissions process for domestic universities.

I’m curious is this is a one-off development, or if it hints at a coming trend. Many test takers really prefer paper tests, but obviously they have some drawbacks in terms of cost, marking speed and security.

Note that the speaking test will still be delivered face-to-face or via an online platform.

If you are in New York from January 14 to 25 you can go see the Pulitzer Prize winning play “English” for free.  The folks behind the Duolingo English Test will pay for your tickets!

Set in Iran in 2008, the play tells the story of four students preparing to take the TOEFL test.  The action is set entirely within their classroom. It has a lot to say about how being understood (or not) can impact our well-being. “English” is a very touching work, but at times also very funny.

I’ve mentioned the play quite a few times in this space, starting in early 2022 when it debuted.  Sadly, I’ll be a continent away (as always) and won’t be able to claim my free seat… but I highly recommend that anyone with an interest in this sort of thing make the trip to Broadway.

Details here.

After I return from my holiday, I will probably take the Duolingo English Test. Let me know if there is anything I should keep an eye out for. I’ve taken this test in the past, but not since the secondary camera requirement was introduced. I’m curious to see how that feels. I haven’t experienced the latest round (several rounds?) of item revisions either.

I’d like to take the TOEFL Essentials Test. A few days ago I was caught flat footed when someone asked me to help them prep for it. And I fear that one day the test will disappear and I’ll miss my chance.

I’m curious about how Pearson does at-home testing.

Leave a comment if there are any other tests I should try to check out. In 2024, I took the following tests:

  • Password Plus
  • Skills for English SELT
  • TOEFL iBT
  • PTE Core
  • PTE Academic
  • EnglishScore (all 3)
  • MET
  • LANGUAGECERT Academic

Over on the LinkedIn (I know, I know), I saw a wonderful post by Peter Pham of PTE Magic which summarized a presentation given at the recent PTE Asia summit in Kuala Lumpur.  It mentioned that 63.5 percent of PTE test takers in Asia are women.  I think for tracking purposes, “Asia” refers to East Asia and Southeast Asia (and excludes South Asia).

Meanwhile, according to Google Analytics, 63.3% of global visitors  to my TOEFL-themed website in 2024 were women.

I generated a report summarizing the demographics of the most recent 39,187 website visitors of whom Google presumed a gender.  Interestingly, women visitors outnumbered men in 21 of the top 25 countries sending traffic to the site.

Below is a blurry screenshot of the data.  Only in the South Asian market (India, Pakistan, Bangladesh, Nepal) do men outnumber women.

A few more stray notes about the LANGUAGECERT Academic test before I move on.

(you can read my initial notes over here)

  1. The test really does feel like a somewhat modernized take on the IELTS Test.  A frequent complaint about the IELTS is that it hasn’t changed a lot since the 1990s. One gets the impression that the people behind the LanguageCert product set out to design something very much like the IELTS… but contemporary. Many of the items on this test are broadly similar to those on the IELTS, with small tweaks. Which is fascinating, as most test makers seeking to compete with the IELTS have gone in a wholly different direction. I wouldn’t be surprised to learn that LanguageCert is staffed by a lot of ex-IELTS folk.

 

  1. Again, I want to emphasize that being able to do a room scan with my phone was pure bliss. It sometimes seems that test makers are not aware of how frigging terrible room scans are. Most people take tests using a built-in laptop camera and must carry their machine around the room to complete a scan of the walls, of the ceiling, of under their desk, under the seat of their chair, inside their desk drawers, etc.  And this experience has only gotten more burdensome. I recently related a humorous story of how one test taker was required to open the door to their flat to show the public hallway and elevator to their proctor. I was once required to hoist my heavy office chair to chest level to give my proctor a peek at the bottom.  Since I am middle-aged and out of shape, that request left me with a sore lower back for the rest of the afternoon. Needless to say, all of this is easier to do with a phone than with a bulky laptop with peripherals dangling off of it.  I urge all test makers to consider implementing a “scan by phone” option. Even if you don’t think it is necessary to require the phone as a secondary camera while the test is in progress, you should consider implementing it as an option for room scans.

 

  1. There is so much Australian-accented English on this test that one would think it is a made-in-Australia test. Perhaps the folks at PeopleCert are making a play for visa acceptance in that country. Most tests include a few dudes that sound like Geoffrey Rush and leave it at that. That’s not the case here. The speakers are immediately identifiable as Australian.

 

  1. I’ve attached a screenshot to highlight the “NVIDIA Issue” I mentioned in my previous post.  Note the three NVIDIA applications that the test software detected. I hit “okay” multiple times with no effect. The software was not able to shut them down and no error message was displayed. I worked around this by shutting down the test software and manually disabling the NVIDIA junk… but by the end of the test, it was running again. I’ve been writing about this potential security issue since 2022. I am convinced that it is the cause of many “unauthorized software detected” cancellations of various test products.

 

  1. The second screenshot is from my account following the test. The UI is very nice.

 

Does anyone know what’s up with IDP IELTS China?  Students seeking to book an IELTS test in China are still seeing the “Registration system maintenance in progress” error that has been displayed for several weeks.  And, as far as I can tell, test dates for 2025 have never been open for booking.  That means, I guess, that no one is currently taking the test through IDP in China;  their entry into the market appears to be paused for the time being.

Some have suggested that this could be due to regulatory hurdles.  If that is the case, I imagine that a plan-B exists, and we’ll hear about it sometime in 2025.  As has been reported by a few outlets, IDP recently canceled its lucrative agreement to collect royalties on administrations of the test done by the British Council.  I’m certain they wouldn’t have given up that source of income without a firm plan to permanently enter the market.

With that said, it is worth noting that the launch of IDP IELTS in China has been somewhat peculiar.  It happened without much fanfare. It was mentioned in the most recent shareholder’s call and I blogged about it at that time. The PIE News picked up the story a bit later, and that was about it.  Most Chinese students only learned about the development after the Chinese blogosphere reported on the PIE’s report.

Students often ask how to download their TOEFL score report.  Just remember that you have to wait one or two extra days to download the PDF file of your score report.  That is, if you get your TOEFL scores on January 10, you have to wait until January 11 or January 12 to download the PDF.

Meanwhile, if you have already waited, here is how to get the score report:

  1.  Log in to your account on the ETS website.
  2.  Click “View your scores” 
  3. Click “Print/Download PDF Format.”

The screenshots show this:

 

More reports today about TOEFL scores being cancelled due to “inconsistent performance” (or what is referred to elsewhere as a “jagged profile”).  I’ve written about this here, here and here.  And many other places.  There seems to be an uptick in such reports at the moment.

This happens because the test taker did really well in the reading and listening sections, and very poorly in the speaking section.  In addition, they completed one of the sections very quickly.  Here’s what the email from ETS looks like:

Your TOEFL iBT® scores from your test on December 21, 2024 could not be reported.

ETS has conducted a review of your test, and there is substantial evidence that the scores are invalid. An analysis of your December 21, 2024 test showed the following:

  • Inconsistent performance on the operational Reading or Listening test sections, compared with your performance on the operational Speaking section of the test; ans
  • Inconsistent testing times, compared with your performance on one or more of the operational sections of the test

As you acknowledged when you registered for the test, ETS has the right to review the validity of test scores, and to cancel questionable scores when we believe there is substantial evidence that they are invalid. You can review these policies in the “ETS Score Cancellation Policies” section of the TOEFL iBT Information Bulletin.

If you have further questions concerning this matter, contact us at [TSReturns@ets.org](mailto:TSReturns@ets.org) or 1-609-406-5430 (option 6).

Sincerely, 
ETS Office of Testing Integrity   

What can you do in this case?  If you took the test in the USA you can request a free re-take or refund.  You can also appeal the cancellation.  If you took the test outside the USA you cannot do anything.  Your only option is to pay to take the test again.  Sorry.

This is one of the reasons why the TOEFL is declining in popularity.  If the cancellation really bothers you, it might be time to consider an alternate test, like millions of people around the world already have.

I just completed the LANGUAGECERT Academic Test (at home). A few notes while everything remains fresh in my mind:

  1. The setup process was smooth. The “Examshield” software used by LanguageCert is pretty slick. It took me about 20 minutes to complete the login process each time (once for the speaking test + once for the rest). This highlights the value of keeping the proctoring process in-house.
  2. A notable feature is the use of a mobile phone as a secondary camera during the test. For added security, the test taker logs into an app and points their phone at their keyboard during the test. Duolingo does the same thing. It was surprisingly simple.
  3. Also: I completed a room scan using my phone instead of by carrying my heavy laptop around. This is a gamechanger. It makes the whole process much more comfortable. Seriously: if anyone from Pearson or ETS is reading this, know that your test takers will love you for switching to this method. You may not realize how annoying room scans are. Institutions will appreciate the added security.
  4. I could log in with my Google credentials. Joy.
  5. It wasn’t all perfect, though. As noted earlier, I was required to use a headset with a built-in microphone. It had to be wired (not bluetooth). I could not use my laptop speakers or mic. I could not use my nice Bose headphones with an aux cable because they don’t have a visible mic. I could not use my cheap earbuds with an in-line mic. This necessitated a shopping trip. This requirement represents an added expense for test takers.
  6. And: the proctoring software wasn’t able to shut down my NVIDIA junk. I kept clicking the “okay” button to shut it down with no effect. I had to close the software and do that manually. Since this happens before the proctor comes online, some test takers will certainly get stuck here and fail to complete the test. I’ve actually written about how NVIDIA junk might be the cause of many test cancellations. It is worth further study.
  7. And also: the instructional PDF given to test takers is way too dense. No one needs to read a six-year changelog or about irrelevant runtimes and bootstrappers.
  8. Customer support interactions were pleasant and speedy. Top marks for that. The proctors were polite and almost bubbly. Both aspects suggest that LanguageCert is actively studying what their competitors are doing wrong.
  9. The speaking test is carried out by a live interviewer, and is graded both by that person and by someone who later watches a video. This will appeal to people who worry about bias.
  10. I like that the “describe the chart” writing task is completed as a “report.” It can be clunky completing the similar IELTS task as a prose summary.
  11. One gets the impression that this test is meant to be like IELTS, but without the things that bother some test takers.
  12. Included were a great range of UK accents, many Australian-accented speakers and one lonely American.
  13. This is not a particularly easy test.

(you can read my second post on this topic over here)

In a recent interview with the Free Press Journal, ETS India head Sachin Jain said that ETS aims to provide TOEFL score reports in just 2 days.  That’s good news for test takers.  A typical TOEFL test taker in India is someone who is also planning to take the GRE. Consequently, the TOEFL sometimes gets shunted aside and left to the last minute.  This sort of test taker will appreciate faster results quite a lot. It will also be good for business, as the other tests in this category have provided two-day results for quite some time.

Jain also mentioned that sometime in Q1 of 2025, ETS India will start providing a free “intermediate guide to the TOEFL” to test takers.  That’s also good news.  I really like the beginner’s guide which is currently provided… but as I noted in my review it is a somewhat skimpy offering compared to what people taking the IELTS in India currently receive at no cost.