Month: September 2024

Review: TOEFL iBT Official Beginner’s Guide

Posted on by TOEFL Resources

My friends at ETS India sent me a copy of the new “TOEFL iBT Official Beginner’s Guide.”  A hard copy of this book is now sent free of charge to people who register for the TOEFL in India.  ETS’s current “get a free book” promise seems to be a unique quirk of the super-competitive Indian market – IELTS registrants in that country have been entitled to a free book for as long as I can remember.

I’m happy to report that most people will find the beginner’s guide really useful.  The first ten pages describe the format, content and scoring of the test.  The rest consists of a complete (and accurate) practice test, followed by sample speaking and writing responses.  I’m VERY happy to report that the test will be totally new to most TOEFL test takers.  This is not one of the tests from the Quick Prep collection, the PDF sets, or the TestReady page! It’s new! And there is so much unmet demand for new and accurate practice tests.  That said, a few experts may recognize it as one of the tests currently licensed to New Oriental for use in their schools in China (test #50, I think).

It must be noted that about 50% of the book is made up of blank pages for note taking.  This means that a second complete test could be easily added without increasing the cost of printing or mailing the book.  Indeed, it is likely that with some creative thinking a third complete test could be added without increasing the page count. Perhaps this should be considered. Have I mentioned the unmet demand for accurate practice tests? Note that the free IELTS book contains four tests.

As an aside: if the so-called “New Oriental Tests” are now cleared for use outside of China… well, I can think of a few good uses for them.

I took the EnglishScore WRITING Test

Posted on by TOEFL Resources

A few days ago I completed the writing component of the British Council’s EnglishScore Test. I unlocked this component by first completing the EnglishScore “Core Skills” Test. You can read my thoughts on that test in an earlier post. This is a mobile-only test which takes 30-40 minutes to complete.

As I noted in that post, the EnglishScore Test is used by individuals seeking to increase their employability, as well as institutions. The test is free, but an official digital certificate can be purchased for $24.99. Below find my own certificate, which includes derpy photos taken while I completed the test (a security feature).

A few notes:

  1. The content of the writing test is determined by the test taker’s score on the core skills test.  According to the test’s validity report, test takers are placed into one of three streams based on those results. The stream affects the difficulty and nature of the questions they get.

 

  1. A mobile-only writing test is a bold proposition. Some might find it awkward to write 70-word responses on a phone. Needless to say, auto-complete and spelling suggestions are turned off. Test takers should probably practice this skill.

 

  1. There are four types of tasks on the writing test: write what you hear, respond to a question, describe a picture, have a chat.

 

  1. Instructions can sometimes be a bit clumsy. At the beginning of the short answer section I was told to write as much as I could. When the questions themselves appeared, I was told to write between 50 and 70 words. When I exceeded 100 words, the word counter turned red and I lost the ability to manually submit my answer. I let time run out without deleting anything, and I suppose my answer was submitted.

 

  1. My approach to tutoring would probably focus on achieving grammatical perfection (or as close as possible). On top of that, I would remind students to show off a bit of grammatical sophistication (probably through the use of coordinating and subordinating conjunctions) and squeeze in a few uncommon words.

 

  1. Results arrived in less than 24 hours. I’m not sure of the exact amount of time, because I didn’t get a notification. Perhaps one should be added. My certificate was available a couple hours after I requested it.

 

  1. In addition to an overall score, the certificate includes subscores: language, organization and communication.

 

  1. Most of the scoring is done by AI. Some of the scoring is done via peer review. I think this approach is innovative, but some could feel otherwise.  Details are provided in the test’s validity document (I’ll link to this in the comments). At least 16 different peers (other test takers) assess the responses of a given test taker. I think I assessed 20 at the end of my test.

 

  1. A printed certificate is not available for the writing test. Only a digital version is available.

 

  1. There are quite a few practice questions and responses on the EnglishScore website.

 

I’ll take the speaking component when I have a moment.

 

More on Potential SELT Changes

Posted on by TOEFL Resources

The PIE just published a useful summary of the ownership structure of the IELTS test.  It can sometimes be tricky to wrap one’s head around the ownership of the test, which is shared, equally, between Cambridge English, the British Council (both non-profit organizations) and IDP Education (an Australian for-profit).  Making things even trickier is the fact that the latter two parties compete with each other to deliver the test in some (but not all) markets. One might predict friction between these parties, but they seem to get along pretty well.

As the PIE points out, the British Council may be “the logical choice” to develop the new English test that the Home Office has put out a tender for. This makes sense considering their worldwide network of testing centers, and IELTS’s current status as a market leader.  But since Cambridge is responsible for the design, development and validity research of IELTS test items, perhaps a more likely front-runner is a new partnership between that organization and the British Council. Note also that the tender seems to invite separate bids for the development and delivery of the test, but how that would work in reality isn’t immediately clear.

That said, a question that comes to mind is whether an IELTS-ish test is even desirable. Is it safe to assume that this is what the Home Office is seeking?

Here’s a bit from a review of the IELTS by John Read published in Language Testing back in 2022:

“As its recent history shows, IELTS has been successful in incorporating technical innovations in the delivery of the test and in a whole range of back-office functions that support the industrial scale of its operations. However, in its adherence to design principles dating from the 1980s, it has proven resistant to any fundamental re-thinking of the construct of academic language proficiency in the light of current concerns in the field, such as the renewed focus on integrated tasks, the importance of assessing interactional competence, the value of diagnostic feedback, and the diversity of academic literacies. Although there are numerous IELTS-funded studies by external researchers suggesting ways in which [the] test could be enhanced, there is no sign of an integrated programme of renewal of the test.”

Keep in mind that the review isn’t all bad. But needless to say, a test like the IELTS has pros and cons.

If the Home Office is seeking a more modern approach to testing, perhaps there is an opportunity for a firm already known for producing such products.  That’s a big “if,” of course, but it is worth considering.

Major SELT Changes Coming?

Posted on by TOEFL Resources

Shocking news out of the UK this morning.  The PIE is reporting that the UK Home Office is reconsidering how it handles Secure English Language Testing .  Rather than accepting results from a handful of approved tests, the Home Office is considering instead a single test, owned by the Home Office and designed by one supplier.   Says the PIE:

“The government appears to be planning to move away from the current concession model based on multiple Home Office-approved suppliers, to a dedicated test owned by the Home Office and designed by one supplier.

The service, carrying an estimated contract value of £1.13 billion, will cover the development and ongoing support of a Home Office branded test to be used globally for all HOELTs, and the facilitation of tests around the world.”

Read the whole tender here.

As most readers know, SELT-approved tests are those tests which are approved by the Home Office for visa and citizenship purposes.  They are delivered at test centers that meet the strict security requirements set by the Home Office.  Testing providers must also meet certain post-test requirements.  SELT-status is highly valued in the testing industry.

Within the UK, these tests are currently delivered by the IELTS partnership, Pearson, Trinity College and LanguageCert.  Outside of the UK, tests are delivered by the IELTS partnership, LanguageCert, Pearson and PSI.

The aforementioned change would represent a seismic shift in the language testing world.

A few thoughts and questions come to mind:

  1. It takes a very long time to develop a test.  Many years of research and development are required.  Would a Home Office-owned test end up being a variation of an existing test?
  2. Aside from the above-mentioned organizations, who might be capable of bidding for this tender?  Keep in mind that PSI is a subsidiary of ETS. 
  3. I would like to know more about the financial implications of this change.  How impacted would some of the major testing firms be by the loss of SELT business?  Perhaps some representatives of those firms will chime in. 
  4. Perhaps someone who follows the industry more closely than I do might wager a guess at how likely it is that the Home Office will actually go in this direction.  Obviously it is not set in stone. 
  5. If this change is implemented, will other governments follow suit? 
  6. Regular readers of this space know that I value competition. I feel that testing monopolies can sometimes be bad for test takers.  This change could reduce competition in the testing space. 
  7. I also value accessibility.  Accessibility is impacted by the number of approved test centers available to test takers, and how close they are. This change could reduce the number of test centers available to test takers.

I’ll post more news as it becomes available, obviously.A big thank-you goes to Polly Nash for digging this story up. Apparently the tender was put out during the holiday and went unnoticed by all but her.

I Took the EnglishScore Test from British Council

Posted on by TOEFL Resources

A few days ago, I took the British Council‘s EnglishScore Test.  This one is a mobile-only English test.  It is used by institutions for placement purposes and by individuals who need a certified English score for some purpose.  I suppose it operates in the same space as the TOEIC, TOEFL iTP (ETS), Upskill (Cambridge) and Versant (Pearson) tests.  I’m so happy that this space has become more crowded in recent years. Competition is vital.

Below, check out my official certificate.

Keep in mind that EnglishScore actually consists of three separate tests: the core skills test, the writing test and the speaking test.  The writing and speaking tests are unlocked after you earn an A2 or above result on the core skills test.  Each test takes about 30-40 minutes to complete.  I’ll take the writing and speaking tests in the weeks ahead.

A few thing are worth noting here:

  1. Yeah, this one is mobile-only.  The only other major test of this type I can think of is Cambridge’s Upskill test. That said, this one is much bigger: EnglishScore has 10 million downloads on the Google Play Store, while the Upskill test has about half a million.

 

  1. The test taker completes a room scan before beginning, and photos are taken throughout the test and appended to the official certificate.  If test makers can get institutions to trust their security features, mobile tests are a great way to increase access and reduce costs. I think we’ll see more tests like this in the future (especially for lower-stakes uses).

 

  1. Everyone can take the test (and get a score) for free.  An official digital certificate costs $24.99.  A printed certificate (couriered to your door) costs $49.99.  Since printed certificates are still big in my neck of the woods I’m curious about the printed version, but I don’t want to pay for it.

 

  1. Account creation can be done via Google, and the whole setup process and security check can be done in minutes.  How nice.

 

  1. The core skills test is a multiple-choice affair, so it is the easiest to deliver via mobile.  And the easiest to score.  I have no complaints about the delivery, which was very smooth.  I’ll raise some issues when talking about the W and S tests.  But this one is completely painless.

 

  1. If you are helping someone prepare for the test, ensure that they go through the test guide beforehand.  Make sure they know how the timers work, as it isn’t always clear in the UI.  Note, also, that the reading test includes quite a few “pick the best title for this passage” questions, which can be tricky for people who haven’t encountered that sort of thing in the past.

 

  1. The grammar section seems to go heavy on questions about verb tenses.  A keen teacher could probably build a study guide using Murphy’s “English Grammar in Use.”

 

  1. Results max out at C1.

 

  1. Attached are both pages of my certificate.  Note the derpy photos on the second page, which were taken while I was completing the test.  The certificate was available a few hours after I completed the test.

 

  1. BC’s private sector partner on this one is Blenheim Chalcot.