Alex Steer

Better communication through data / about / archive

Guardian fails on Sats reporting

533 words | ~3 min

The Guardian has been getting itself into a muddle over its reporting of the Sats results.

At 11.49 this morning it published a version of its story to the RSS feed on its website which contained the following lines:

Of the 600,000 pupils who took the tests, 72% did not reach level 4, compared to 71% last year. This means they cannot add, subtract, multiply or divide in their heads, or write extended sentences using commas.

An hour or so later, when I checked the website itself, this had been amended (my emphasis):

Of the 600,000 pupils who took the tests, 72% reached level 4, compared to 73% last year. This means they cannot add, subtract, multiply or divide in their heads, or write extended sentences using commas.

First of all, this obviously makes no sense as a sentence now. The 72% are the ones who can add, substract, etc.

Second, given that the whole thrust of the piece is about declining standards in schools and possible marking inaccuracies, the lack of attention to detail here is striking. Guardian, check your stats and sort it out before you publish next time, not after.

This is not the only problem with this article, though. Take a look at the results and you'll see that these changes are pretty minimal: no change in maths and science, and a 1% drop in children achieving Level 4 in English, reading and writing. This is not good news, obviously, but neither is it an educational catastrophe.

The Guardian, post-correction, states the figures accurately, but uses an inconsistent style of description to make them sound as bad as possible. For example:

More than a quarter of 11-year-olds in England failed to achieve the standard expected of them in their English and maths Sats.

Given that this standard (Level 4) is what is expected of 'a typical 11 year-old' (source), it's not surprising that around a quarter are below it. More than a quarter are also above it: Level 5 achievement - in other words, 11 year-olds attaining the level of a typical 13 year-old - ranged from 19% in writing to 47% in reading.

Try this...

The statistics from the Department for Children, Schools and Families showed boys were falling far behind in writing. Four out of 10 boys did not reach the level expected of them, while 75% of girls did.

Using a negative natural frequency for boys ('four out of 10 boys did not') and a positive percentage for girls ('75% of girls did') is unfair, as the eye and mind gravitate towards the 'four' and the 'seven(ty)'. In fact the attainment difference is 15% - again, clearly a problem, though this is by far the largest differential.

For cherry-picking worst cases and wording them as direly as possible, not just for the shoddy and unmarked correction of published material, this article fails to achieve the standard expected for education journalism.

# Alex Steer (04/08/2009)


Bad news: your dictionaries are worthless

120 words | ~1 min

Chris Anderson, editor of Wired, in an interview with Der Spiegel:

I don't use the word journalism.

Then...

Sorry, I don't use the word media. I don't use the word news. I don't think that those words mean anything anymore.

Followed shortly by...

There are no other words. We're in one of those strange eras where the words of the last century don't have meaning.

Fortunately, the word 'pretentious' seems to have clawed its way into the 21st century for precisely this purpose.

# Alex Steer (31/07/2009)


Fair access to the professions

902 words | ~5 min

The Panel on Fair Access to the Professions has released its final report, Unleashing Aspiration. One of its central arguments (which, alarmingly, seems to have been in place since before the panel was set up), is that 'social mobility into professional careers has slowed', and that 'if action is not taken to reverse historical trends, tomorrow's generation of professionals will today grow up in families that are better off than seven in ten of all families in the UK'. These arguments, and the evidence behind them, are laid out in Chapter 1 of the report. However, some of the reasoning is distinctly questionable.

To start with, the definition of a profession seems purpose-built to exclude those which are less exclusive, and thus lend weight to the central argument. The list of example professions given reads:

‘Life science’ professionals, such as doctors, dentists, nurses and vets; Legal professionals, such as judges, barristers, solicitors, paralegals and court officials; Management and business service professionals, such as accountants, bankers, management consultants and business and finance advisers; ‘Creative industry’ professionals, such as journalists, publishers, designers, writers and artists; Public service professionals, such as senior civil servants, managers in local government, armed forces officers and senior police officers; Scientists, such as archaeologists, chemists, mathematicians and physicists; Education professionals, such as professors, lecturers, teachers and early-years specialists; and Built environment professionals, such as architects, engineers, surveyors, town planners, urban designers and construction specialists.

With the exception of 'construction specialists' (slightly vague), there is no mention of what used to be called trades: the builders, fitters, bricklayers, plumbers, electricians, stonemasons, thatchers and the like whose occupations all fit the report's criteria of having recognisable entry points, codes of ethics, systems for self-regulation and a professional development. From a government that so trumpets its investment in apprenticeships and training, this seems a curious omission.

The following figure is used to make the claim that 'the UK is a world leader when it comes to knowledge-based services':

Fair Access - country comparison, knowledge-based services

Though this suggests that the UK needs a better spread away from knowledge-based services, which a quick analysis of our economic situation would tell you anyway. (The definition of a 'knowledge-based service' is hazy too - it's not clear whether, for example, doctors count as knowledge workers.)

The report also rolls out a variant on the usual inaccurate story about declining social mobility (see my link above). Writing that 'there is some recent evidence that the UK may have reached the bottom of a long-running decline in social mobility', the authors of the report make the common mistake of treating measures of intergenerational mobility from previous longitudinal studies as points on a line rather than discrete snapshots, and of assuming a continued downward trend which is not necessarily correct (and which, given the length of time it takes to gather evidence, we won't be able to see for years yet). This does not detract from the analysis which suggests that social immobility remains a problem.

This chart is also telling:

Fair Access - social mobility index UK 1958 vs 1970

The analysis on this is incredible. This is presented as evidence of 'growing social exclusivity' among the professions, and four reasons are given for the trend.

  1. 'Opportunity hoarding' (i.e. elitism) by professions;
  2. 'Qualification inflation' as more professions require higher qualifications
  3. Lack of movement from vocational training into professions
  4. Concentration of professional jobs in London and the South East

The most striking insight from recent comparison studies on social mobility is completely omitted. This is that there is a strong link between parental income and educational attainment.

This insight is the killer. Bear it in mind, and the over-representation of the children of rich families in professions requiring high-level qualifications is thrown into a different light. Rich kids, in short, do better at school, get to better universities, and get into better jobs. The higher average educational attainment of rich kids also explains, in large part, the strong intergenerational income correlation: rich parents are most likely to have kids that end up rich, and the education system is a significant vector by which wealth is passed on. And looking at the chart above, it's no surprise that the professions that hire the most rich kids are the ones with high salaries: law, medicine, finance and accounting. (Journalism is a fascinating anomaly that says a lot about the changing role and perceived power of broadcasters.)

Seen through the lens of this insight, the big story about mean elitist professionals pulling up the drawbridge to keep the insiders in and the outsiders out looks pretty insignificant. This chart, though, takes on a whole new significance:

Fair Access - social mobility by professional group

It tells the story of a generation of children from rich parents who have been sent to independent schools, where they have received an education far better geared to helping them achieve high qualifications and professional jobs than the education received by their peers who were reliant on state provision. Without really meaning to, this report damns a generation of state educational policy and exposes its role in hindering access to the professions.

# Alex Steer (23/07/2009)


Weak signals about mobile technology

529 words | ~3 min

The eMarketer website has published the findings of a study it commissioned from Lightspeed Research on mobile phone use in the US, UK, France and Germany.

For the UK, it's no surprise that texting and voice calls are the most common types of use (82% and 75% at least once a week, respectively), though as eMarketing points out the figure of 22% that browse the internet weekly is a surprise. This seems to me to reflect a change in thinking about what mobile devices are for that has been going on for a few years now, and is most clearly seen in convergent devices like the iPhone and Blackberry.

What's really striking, and not given much comment by eMarketing, is the result for features that US mobile users would like to have on their phones, reproduced here.

eMarketer mobile survey 2009 - desired features

Taken on their own, these responses are fairly interesting and provide fairly strong signals about what might come next in mobile: expect to see more devices with satellite navigation and similar GPS tools hitting the market soon, for example. But taken together, I think they reveal something more subtle about how mobile use might change over the next few years.

Several of these responses reimagine mobile devices as tools that transform the relationship between people and the spaces they inhabit. Satellite navigation is the strongest manifestation of this: it tells you where you are and helps you get where you need to be. In doing so it maps data on the real world you inhabit, turning information about distances and directions into instructions that centre on you: turn left, turn right, in 20 yards, stop. But sat nav is just the most obvious version of an idea of mobile devices as things that connect people to the world, and not just in the old-fashioned sense of being able to speak to one another. A mobile device that can locate people and monitor systems remotely is as much a translation device as a communication device, helping people to understand and transcend the physical spaces within which they exist, and to overlay otherwise-invisible layers of data onto the here and now.

It's hard to describe these emerging phenomena without sounding either too technical (talking about embedded sensor architectures) or too mystical (riffing about the demon-haunted world of the internet of things). But it's because these things are at the edge of mainstream understanding that they're worth thinking about. This survey, along with the appearance of the first few augmented reality applications, seems to hint that a new way of thinking about mobile is starting to creep into public consciousness.

# Alex Steer (21/07/2009)


If you are dead, press 1

535 words | ~3 min

The National Pandemic Flu Service is due to be launched this week. Essentially it's a phone line and website which tells people if they have swine flu and, if they do, directs them to treatment.

Apparently having one phone line that you can call to ask questions about your health, as well as a nationwide primary care system, isn't enough, and we need something else as well. I especially love the indignant tone from the Lib Dems' health spokesman, Norman Lamb, complaining about the 'additional burden' on GPs of 'a large number of calls', as if he can't believe that people are so stupid as to be phoning up their GPs when they feel ill. I mean, next they'll be onto the police just because they've been stabbed.

In amid all this urgency around public health, there are surely a couple of important points about good communication. The first is that innovation should strengthen brands, not detract from them. How will the NPFS relate to NHS Direct, the online and phone-based health advice service that already exists? Unless some good reasons are given, it will seem very much like NHS Direct is a brand that's fine for cases of man-flu, sniffles and sprained thumbs, but incapable of coping whenever the pathogens hit the fan. Once the NPFS folds, the lingering perception of the NHS Direct as a sort of telephonic mecca for timewasters will do it no good and may discourage people from using it.

The second point is that communication needs to be consistent and coordinated. Not in the sense of endless messages pushed out on every channel, but in the sense that if, at any given time, I want to know what I should do if I feel ill, I should be able to find out quite straightforwardly. Better yet, I should already know. There is already too little clarity about the respective roles of NHS Direct and GPs. Which should I go to if I think I've twisted my ankle? When the NPFS arrives, if I think I have flu-like symptoms, which of three ports of call do I choose? If I don't know by the time I fall ill, someone has failed.

Coca-Cola, which basically sells sweet brown fizzy water, is great at differentiating its brands. Everybody knows the difference between Coca-Cola, Diet Coke and Coke Zero - why the three exist, whom they're targeted at, and what their branding looks and feels like. If they feel the need to put so much effort in to sell three strains of almost identical liquid in tins, surely the imperative is far stronger when it comes to giving people advice and treatment which could save their lives.

Posted via email from Common Parlance

# Alex Steer (20/07/2009)


Pret makes things out of people

847 words | ~4 min

Image lost in database transfer - sorry!

I couldn't resist that subject line, but there's a point to it.

The blurred, grainy photo in this post (taken with my slightly ropy phone camera) is of a customer comments card I found this weekend in the Cambridge branch of Pret, the sandwich shop. The card reads:

My name is Marcus. I'm the Manager at this Pret shop.
My team and I meet every morning.
We discuss the comments you've made, the good, the bad and the ugly. If we can deal with it ourselves, we will.
If we can't, I'll forward this card to Julian Metcalfe back at the office. I know he'll do what he can.
If you have a minute, please do ask to speak to me or one of my team right now.

The space for comments is on the back.

For all its simplicity, this is the best feedback form I've seen in ages. It wins for a number of reasons. The first is the design, for doing what any personalised marketing object should do now that printing is cheap, quick and easy, and refusing to make the names of the branch owner and (I presume) local area manager look like afterthoughts. Pret is an international brand, but just by printing different cards for each of its outlets it gives itself a local feel. Imagine how much worse it would look (my photography notwithstanding) if the names had been written in over a dotted line.

But the design is just part of the achievement. Most of the work is done by the tone. The use of the first person is something I haven't seen before on a card like this, at least not without an accompanying cheesy picture of some branch manager wearing an 'I care' smile. The is polite but informal (see the use of contracted forms - I'm, you've, I'll, he'll - as well as idiomatic expressions - the good, the bad and the ugly; deal with it; do what he can - and the obligatory dummy verb in please do ask). As readers we can tell that this feels more like informal talk than legally and formally precise 'business speak'. As I've discussed previously, analysing sociolinguistic tone - saying what makes a piece of language sound informal or businesslike - is harder than it seems, and relies on the aggregation of lots of small items of usage, or their absence. (Note the total lack of professional jargon here - the closest we get are the words 'manager' and 'team', not very close at all.)

The effect is to transform the card into the speaking voice of the branch manager, and to make the manager sound approachable. Given that comment cards are essentially a way of making sure that branch managers can avoid speaking to customers while still letting those customers feel they've had their say, this is a neat conjuring trick. These days, we know that comment cards, like automated phone lines, are barriers between companies and their customers. This card does not feel like that, partly because of the tone, and partly because it is less like a wall and more like a window into the daily operations of the Cambridge branch of Pret.

Finally, rather than being an instruction to take a number and join the queue, the card actually invites customers to disrupt the entire purpose of the comment-card system: 'please do ask to speak to me or one of my team right now'. The emphasis is even put on the customer's convenience: 'If you have a minute'. This card invites its reader to see that Pret is made out of people, not just business functions, but it also acknowledges that the reader is not part of that system, and so offers different ways of getting a message through and being heard.

Posted via email from Common Parlance

# Alex Steer (20/07/2009)


If it contains numbers, it must be an insight

144 words | ~1 min

Looking for crime statistics the other day, I came across an article from the Evening Standard in 2007, whose headline told me:

Average age of murdered teenagers is just 16

Given that we're talking about people who aged between 13 and 19, you wonder what the authors of the piece thought their average age might be.

And, as if to labour the point, we later find out...

The ages of those charged in connection with the killings range from 13 to 22, with the average being 17.

Which is, of course, similarly useful maths. And far easier than, say, taking an mean or median of the household incomes of the perpetrators or victims, or their average number of prior contacts with the police, and using those numbers to start digging for stories more insightful than the 'inexplicable teen knife madness' headlines that drowned out everything else a couple of years ago

# Alex Steer (17/07/2009)


A license to teach is not empowering

178 words | ~1 min

Ed Balls's white paper, Your Child, Your Schools, Our Future, published today, contains the breathtaking proposal that teachers should have licences to practice which would need to be renewed every five years.

Incredibly, the general secretary of the NASUWT seems to support this. From the BBC report:

The general secretary of the NASUWT teaching union, Chris Keates, said licensing could give qualified teacher status "the long overdue recognition that it is a high status qualification" like those in medicine and law.

No it doesn't. It sends a message that teachers are like bankers: probably inefficient, possibly incompetent, and in need of more government regulation.

When the Children's Secretary says that 'it may be that we will discover some teachers who do not make the grade and some who aren't re-licensed', teachers can be forgiven for not feeling that this licensing proposal is being handed down in recognition of their achievements.

# Alex Steer (30/06/2009)


Looking for examples of language use trends

214 words | ~1 min

Hello internet, I'd like your advice.

I am looking for analyses and examples from anywhere in the world of shifts in language use patterns and language policy for a project I'm working on.

These might include information on language loss and endangerment, language protection schemes, language rights issues, language and ethnicity, globalisation of languages, emergence of distinctive regional standards (e.g. Chinglish, Singlish), changing official attitudes to multilingualism, conflicts over choice of language, etc. I'm also keen to see any good papers on theoretical issues in the branches of sociolinguistics that deal with language choice, language cultures and language policy. For this piece of work I'm interested in language use in the very broad and traditional sense - i.e. which languages people use to communicate. Information on morphological, lexical or syntactic change, sociolect or dialect, and similar are not really of interest for this (though always interesting in themselves).

If you've got anything, from a journal article to a newspaper item or blog post, please send it by email to alex@cantab.net, or via Twitter or Delicious to @alexsteer, or leave a comment on this post.

If you know any other language geeks, pass this on.

Thank you!

# Alex Steer (30/06/2009)


Just because you read it on a blog doesn't mean it's not rubbish

876 words | ~4 min

Dave Trott at CST Advertising thinks he knows about the origins of on one's tod, meaning on one's own. What he shows with his post is that a) he doesn't, and b) he cares more about winning arguments than being right.

In fairness, that's his point. The blog's argument, which is ultimately about advertising, is that in an ad pitch 'whoever wins makes the best argument', and that 'all that wins is the best argument, not necessarily the best ad'. This is probably true, and he concludes quite neatly:

Think of that next time you’re on an awards jury, or with a client, or an account man or planner, or even your creative partner. Someone might be better at arguing. They might win the argument. But they might still come up with the wrong answer.

Which is fine. But the example he uses to get to the end of this lesson is extraordinary.

Now, everyone's allowed a crazy theory or two about the origins of words. Many of us do it, and we may not be that interested to know whether or not the word 'posh' really comes from 'port out, starboard home' (it doesn't). But hopefully most of us, when confronted with the facts, actually do the decent thing and say, 'Okay. It was a fun theory, but it was wrong. Game over.'

This is where Dave Trott falls down. His pet theory is that on one's tod comes from the name of Mike Todd, the Hollywood producer whom Elizabeth Taylor married in 1957. In fairness, he thinks he has evidence. Here it is:

[Todd] wanted to make the film “Around The World In Eighty Days” starring David Niven. It cost an absolute fortune and he couldn’t get any backing. At the time it was a famous story, how he scraped, and did whatever it took, to finance the film. Against the odds he got it made, and it was a huge success. In those days the biggest TV programme was “Sunday Night At The London Palladium”. The host at this particular time was Norman Vaughan. He used to do a brief monologue at the beginning of the show. One Sunday night he was grumbling that he’d had no help that evening. “I’ve had to do everything on my Mike Todd” he said. It got a huge laugh. Because everyone knew what he meant without saying it. The phrase “on your Mike Todd” caught on. Soon it got shortened to “on your Todd” and eventually “on your tod”. And it passed into the language.

Which is not a bad theory. So far, so good.

Except that the OED cites examples of on one's tod back as far as 1934. 22 years before the film was made. When Elizabeth Taylor was 2.

The OED also gives some of the evidence for the apparent origin of the term. It's rhyming slang for 'Tod Sloan', a once famous but now forgotten early 20th century American jockey who died in 1933 (at around the time the slang term seems to have been coined). A good account is given by the lexicographer Michael Quinion here.

This should really be the point at which you roll over and accept the evidence. However, Dave Trott has decided that, since it doesn't fit his theory, the evidence is wrong, and so are the people who have found it.

All you have to do is look it up in any of the various books on cockney rhyming slang. There are several in Foyles. All written by 30-ish middle class university graduates. All of whom are experts in the derivation of cockney rhyming slang. So to them, all slang must be rhyming slang. [...] So they’ll tell you that ‘on your tod’ is believed to refer to a certain Todd Sloan, a man famous in the east end of London for riding around everyday, alone on his horse. He liked to be alone. Hence ‘todd sloan’ = alone. Except that’s bollocks. These people assume that all slang is derived from rhyming slang because that’s their preconception. So they make the evidence fit their preconception.

No, Dave. First off, your description of Tod Sloan is wrong. See the link above. Second, the people who write dictionaries, middle-class though they might be, are people who earn their livings and spend their lives sifting through the evidence for where words come from and trying to get it right. Some dictionaries are more rigorous than others, but that's the general principle. What they don't do is make up any old nonsense, then go on the offensive when it turns out they're wrong.

So maybe in advertising 'all that wins is the best argument'. But not in lexicography. In lexicography, you actually have to be right.

Game over.

# Alex Steer (25/06/2009)