Noble: Not so fast; facts are stubborn—why TTPS poll is unfortunate attempt at misdirection

The Mark Twain quote ‘facts are stubborn, statistics are flexible’ seemed appropriate last week, as the news about New York governor Andrew Cuomo’s misclassification of 9,000 Covid-19 deaths broke, shattering the carefully groomed image of his pandemic achievements as a national leader. 

Cuomo, ably assisted by his aides, sought to control the data and brush aside public health expertise. But facts are stubborn. They do not just disappear. 

Sound data helps to build strategy and reduce risks. It is essential for developing appropriate commercial and public policy. Unreliable data leads to disastrous decision making by decision-makers. Robust data is crucial to our nation’s success. 

It is commendable that the Police Service has re-introduced externally conducted surveys to direct their plans to create improved performance. As the MFO chair, I was invited to join a briefing session at the Police Service Administration Building. (I have institutional knowledge based on work done with former Commissioner Dwayne Gibbs.)

The briefing officer advised that MFO’s invitation was on the instructions of his superior. We, at MFO, recommended a comprehensive plan on 22 January, the agreed date. The fieldwork by the selected tenderer began the next day. We have no regrets since clients are free to do as they please.

I offer some comments on the recent TTPS survey, based on the aired portion of the press conference and newspaper publications. I hope that these comments will lead to a better appreciation of how proper research is done and evaluated. 

In response to a direct question about the identity of the study’s sponsor the researcher deflected, indicating that the study’s author was also the sponsor. That assertion was undermined within minutes of the press conference conclusion. 

Did she and the TTPS representative present not know the sponsor’s identity? Or did he choose to hide this? 

Self-sponsorship of a study is not inherently wrong, but the undeclared TTPS interest causes unwarranted scepticism about the research and the timing of the release. Why hide that fact when the entire press conference was designed to provide facts?

The researcher contended that the Central Statistical Office (CSO) provided both the sample framework and telephone numbers used to collect the data. A review of the reports’ demographics suggests that the sample was drawn mainly from social media sources, specifically Facebook. 

The sample is not representative of the CSO’s national population data. The TTPS officer unwittingly tipped off that it was not a genuinely representative sample by describing how the respondents came into the study.  

The significant variances between the reports’ demographic data and CSO’s population data reduce the results’ value without a correction of such differences (Dutwin and Buskirk, 2017). 

There was no explanation for this correction not being done even when pressed by a reporter. This lack of attempt to create a representative panel makes this poll no better than a scaled-up version of the unscientific TV6 People Meter. It is impossible to proclaim that ‘the people have spoken’.

The report took great pains to disclose that police officers did not participate in the study. Given the social media component (the participation level was undeclared), it was necessary to make a similar disclosure about any participation by the ‘I support Gary Griffith’ Facebook group, which numbers 73,000 fans. Their level of participation increases the risk of biased results. 

The alleged access to telephone numbers, if true, subverts the legislation that governs the CSO. That entity cannot provide such data. The CSO can make phone calls on behalf of researchers but cannot share their phone listings data. Shades of Cambridge Analytica? 

Research relies on public confidence in its integrity and the confidential treatment of the information provided for its success. Public cooperation depends on research being carried out honestly and objectively without the infringement of privacy.  

To assert that CSO gave the telephone numbers has the damning potential to undermine public confidence in both the CSO and the market research industry. 

Both presenters took great pains to suggest that both the TTPS and the police commissioner perform better than ever, via an overview of publicly and privately done polls. Never did they admit how the significant and limiting methodological differences between these studies would restrain such comparisons.

The harping about the margin of error for this study is a red herring. The margin of error tells the possible range of results if we did the same survey 100 times. But a purported national sample must represent the general population fairly. 

It does not matter how many persons you interviewed or what they said. If the respondents do not fairly represent the larger population, your results are likely to be inaccurate. Rolling the proverbial dice may be as good. 

The publication of this poll may have set back the work of our public opinion pollsters. Potentially, the professional reputations of the women working on the report are damaged. 

It is an unfortunate attempt to influence the public narrative about our policing performance. We will quote from this study at our peril. 

Editor’s Note: Market Facts & Opinions (2000) Ltd, established in 1985, has been doing online interviews since 2015. It is the only company with an in -house live call centre.

More from Wired868

Noble: Who will we put? Does T&T have competent, charismatic leader for these difficult times?

The next five years ahead for the country will be tough. What is terrible now has every chance of worsening: Read more

Dear Editor: We can’t arrest our way out of crime; T&T must pull at the roots

“[…] Arresting and imprisoning individuals removes them from society, preventing them from committing more crimes while incarcerated. But there are Read more

Noble: A man called ‘Bandy’; is T&T reaping whirlwind for alleged extrajudicial killing?

The “well-coordinated hit with pinpoint accuracy” that felled Randall Hector was entirely predictable. The roots of this current situation started Read more

Noble: Peering into 2025; T&T must be mindful of polycrisis

I am no prophet. I would not attempt to replicate the famous BC Pires, who used to write a column Read more

Noble: Different class, same struggle—why Farley’s house slave jibe jars

“[…] I’m a slave from a land so far/ I was caught/ And I was brought here from Africa…/ I’m Read more

Noble: Have we lost every drop of human kindness? Lisa Morris-Julian deserves better

“[…] I am saddened by those among us who cannot restrain ourselves from spewing bitter bile at this moment of Read more

Noble Philip

Noble Philip, a retired business executive, is trying to interpret Jesus’ relationships with the poor and rich among us. A Seeker, not a Saint.