corner
Healthy Skepticism
Join us to help reduce harm from misleading health information.
Increase font size   Decrease font size   Print-friendly view   Print
Register Log in

Healthy Skepticism Library item: 20588

Warning: This library includes all items relevant to health product marketing that we are aware of regardless of quality. Often we do not agree with all or part of the contents.

 

Publication type: Journal Article

Bertens LCM, Broekhuizen BDL, Naaktgeboren CA, Rutten FH, Hoes AW, van Mourik Y, Moons KGM, Reitsma JB
Use of Expert Panels to Define the Reference Standard in Diagnostic Research: A Systematic Review of Published Methods and Reporting
PLoS Med 2013 Oct 15; 10:(10):
http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.1001531


Abstract:

Background

In diagnostic studies, a single and error-free test that can be used as the reference (gold) standard often does not exist. One solution is the use of panel diagnosis, i.e., a group of experts who assess the results from multiple tests to reach a final diagnosis in each patient. Although panel diagnosis, also known as consensus or expert diagnosis, is frequently used as the reference standard, guidance on preferred methodology is lacking. The aim of this study is to provide an overview of methods used in panel diagnoses and to provide initial guidance on the use and reporting of panel diagnosis as reference standard.

Methods and Findings

PubMed was systematically searched for diagnostic studies applying a panel diagnosis as reference standard published up to May 31, 2012. We included diagnostic studies in which the final diagnosis was made by two or more persons based on results from multiple tests. General study characteristics and details of panel methodology were extracted. Eighty-one studies were included, of which most reported on psychiatry (37%) and cardiovascular (21%) diseases. Data extraction was hampered by incomplete reporting; one or more pieces of critical information about panel reference standard methodology was missing in 83% of studies. In most studies (75%), the panel consisted of three or fewer members. Panel members were blinded to the results of the index test results in 31% of studies. Reproducibility of the decision process was assessed in 17 (21%) studies. Reported details on panel constitution, information for diagnosis and methods of decision making varied considerably between studies.

Conclusions

Methods of panel diagnosis varied substantially across studies and many aspects of the procedure were either unclear or not reported. On the basis of our review, we identified areas for improvement and developed a checklist and flow chart for initial guidance for researchers conducting and reporting of studies involving panel diagnosis.

 

  Healthy Skepticism on RSS   Healthy Skepticism on Facebook   Healthy Skepticism on Twitter

Please
Click to Register

(read more)

then
Click to Log in
for free access to more features of this website.

Forgot your username or password?

You are invited to
apply for membership
of Healthy Skepticism,
if you support our aims.

Pay a subscription

Support our work with a donation

Buy Healthy Skepticism T Shirts


If there is something you don't like, please tell us. If you like our work, please tell others.

Email a Friend








Far too large a section of the treatment of disease is to-day controlled by the big manufacturing pharmacists, who have enslaved us in a plausible pseudo-science...
The blind faith which some men have in medicines illustrates too often the greatest of all human capacities - the capacity for self deception...
Some one will say, Is this all your science has to tell us? Is this the outcome of decades of good clinical work, of patient study of the disease, of anxious trial in such good faith of so many drugs? Give us back the childlike trust of the fathers in antimony and in the lancet rather than this cold nihilism. Not at all! Let us accept the truth, however unpleasant it may be, and with the death rate staring us in the face, let us not be deceived with vain fancies...
we need a stern, iconoclastic spirit which leads, not to nihilism, but to an active skepticism - not the passive skepticism, born of despair, but the active skepticism born of a knowledge that recognizes its limitations and knows full well that only in this attitude of mind can true progress be made.
- William Osler 1909