2 Matching Annotations
  1. Jul 2018
    1. On 2015 Mar 27, James M Heilman commented:

      A great analysis of this paper exists here https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2015-03-25/Recent_research

      "A paper in Advances in Physiology Education[2] claims to assess the suitability of Wikipedia's respiratory articles for medical student learning. Forty Wikipedia articles on respiratory topics were sampled on 27 April 2014. These articles were assessed by three researchers with a modified version of the DISCERN tool. Article references were checked for accuracy and typography. Readability was assessed with the Flesch–Kincaid and Coleman–Liau tools.

      The paper found a wide range of accuracy scores using the modified DISCERN tool, from 14.67 for "[Nail] clubbing" to 38.33 for "Tuberculosis". Incorrect, incomplete or inconsistent formatting of references were commonly found, although these were not quantified in the paper. Readability of the articles was typically at a college level. On the basis of these findings, the paper declares Wikipedia's respiratory articles as unsuitable for medical students.

      The researcher apparently uses an arbitrary unvalidated modification of the DISCERN tool to assess the accuracy of articles. The nature of this modification is not specified; nor is it available at the journal's website as claimed in the paper.

      The DISCERN tool does not assess accuracy; rather, it is designed to assess "information about treatment choices specifically for health consumers". As such, the use of this tool is inappropriate to assess the suitability for medical students.

      There is no acknowledgement that Wikipedia is an encyclopedia. Several of the DISCERN tool's questions are unsuitable for an encyclopedia. DISCERN questions such as "Does it describe how each treatment works?" and "Does it describe the risks of each treatment?" would be answered on other Wikipedia pages, not on the disease article's page. The author makes an a priori assumption that the medical textbooks used for comparison are perfect sources. The author does not assess those textbooks with the DISCERN tool.

      The paper states: "[t]he number of citations from peer-reviewed journals published in the last 5 yr was only 312 (19%)." However this is far superior to the number of citations in the textbooks listed. The chapter on "Neoplasms of the lung" in Harrison's Principles of Internal Medicine (18th ed.) contains no citations at all. Seven sources are listed in its "Further readings" section, of which only one is from the last five years.

      The claim that the article on "clubbing ... had no references or external links" is incorrect. On 27 April 2014, Wikipedia's article on "Nail clubbing" had ten references.

      Several of the articles are at a rudimentary stage, containing limited information and lacking appropriate references. However two articles, "Lung cancer" and "Diffuse panbronchiolitis", were assessed by Wikipedia's editors at the highest standard and awarded "Featured article" status. Five more articles, "Asthma", "Chronic obstructive pulmonary disease", "Pneumonia", "Pneumothorax" and "Tuberculosis", reached "Good article" standard. These articles are exceptionally detailed, accurate, and well-referenced. Azer's paper makes no mention of the high quality of these articles.

      The research uses an unvalidated tool for an inappropriate purpose without applying a suitable comparator, and inevitably draws incorrect conclusions.

      Wikipedia is an encyclopedia. It is not a medical textbook; nor is it intended to replace medical textbooks. Rather, it should be used as a starting point by medical students. The quality of an individual article should be quickly assessed by the reader, and information can be confirmed in the references provided. Missing information should be sought from other sources, such as textbooks. Students should be encouraged to use Wikipedia alongside medical textbooks to assist their learning."

      It is by User:Axl and is under a CC BY SA license


      This comment, imported by Hypothesis from PubMed Commons, is licensed under CC BY.

  2. Feb 2018
    1. On 2015 Mar 27, James M Heilman commented:

      A great analysis of this paper exists here https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2015-03-25/Recent_research

      "A paper in Advances in Physiology Education[2] claims to assess the suitability of Wikipedia's respiratory articles for medical student learning. Forty Wikipedia articles on respiratory topics were sampled on 27 April 2014. These articles were assessed by three researchers with a modified version of the DISCERN tool. Article references were checked for accuracy and typography. Readability was assessed with the Flesch–Kincaid and Coleman–Liau tools.

      The paper found a wide range of accuracy scores using the modified DISCERN tool, from 14.67 for "[Nail] clubbing" to 38.33 for "Tuberculosis". Incorrect, incomplete or inconsistent formatting of references were commonly found, although these were not quantified in the paper. Readability of the articles was typically at a college level. On the basis of these findings, the paper declares Wikipedia's respiratory articles as unsuitable for medical students.

      The researcher apparently uses an arbitrary unvalidated modification of the DISCERN tool to assess the accuracy of articles. The nature of this modification is not specified; nor is it available at the journal's website as claimed in the paper.

      The DISCERN tool does not assess accuracy; rather, it is designed to assess "information about treatment choices specifically for health consumers". As such, the use of this tool is inappropriate to assess the suitability for medical students.

      There is no acknowledgement that Wikipedia is an encyclopedia. Several of the DISCERN tool's questions are unsuitable for an encyclopedia. DISCERN questions such as "Does it describe how each treatment works?" and "Does it describe the risks of each treatment?" would be answered on other Wikipedia pages, not on the disease article's page. The author makes an a priori assumption that the medical textbooks used for comparison are perfect sources. The author does not assess those textbooks with the DISCERN tool.

      The paper states: "[t]he number of citations from peer-reviewed journals published in the last 5 yr was only 312 (19%)." However this is far superior to the number of citations in the textbooks listed. The chapter on "Neoplasms of the lung" in Harrison's Principles of Internal Medicine (18th ed.) contains no citations at all. Seven sources are listed in its "Further readings" section, of which only one is from the last five years.

      The claim that the article on "clubbing ... had no references or external links" is incorrect. On 27 April 2014, Wikipedia's article on "Nail clubbing" had ten references.

      Several of the articles are at a rudimentary stage, containing limited information and lacking appropriate references. However two articles, "Lung cancer" and "Diffuse panbronchiolitis", were assessed by Wikipedia's editors at the highest standard and awarded "Featured article" status. Five more articles, "Asthma", "Chronic obstructive pulmonary disease", "Pneumonia", "Pneumothorax" and "Tuberculosis", reached "Good article" standard. These articles are exceptionally detailed, accurate, and well-referenced. Azer's paper makes no mention of the high quality of these articles.

      The research uses an unvalidated tool for an inappropriate purpose without applying a suitable comparator, and inevitably draws incorrect conclusions.

      Wikipedia is an encyclopedia. It is not a medical textbook; nor is it intended to replace medical textbooks. Rather, it should be used as a starting point by medical students. The quality of an individual article should be quickly assessed by the reader, and information can be confirmed in the references provided. Missing information should be sought from other sources, such as textbooks. Students should be encouraged to use Wikipedia alongside medical textbooks to assist their learning."

      It is by User:Axl and is under a CC BY SA license


      This comment, imported by Hypothesis from PubMed Commons, is licensed under CC BY.