Warning: file_get_contents(https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pubmed&id=26873781
&cmd=llinks): Failed to open stream: HTTP request failed! HTTP/1.1 429 Too Many Requests
in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 215
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 229.6 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 263.2 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 263.2 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 263.2 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 263.2 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Deprecated: Implicit conversion from float 263.2 to int loses precision in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 534
Warning: imagejpeg(C:\Inetpub\vhosts\kidney.de\httpdocs\phplern\26873781
.jpg): Failed to open stream: No such file or directory in C:\Inetpub\vhosts\kidney.de\httpdocs\pget.php on line 117 J+Biomed+Inform
2016 ; 60
(ä): 199-209
Nephropedia Template TP
gab.com Text
Twit Text FOAVip
Twit Text #
English Wikipedia
Is the crowd better as an assistant or a replacement in ontology engineering? An
exploration through the lens of the Gene Ontology
#MMPMID26873781
Mortensen JM
; Telis N
; Hughey JJ
; Fan-Minogue H
; Van Auken K
; Dumontier M
; Musen MA
J Biomed Inform
2016[Apr]; 60
(ä): 199-209
PMID26873781
show ga
Biomedical ontologies contain errors. Crowdsourcing, defined as taking a job
traditionally performed by a designated agent and outsourcing it to an undefined
large group of people, provides scalable access to humans. Therefore, the crowd
has the potential to overcome the limited accuracy and scalability found in
current ontology quality assurance approaches. Crowd-based methods have
identified errors in SNOMED CT, a large, clinical ontology, with an accuracy
similar to that of experts, suggesting that crowdsourcing is indeed a feasible
approach for identifying ontology errors. This work uses that same crowd-based
methodology, as well as a panel of experts, to verify a subset of the Gene
Ontology (200 relationships). Experts identified 16 errors, generally in
relationships referencing acids and metals. The crowd performed poorly in
identifying those errors, with an area under the receiver operating
characteristic curve ranging from 0.44 to 0.73, depending on the methods
configuration. However, when the crowd verified what experts considered to be
easy relationships with useful definitions, they performed reasonably well.
Notably, there are significantly fewer Google search results for Gene Ontology
concepts than SNOMED CT concepts. This disparity may account for the difference
in performance - fewer search results indicate a more difficult task for the
worker. The number of Internet search results could serve as a method to assess
which tasks are appropriate for the crowd. These results suggest that the crowd
fits better as an expert assistant, helping experts with their verification by
completing the easy tasks and allowing experts to focus on the difficult tasks,
rather than an expert replacement.