Class information for:
Level 1: MECHANICAL TURK//MTURK//CROWDSOURCING

Basic class information
Class id #P Avg. number of
references		 Database coverage
of references
26700 248 35.0 46%


Bar chart of Publication_year

Last years might be incomplete

Hierarchy of classes
The table includes all classes above and classes immediately below the current class.


Cluster id Level Cluster label #P
1 4 ECONOMICS//EDUCATION & EDUCATIONAL RESEARCH//PSYCHOL 3876184
221 3       ECONOMICS//GAMES AND ECONOMIC BEHAVIOR//SOCIAL SCIENCES, MATHEMATICAL METHODS 50232
549 2             COOPERATION//PRISONERS DILEMMA//SOCIAL DILEMMAS 14637
26700 1                   MECHANICAL TURK//MTURK//CROWDSOURCING 248

Terms with highest relevance score


rank Term termType Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 MECHANICAL TURK authKW 1119308 8% 45% 20
2 MTURK authKW 990864 5% 62% 13
3 CROWDSOURCING authKW 984875 31% 11% 76
4 AMAZON MECHANICAL TURK authKW 685204 6% 35% 16
5 HUMAN COMPUTATION authKW 492489 5% 33% 12
6 REPEATED LABELING authKW 369379 1% 100% 3
7 GAMES WITH A PURPOSE authKW 369373 2% 50% 6
8 GROUND TRUTH INFERENCE authKW 246253 1% 100% 2
9 LEARNING FROM CROWDS authKW 246253 1% 100% 2
10 MULTIPLE NOISY LABELING authKW 246253 1% 100% 2

Web of Science journal categories


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 Computer Science, Artificial Intelligence 1615 21% 0% 53
2 Computer Science, Information Systems 865 16% 0% 39
3 Psychology, Multidisciplinary 800 13% 0% 33
4 Psychology, Experimental 782 13% 0% 31
5 Psychology, Mathematical 742 4% 0% 10
6 Psychology, Social 295 6% 0% 15
7 Medical Informatics 199 4% 0% 9
8 Computer Science, Software Engineering 192 7% 0% 17
9 Computer Science, Cybernetics 155 2% 0% 6
10 Computer Science, Interdisciplinary Applications 117 6% 0% 16

Address terms


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 CHAIR COMP AIDED MED PROCEDURE 123126 0% 100% 1
2 ETSI TELECOMUNICACCEI MONCLOA UPM UCM 123126 0% 100% 1
3 FRAXINUS ASH DIEBACK GAME COMMUN 123126 0% 100% 1
4 GRP KNOWLEDGE MEDIA 123126 0% 100% 1
5 PFORZHEIMER MAIL 383 123126 0% 100% 1
6 PROGRAM BIOMED INFOFMAT 123126 0% 100% 1
7 UNIV PENN LIB 123126 0% 100% 1
8 WEE KIMWEE COMMUN INFORMAT 123126 0% 100% 1
9 CAD KNOWLEDGE SOLUT IKM CKS 61562 0% 50% 1
10 CDL FLEX 61562 0% 50% 1

Journals


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 JEZIKOSLOVLJE 5861 0% 5% 1
2 BEHAVIOR RESEARCH METHODS 4609 3% 1% 7
3 JOURNAL OF MEDICAL INTERNET RESEARCH 4223 3% 0% 8
4 LANGUAGE RESOURCES AND EVALUATION 3627 1% 1% 3
5 IEEE INTELLIGENT SYSTEMS 2782 2% 1% 4
6 LABORATORY PHONOLOGY 2734 0% 2% 1
7 COMPUTERS IN HUMAN BEHAVIOR 2702 4% 0% 10
8 IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING 2610 3% 0% 8
9 ACM TRANSACTIONS ON THE WEB 2575 1% 1% 2
10 JUDGMENT AND DECISION MAKING 2005 1% 1% 3

Author Key Words


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class		 LCSH search Wikipedia search
1 MECHANICAL TURK 1119308 8% 45% 20 Search MECHANICAL+TURK Search MECHANICAL+TURK
2 MTURK 990864 5% 62% 13 Search MTURK Search MTURK
3 CROWDSOURCING 984875 31% 11% 76 Search CROWDSOURCING Search CROWDSOURCING
4 AMAZON MECHANICAL TURK 685204 6% 35% 16 Search AMAZON+MECHANICAL+TURK Search AMAZON+MECHANICAL+TURK
5 HUMAN COMPUTATION 492489 5% 33% 12 Search HUMAN+COMPUTATION Search HUMAN+COMPUTATION
6 REPEATED LABELING 369379 1% 100% 3 Search REPEATED+LABELING Search REPEATED+LABELING
7 GAMES WITH A PURPOSE 369373 2% 50% 6 Search GAMES+WITH+A+PURPOSE Search GAMES+WITH+A+PURPOSE
8 GROUND TRUTH INFERENCE 246253 1% 100% 2 Search GROUND+TRUTH+INFERENCE Search GROUND+TRUTH+INFERENCE
9 LEARNING FROM CROWDS 246253 1% 100% 2 Search LEARNING+FROM+CROWDS Search LEARNING+FROM+CROWDS
10 MULTIPLE NOISY LABELING 246253 1% 100% 2 Search MULTIPLE+NOISY+LABELING Search MULTIPLE+NOISY+LABELING

Core articles
The table includes core articles in the class. The following variables is taken into account for the relevance score of an article in a cluster c:
(1) Number of references referring to publications in the class.
(2) Share of total number of active references referring to publications in the class.
(3) Age of the article. New articles get higher score than old articles.
(4) Citation rate, normalized to year.


Rank Reference # ref.
in cl.		 Shr. of ref. in
cl.		 Citations
1 PAOLACCI, G , CHANDLER, J , (2014) INSIDE THE TURK: UNDERSTANDING MECHANICAL TURK AS A PARTICIPANT POOL.CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE. VOL. 23. ISSUE 3. P. 184-188 13 68% 220
2 HAUSER, DJ , SCHWARZ, N , (2016) ATTENTIVE TURKERS: MTURK PARTICIPANTS PERFORM BETTER ON ONLINE ATTENTION CHECKS THAN DO SUBJECT POOL PARTICIPANTS.BEHAVIOR RESEARCH METHODS. VOL. 48. ISSUE 1. P. 400 -407 9 64% 31
3 CHANDLER, J , SHAPIRO, D , (2016) CONDUCTING CLINICAL RESEARCH USING CROWDSOURCED CONVENIENCE SAMPLES.ANNUAL REVIEW OF CLINICAL PSYCHOLOGY, VOL 12. VOL. 12. ISSUE . P. 53 -81 30 29% 8
4 MILLER, JD , CROWE, M , WEISS, B , MAPLES-KELLER, JL , LYNAM, DR , (2017) USING ONLINE, CROWDSOURCING PLATFORMS FOR DATA COLLECTION IN PERSONALITY DISORDER RESEARCH: THE EXAMPLE OF AMAZON'S MECHANICAL TURK.PERSONALITY DISORDERS-THEORY RESEARCH AND TREATMENT. VOL. 8. ISSUE 1. P. 26 -34 19 48% 0
5 SCHMIDT, GB , JETTINGHOFF, WM , (2016) USING AMAZON MECHANICAL TURK AND OTHER COMPENSATED CROWDSOURCING SITES.BUSINESS HORIZONS. VOL. 59. ISSUE 4. P. 391 -400 8 80% 0
6 KUANG, JQ , ARGO, L , STODDARD, G , BRAY, BE , ZENG-TREITLER, Q , (2015) ASSESSING PICTOGRAPH RECOGNITION: A COMPARISON OF CROWDSOURCING AND TRADITIONAL SURVEY APPROACHES.JOURNAL OF MEDICAL INTERNET RESEARCH. VOL. 17. ISSUE 12. P. - 13 46% 3
7 STEWART, N , UNGEMACH, C , HARRIS, AJL , BARTELS, DM , NEWELL, BR , PAOLACCI, G , CHANDLER, J , (2015) THE AVERAGE LABORATORY SAMPLES A POPULATION OF 7,300 AMAZON MECHANICAL TURK WORKERS.JUDGMENT AND DECISION MAKING. VOL. 10. ISSUE 5. P. 479 -491 10 56% 4
8 ZHANG, J , WU, XD , SHENG, V , (2016) LEARNING FROM CROWDSOURCED LABELED DATA: A SURVEY.ARTIFICIAL INTELLIGENCE REVIEW. VOL. 46. ISSUE 4. P. 543 -576 14 41% 0
9 BOYNTON, MH , RICHMAN, LS , (2014) AN ONLINE DAILY DIARY STUDY OF ALCOHOL USE USING AMAZON'S MECHANICAL TURK.DRUG AND ALCOHOL REVIEW. VOL. 33. ISSUE 4. P. 456 -461 11 46% 10
10 CHANDLER, J , MUELLER, P , PAOLACCI, G , (2014) NONNAIVETE AMONG AMAZON MECHANICAL TURK WORKERS: CONSEQUENCES AND SOLUTIONS FOR BEHAVIORAL RESEARCHERS.BEHAVIOR RESEARCH METHODS. VOL. 46. ISSUE 1. P. 112 -130 10 32% 95

Classes with closest relation at Level 1


Rank Class id link
1 35852 CAPTCHA//HUMAN INTERACTIVE PROOFS//ABUSE OF WEB SITES AND SERVICES
2 9392 OPEN INNOVATION//USER INNOVATION//LEAD USERS
3 36416 TEXTISMS//TEXTESE//TEXT MESSAGING
4 32142 CALLING//CAREER CALLING//WORK MEANING
5 7645 WEB SURVEY//PUBLIC OPINION QUARTERLY//RESPONSE QUALITY
6 37501 COMBINATION TECHNIQUE//TWO SCALE DISCRETIZATION//SPARSE GRIDS
7 33002 IDENTIFIABLE VICTIM EFFECT//IDENTIFIABLE VICTIM//IDENTIFIED VICTIM EFFECT
8 28343 ULTIMATUM GAME//ALTRUISTIC PUNISHMENT//ECONOMICAL DECISION MAKING
9 35798 AFFINITY PROPAGATION//VERY LARGE DATA SETS VLDS//BILINGUAL GRAPH
10 18924 CITIZEN SCIENCE//VOLUNTEER MONITORING//LOCALLY BASED MONITORING

Go to start page