Class information for:
Level 2: ICCA JOURNAL//ICGA JOURNAL//REINFORCEMENT LEARNING

Basic class information

ID Publications Average number
of references
Avg. shr. active
ref. in WoS
1992 5055 26.4 30%



Bar chart of Publication_year

Last years might be incomplete

Classes in level above (level 3)



ID, lev.
above
Publications Label for level above
186 51139 ARTIFICIAL INTELLIGENCE//ICCA JOURNAL//ICGA JOURNAL

Classes in level below (level 1)



ID, lev. below Publications Label for level below
6683 1382 REINFORCEMENT LEARNING//ADAPTIVE DYNAMIC PROGRAMMING//APPROXIMATE DYNAMIC PROGRAMMING
9109 1121 JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH//AUTOMATED PLANNING//DOMAIN INDEPENDENT PLANNING
10907 957 ICCA JOURNAL//ICGA JOURNAL//MONTE CARLO TREE SEARCH MCTS
17287 543 GITTINS INDEX//EULER DISTRIBUTION//HEINE DISTRIBUTION
19191 451 15 PUZZLE//PATTERN DATABASES//SLIDING TILE PUZZLES
22955 307 POINT BASED VALUE ITERATION//PREDICTIVE STATE REPRESENTATIONS//POMDP
23337 294 SPRAGUE GRUNDY FUNCTION//IMPARTIAL GAME//WYTHOFFS GAME

Terms with highest relevance score



Rank Term Type of term Relevance score
(tfidf)
Class's shr.
of term's tot.
occurrences
Shr. of publ.
in class containing
term
Num. of
publ. in
class
1 ICCA JOURNAL Journal 509 92% 4% 200
2 ICGA JOURNAL Journal 448 91% 4% 185
3 REINFORCEMENT LEARNING Author keyword 87 15% 10% 528
4 ADAPTIVE DYNAMIC PROGRAMMING Author keyword 65 64% 1% 64
5 JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH Journal 56 25% 4% 197
6 ARTIFICIAL INTELLIGENCE Journal 48 14% 6% 313
7 APPROXIMATE DYNAMIC PROGRAMMING Author keyword 43 37% 2% 94
8 MONTE CARLO TREE SEARCH MCTS Author keyword 41 100% 0% 15
9 GITTINS INDEX Author keyword 40 61% 1% 43
10 ADAPTIVE DYNAMIC PROGRAMMING ADP Author keyword 31 76% 0% 22

Web of Science journal categories

Author Key Words



Rank Web of Science journal category Relevance score
(tfidf)
Class's shr.
of term's tot.
occurrences
Shr. of publ.
in class containing
term
Num. of
publ. in
class
LCSH search Wikipedia search
1 REINFORCEMENT LEARNING 87 15% 10% 528 Search REINFORCEMENT+LEARNING Search REINFORCEMENT+LEARNING
2 ADAPTIVE DYNAMIC PROGRAMMING 65 64% 1% 64 Search ADAPTIVE+DYNAMIC+PROGRAMMING Search ADAPTIVE+DYNAMIC+PROGRAMMING
3 APPROXIMATE DYNAMIC PROGRAMMING 43 37% 2% 94 Search APPROXIMATE+DYNAMIC+PROGRAMMING Search APPROXIMATE+DYNAMIC+PROGRAMMING
4 MONTE CARLO TREE SEARCH MCTS 41 100% 0% 15 Search MONTE+CARLO+TREE+SEARCH+MCTS Search MONTE+CARLO+TREE+SEARCH+MCTS
5 GITTINS INDEX 40 61% 1% 43 Search GITTINS+INDEX Search GITTINS+INDEX
6 ADAPTIVE DYNAMIC PROGRAMMING ADP 31 76% 0% 22 Search ADAPTIVE+DYNAMIC+PROGRAMMING+ADP Search ADAPTIVE+DYNAMIC+PROGRAMMING+ADP
7 GAME TREE SEARCH 27 65% 1% 26 Search GAME+TREE+SEARCH Search GAME+TREE+SEARCH
8 SPRAGUE GRUNDY FUNCTION 23 100% 0% 10 Search SPRAGUE+GRUNDY+FUNCTION Search SPRAGUE+GRUNDY+FUNCTION
9 ADAPTIVE CRITIC DESIGNS 22 51% 1% 31 Search ADAPTIVE+CRITIC+DESIGNS Search ADAPTIVE+CRITIC+DESIGNS
10 EULER DISTRIBUTION 21 90% 0% 9 Search EULER+DISTRIBUTION Search EULER+DISTRIBUTION

Key Words Plus



Rank Web of Science journal category Relevance score
(tfidf)
Class's shr.
of term's tot.
occurrences
Shr. of publ.
in class containing
term
Num. of
publ. in
class
1 HEURISTIC SEARCH 66 43% 2% 118
2 CRITIC DESIGNS 45 90% 0% 19
3 ADAPTIVE OPTIMAL CONTROL 31 92% 0% 12
4 ADAPTIVE CRITIC DESIGNS 28 55% 1% 35
5 BANDIT PROCESSES 23 86% 0% 12
6 OPTIMAL TRACKING CONTROL 23 76% 0% 16
7 DYNAMIC ALLOCATION INDEXES 21 78% 0% 14
8 TDLAMBDA 21 75% 0% 15
9 COMPUTER GO 17 51% 0% 24
10 CONSPIRACY NUMBERS 17 75% 0% 12

Journals



Rank Web of Science journal category Relevance score
(tfidf)
Class's shr.
of term's tot.
occurrences
Shr. of publ.
in class containing
term
Num. of
publ. in
class
1 ICCA JOURNAL 509 92% 4% 200
2 ICGA JOURNAL 448 91% 4% 185
3 JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH 56 25% 4% 197
4 ARTIFICIAL INTELLIGENCE 48 14% 6% 313
5 IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES 30 37% 1% 66
6 AI MAGAZINE 9 11% 2% 76
7 AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS 6 12% 1% 46

Reviews



Title Publ. year Cit. Active
references
% act. ref.
to same field
Reinforcement learning: A survey 1996 1411 16 75%
A comprehensive survey of multiagent reinforcement learning 2008 176 35 83%
Adaptive Dynamic Programming: An Introduction 2009 99 56 75%
Transfer Learning for Reinforcement Learning Domains: A Survey 2009 84 26 81%
Decision-theoretic planning: Structural assumptions and computational leverage 1999 250 27 63%
Cooperative multi-agent learning: The state of the art 2005 198 35 26%
Computer go: An AI oriented survey 2001 70 27 96%
Reinforcement learning and optimal adaptive control: An overview and implementation examples 2012 10 29 83%
Games solved: Now and in the future 2002 64 33 100%
Reinforcement learning in robotics: A survey 2013 13 52 38%

Address terms



Rank Address term Relevance score
(tfidf)
Class's shr.
of term's tot.
occurrences
Shr. of publ.
in class containing
term
Num. of
publ. in
class
1 GAMES AI GRP 20 100% 0.2% 9
2 STATE MANAGEMENT CONTROL COMPLEX SYST 15 22% 1.2% 60
3 KNOWLEDGE AGENT TECHNOL 14 57% 0.3% 16
4 SEQUEL PROJECT 9 67% 0.2% 8
5 IKAT 5 38% 0.2% 11
6 PL MECH ROBOT 4 67% 0.1% 4
7 TEAM SEQUEL 4 75% 0.1% 3
8 UTA 4 56% 0.1% 5
9 COMPUTAT LEARNING 3 33% 0.2% 8
10 NAVY PL AI 3 60% 0.1% 3

Related classes at same level (level 2)



Rank Relatedness score Related classes
1 0.0000020142 INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS//HUMAN ROBOT INTERACTION//CHARACTER ANIMATION
2 0.0000018428 ROBOTICS//ROBOTICS AND AUTONOMOUS SYSTEMS//MOBILE ROBOTS
3 0.0000016117 AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS//MULTI AGENT SYSTEMS//AUTOMATED NEGOTIATIONS
4 0.0000014729 RANKING AND SELECTION//OPTIMIZATION VIA SIMULATION//RARE EVENT SIMULATION
5 0.0000012483 NONMONOTONIC REASONING//ANSWER SET PROGRAMMING//DEFAULT LOGIC
6 0.0000012073 CASE BASED REASONING//IEEE EXPERT-INTELLIGENT SYSTEMS & THEIR APPLICATIONS//QUALITATIVE REASONING
7 0.0000011943 CONSTRAINTS//INDUCTIVE INFERENCE//PAC LEARNING
8 0.0000009844 EVOLUTIONARY COMPUTATION//IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION//EVOLUTIONARY ALGORITHMS
9 0.0000009575 LEARNING AUTOMATA//DATA BROADCAST//WIRELESS DATA BROADCASTING
10 0.0000007094 SECRETARY PROBLEM//BEST CHOICE PROBLEM//PROPHET INEQUALITY