Class information for:
Level 1: OPTIMAL STATIONARY POLICY//CONTINUOUS TIME MARKOV DECISION PROCESS//ESTADIST CALCULO

Basic class information
Class id #P Avg. number of
references		 Database coverage
of references
9283 1170 19.7 30%


Bar chart of Publication_year

Last years might be incomplete

Hierarchy of classes
The table includes all classes above and classes immediately below the current class.


Cluster id Level Cluster label #P
1 4 ECONOMICS//EDUCATION & EDUCATIONAL RESEARCH//PSYCHOL 3876184
532 3       COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE//REINFORCEMENT LEARNING//ICCA JOURNAL 19644
3182 2             SECRETARY PROBLEM//OPTIMAL STATIONARY POLICY//BEST CHOICE PROBLEM 2129
9283 1                   OPTIMAL STATIONARY POLICY//CONTINUOUS TIME MARKOV DECISION PROCESS//ESTADIST CALCULO 1170

Terms with highest relevance score


rank Term termType Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 OPTIMAL STATIONARY POLICY authKW 757653 3% 97% 30
2 CONTINUOUS TIME MARKOV DECISION PROCESS authKW 511301 2% 85% 23
3 ESTADIST CALCULO address 477100 2% 63% 29
4 DISCRETE TIME MARKOV CONTROL PROCESSES authKW 392988 1% 94% 16
5 AVERAGE COST CRITERION authKW 377097 1% 85% 17
6 MARKOV DECISION PROCESSES authKW 347627 7% 15% 86
7 OPTIMALITY EQUATION authKW 341359 2% 59% 22
8 BOREL STATE SPACE authKW 326207 1% 83% 15
9 DISCOUNTED COST authKW 319671 2% 58% 21
10 CONSTRAINED OPTIMAL POLICY authKW 260970 1% 100% 10

Web of Science journal categories


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 Operations Research & Management Science 28361 35% 0% 413
2 Mathematics, Applied 16446 47% 0% 550
3 Automation & Control Systems 13727 23% 0% 264
4 Statistics & Probability 4507 15% 0% 181
5 Computer Science, Cybernetics 1650 4% 0% 42
6 Mathematics 853 13% 0% 152
7 COMPUTER APPLICATIONS & CYBERNETICS 476 1% 0% 7
8 Engineering, Electrical & Electronic 122 9% 0% 101
9 Social Sciences, Mathematical Methods 84 1% 0% 14
10 Management 78 2% 0% 26

Address terms


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 ESTADIST CALCULO 477100 2% 63% 29
2 MATH COMPUTAT SCI 37395 5% 2% 62
3 STAT OPERAT 2 34795 0% 67% 2
4 TEAM CQFD 31060 0% 24% 5
5 PROBABIL ESTADIST 29819 0% 29% 4
6 ASIA PACIFIC OPERAT 26097 0% 100% 1
7 CIENCIAS ACTUARIALES 26097 0% 100% 1
8 COL SAN MANUEL CU 26097 0% 100% 1
9 COURSE ENGN SOCIAL DEV 26097 0% 100% 1
10 ESTADISITCA CALCULO 26097 0% 100% 1

Journals


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class
1 MATHEMATICAL METHODS OF OPERATIONS RESEARCH 181623 7% 8% 84
2 MATHEMATICS OF OPERATIONS RESEARCH 102394 7% 5% 86
3 SIAM JOURNAL ON CONTROL AND OPTIMIZATION 60604 8% 3% 92
4 APPLIED MATHEMATICS AND OPTIMIZATION 39230 4% 4% 41
5 KYBERNETIKA 16478 3% 2% 33
6 OPERATIONS RESEARCH LETTERS 10804 3% 1% 34
7 IEEE TRANSACTIONS ON AUTOMATIC CONTROL 10643 6% 1% 67
8 JOURNAL OF APPLIED PROBABILITY 10250 3% 1% 37
9 JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS 9472 4% 1% 43
10 SYSTEMS & CONTROL LETTERS 9264 3% 1% 38

Author Key Words


Rank Term Chi square Shr. of publ. in
class containing
term		 Class's shr. of
term's tot. occurrences		 #P with
term in
class		 LCSH search Wikipedia search
1 OPTIMAL STATIONARY POLICY 757653 3% 97% 30 Search OPTIMAL+STATIONARY+POLICY Search OPTIMAL+STATIONARY+POLICY
2 CONTINUOUS TIME MARKOV DECISION PROCESS 511301 2% 85% 23 Search CONTINUOUS+TIME+MARKOV+DECISION+PROCESS Search CONTINUOUS+TIME+MARKOV+DECISION+PROCESS
3 DISCRETE TIME MARKOV CONTROL PROCESSES 392988 1% 94% 16 Search DISCRETE+TIME+MARKOV+CONTROL+PROCESSES Search DISCRETE+TIME+MARKOV+CONTROL+PROCESSES
4 AVERAGE COST CRITERION 377097 1% 85% 17 Search AVERAGE+COST+CRITERION Search AVERAGE+COST+CRITERION
5 MARKOV DECISION PROCESSES 347627 7% 15% 86 Search MARKOV+DECISION+PROCESSES Search MARKOV+DECISION+PROCESSES
6 OPTIMALITY EQUATION 341359 2% 59% 22 Search OPTIMALITY+EQUATION Search OPTIMALITY+EQUATION
7 BOREL STATE SPACE 326207 1% 83% 15 Search BOREL+STATE+SPACE Search BOREL+STATE+SPACE
8 DISCOUNTED COST 319671 2% 58% 21 Search DISCOUNTED+COST Search DISCOUNTED+COST
9 CONSTRAINED OPTIMAL POLICY 260970 1% 100% 10 Search CONSTRAINED+OPTIMAL+POLICY Search CONSTRAINED+OPTIMAL+POLICY
10 OPTIMALITY INEQUALITY 260970 1% 100% 10 Search OPTIMALITY+INEQUALITY Search OPTIMALITY+INEQUALITY

Core articles
The table includes core articles in the class. The following variables is taken into account for the relevance score of an article in a cluster c:
(1) Number of references referring to publications in the class.
(2) Share of total number of active references referring to publications in the class.
(3) Age of the article. New articles get higher score than old articles.
(4) Citation rate, normalized to year.


Rank Reference # ref.
in cl.		 Shr. of ref. in
cl.		 Citations
1 PIUNOVSKII, AB , (1998) CONTROLLED RANDOM SEQUENCES: METHODS OF CONVEX ANALYSIS AND PROBLEMS WITH FUNCTIONAL CONSTRAINTS.RUSSIAN MATHEMATICAL SURVEYS. VOL. 53. ISSUE 6. P. 1233-1293 51 89% 9
2 MENDOZA-PEREZ, AF , JASSO-FUENTES, H , DE-LA-CRUZ COURTOIS, OA , (2016) CONSTRAINED MARKOV DECISION PROCESSES IN BOREL SPACES: FROM DISCOUNTED TO AVERAGE OPTIMALITY.MATHEMATICAL METHODS OF OPERATIONS RESEARCH. VOL. 84. ISSUE 3. P. 489 -525 25 93% 0
3 GUO, XP , HERNANDEZ-LERMA, O , PRIETO-RUMEAU, T , (2006) A SURVEY OF RECENT RESULTS ON CONTINUOUS-TIME MARKOV DECISION PROCESSES.TOP. VOL. 14. ISSUE 2. P. 177-243 29 83% 26
4 ARAPOSTATHIS, A , BORKAR, VS , FERNANDEZGAUCHERAND, E , GHOSH, MK , MARCUS, SI , (1993) DISCRETE-TIME CONTROLLED MARKOV-PROCESSES WITH AVERAGE COST CRITERION - A SURVEY.SIAM JOURNAL ON CONTROL AND OPTIMIZATION. VOL. 31. ISSUE 2. P. 282-344 39 76% 200
5 ZHANG, Y , (2014) AVERAGE OPTIMALITY FOR CONTINUOUS-TIME MARKOV DECISION PROCESSES UNDER WEAK CONTINUITY CONDITIONS.JOURNAL OF APPLIED PROBABILITY. VOL. 51. ISSUE 4. P. 954 -970 19 100% 3
6 VEGA-AMAYA, O , (2015) ON THE VANISHING DISCOUNT FACTOR APPROACH FOR MARKOV DECISION PROCESSES WITH WEAKLY CONTINUOUS TRANSITION PROBABILITIES.JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS. VOL. 426. ISSUE 2. P. 978 -985 18 100% 1
7 GUO, XP , ZHANG, Y , (2016) OPTIMALITY OF MIXED POLICIES FOR AVERAGE CONTINUOUS-TIME MARKOV DECISION PROCESSES WITH CONSTRAINTS.MATHEMATICS OF OPERATIONS RESEARCH. VOL. 41. ISSUE 4. P. 1276 -1296 21 84% 0
8 GUO, XP , SONG, XY , (2011) DISCOUNTED CONTINUOUS-TIME CONSTRAINED MARKOV DECISION PROCESSES IN POLISH SPACES.ANNALS OF APPLIED PROBABILITY. VOL. 21. ISSUE 5. P. 2016-2049 20 95% 4
9 WEI, QD , GUO, XP , (2015) CONSTRAINED SEMI-MARKOV DECISION PROCESSES WITH RATIO AND TIME EXPECTED AVERAGE CRITERIA IN POLISH SPACES.OPTIMIZATION. VOL. 64. ISSUE 7. P. 1593 -1623 17 100% 1
10 GUO, XP , HUANG, YH , SONG, XY , (2012) LINEAR PROGRAMMING AND CONSTRAINED AVERAGE OPTIMALITY FOR GENERAL CONTINUOUS-TIME MARKOV DECISION PROCESSES IN HISTORY-DEPENDENT POLICIES.SIAM JOURNAL ON CONTROL AND OPTIMIZATION. VOL. 50. ISSUE 1. P. 23-47 19 90% 3

Classes with closest relation at Level 1


Rank Class id link
1 21257 STOCHASTIC GAMES//UNIFORM VALUE//DYNKIN GAMES
2 31705 PARTIALLY OBSERVED MARKOV DECISION PROCESS//BLACKWELL DOMINANCE//ACTIVE STATE TRACKING
3 30469 DYNAMIC FUZZY SYSTEM//FUZZY DYNAMIC PROGRAMMING//FUZZY REWARD
4 21756 VINTAGE CAPITAL MODELS//EQUIPMENT REPLACEMENT//VINTAGE CAPITAL
5 19552 SINGULAR STOCHASTIC CONTROL//PAIRS TRADING//OPTIMAL STOPPING
6 5817 REINFORCEMENT LEARNING//Q LEARNING//MARKOV DECISION PROCESSES
7 13663 INDEX POLICIES//GITTINS INDEX//STOCHASTIC SCHEDULING
8 20476 OCCUPATIONAL MEASURES//CONTROL SETS//DIFFERENTIAL INCLUSIONS
9 16305 EQUILIBRIUM STRATEGIES//SOCIAL OPTIMIZATION//BALKING
10 18298 SINGULARLY PERTURBED MARKOV CHAIN//STOCHASTIC MATRIX//ITERATIVE AGGREGATION DISAGGREGATION METHOD

Go to start page