Class information for:
Level 1: OPTIMAL STATIONARY POLICY//DISCRETE TIME MARKOV CONTROL PROCESSES//CONTINUOUS TIME MARKOV DECISION PROCESS

Basic class information
ID Publications Average number
of references		 Avg. shr. active
ref. in WoS
8560 1172 20.4 30%


Bar chart of Publication_year

Last years might be incomplete

Classes in level above (level 2)


ID, lev.
above		 Publications Label for level above
1079 9430 VISCOSITY SOLUTIONS//BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS//BACKWARD STOCHASTIC DIFFERENTIAL EQUATION

Terms with highest relevance score


Rank Term Type of term Relevance score
(tfidf)		 Class's shr.
of term's tot.
occurrences		 Shr. of publ.
in class containing
term		 Num. of
publ. in
class
1 OPTIMAL STATIONARY POLICY Author keyword 45 90% 2% 19
2 DISCRETE TIME MARKOV CONTROL PROCESSES Author keyword 35 89% 1% 16
3 CONTINUOUS TIME MARKOV DECISION PROCESS Author keyword 35 86% 2% 18
4 BOREL STATE SPACE Author keyword 30 84% 1% 16
5 AVERAGE COST CRITERION Author keyword 27 78% 2% 18
6 OPTIMAL STATIONARY POLICIES Author keyword 24 91% 1% 10
7 CONSTRAINED OPTIMAL POLICY Author keyword 23 100% 1% 10
8 OPTIMALITY INEQUALITY Author keyword 20 100% 1% 9
9 DISCRETE TIME MARKOV DECISION PROCESS Author keyword 15 82% 1% 9
10 MARKOV DECISION PROCESSES Author keyword 15 15% 8% 91

Web of Science journal categories

Author Key Words


Rank Web of Science journal category Relevance score
(tfidf)		 Class's shr.
of term's tot.
occurrences		 Shr. of publ.
in class containing
term		 Num. of
publ. in
class		 LCSH search Wikipedia search
1 OPTIMAL STATIONARY POLICY 45 90% 2% 19 Search OPTIMAL+STATIONARY+POLICY Search OPTIMAL+STATIONARY+POLICY
2 DISCRETE TIME MARKOV CONTROL PROCESSES 35 89% 1% 16 Search DISCRETE+TIME+MARKOV+CONTROL+PROCESSES Search DISCRETE+TIME+MARKOV+CONTROL+PROCESSES
3 CONTINUOUS TIME MARKOV DECISION PROCESS 35 86% 2% 18 Search CONTINUOUS+TIME+MARKOV+DECISION+PROCESS Search CONTINUOUS+TIME+MARKOV+DECISION+PROCESS
4 BOREL STATE SPACE 30 84% 1% 16 Search BOREL+STATE+SPACE Search BOREL+STATE+SPACE
5 AVERAGE COST CRITERION 27 78% 2% 18 Search AVERAGE+COST+CRITERION Search AVERAGE+COST+CRITERION
6 OPTIMAL STATIONARY POLICIES 24 91% 1% 10 Search OPTIMAL+STATIONARY+POLICIES Search OPTIMAL+STATIONARY+POLICIES
7 CONSTRAINED OPTIMAL POLICY 23 100% 1% 10 Search CONSTRAINED+OPTIMAL+POLICY Search CONSTRAINED+OPTIMAL+POLICY
8 OPTIMALITY INEQUALITY 20 100% 1% 9 Search OPTIMALITY+INEQUALITY Search OPTIMALITY+INEQUALITY
9 DISCRETE TIME MARKOV DECISION PROCESS 15 82% 1% 9 Search DISCRETE+TIME+MARKOV+DECISION+PROCESS Search DISCRETE+TIME+MARKOV+DECISION+PROCESS
10 MARKOV DECISION PROCESSES 15 15% 8% 91 Search MARKOV+DECISION+PROCESSES Search MARKOV+DECISION+PROCESSES

Key Words Plus


Rank Web of Science journal category Relevance score
(tfidf)		 Class's shr.
of term's tot.
occurrences		 Shr. of publ.
in class containing
term		 Num. of
publ. in
class
1 UNBOUNDED COSTS 46 82% 2% 27
2 BOREL SPACES 41 87% 2% 20
3 UNBOUNDED REWARDS 32 85% 1% 17
4 BIAS OPTIMALITY 32 80% 2% 20
5 OPTIMAL STATIONARY POLICIES 29 72% 2% 23
6 CONTROLLED QUEUING SYSTEMS 23 100% 1% 10
7 BLACKWELL OPTIMALITY 20 100% 1% 9
8 POLISH SPACES 17 75% 1% 12
9 STATIONARY POLICIES 17 100% 1% 8
10 AVERAGE OPTIMALITY 15 82% 1% 9

Journals

Reviews


Title Publ. year Cit. Active
references		 % act. ref.
to same field
DISCRETE-TIME CONTROLLED MARKOV-PROCESSES WITH AVERAGE COST CRITERION - A SURVEY 1993 174 51 75%
A survey of recent results on continuous-time Markov decision processes 2006 19 35 89%
Controlled random sequences: methods of convex analysis and problems with functional constraints 1998 8 57 91%
MARKOV DECISION-PROCESSES 1989 27 17 88%
MEAN, VARIANCE, AND PROBABILISTIC CRITERIA IN FINITE MARKOV DECISION-PROCESSES - A REVIEW 1988 52 4 50%
Jaap Wessels - his life with stochastic processes 2000 0 13 46%
DECISION AND FORECAST HORIZONS IN A STOCHASTIC ENVIRONMENT - A SURVEY 1987 2 4 75%
MARKOV DECISION-PROCESSES - HISTORICAL REVIEW AND PRESENT-DAY DEVELOPMENT 1986 0 3 100%
ON USING DISCRETE RANDOM MODELS WITHIN DECISION SUPPORT SYSTEMS 1984 2 5 60%
Jean Leray and nonlinear integral equations: A partially forgotten legacy 2007 0 14 7%

Address terms


Rank Address term Relevance score
(tfidf)		 Class's shr.
of term's tot.
occurrences		 Shr. of publ.
in class containing
term		 Num. of
publ. in
class
1 ESTADIST CALCULO 4 30% 1.0% 12
2 THEORET PL ECON 2 29% 0.4% 5
3 ECON LICADA CUANTITAT 2 1 50% 0.2% 2
4 PROBABIL ESTADIST 1 29% 0.3% 4
5 INRIA BORDEAUX SUD QUEST 1 40% 0.2% 2
6 TEAM CQFD 1 21% 0.3% 4
7 INVEST SOCIOECON 1 33% 0.2% 2
8 ECON POLICY DIRECTORATE AEP 1 50% 0.1% 1
9 ENTERPRISE MKT MANAGEMENT 1 50% 0.1% 1
10 JULIUS M BERNICE NAIMAN CHAIR ENGN 1 50% 0.1% 1

Related classes at same level (level 1)


Rank Relatedness score Related classes
1 0.0000264436 UNIFORM VALUE//STOPPING GAMES//STOCHASTIC GAMES
2 0.0000152724 RISK SENSITIVE CONTROL//RISK SENSITIVE STOCHASTIC CONTROL//ESTADIST CALCULO
3 0.0000102796 POINT BASED VALUE ITERATION//PREDICTIVE STATE REPRESENTATIONS//POMDP
4 0.0000102502 SINGULARLY PERTURBED MARKOV CHAIN//FIBER DYNAMICS//ANISOTROPIC SINGULAR PERTURBATIONS
5 0.0000100896 DISCRETE DECISION PROCESS//ECON ENGN//MULTIOBJECTIVE DYNAMIC PROGRAMMING
6 0.0000084020 GITTINS INDEX//EULER DISTRIBUTION//HEINE DISTRIBUTION
7 0.0000072432 OCCUPATIONAL MEASURES//CONTROL SETS//APPROXIMATION OF SLOW MOTIONS
8 0.0000070801 SOCIAL OPTIMIZATION//EQUILIBRIUM STRATEGIES//DELAY INFORMATION
9 0.0000068197 STOCHASTIC APPROXIMATION//GRADIENT ESTIMATION//FREQUENCY DOMAIN METHODOLOGY
10 0.0000058520 SINGULAR STOCHASTIC CONTROL//OPTIMAL STOPPING//REVERSIBLE INVESTMENT