G. Buckdahn, R. Goreac, D. Quincampoix, and M. , Stochastic Optimal Control and Linear Programming Approach, Applied Mathematics & Optimization, vol.18, issue.4, pp.257-276, 2011.
DOI : 10.1007/s00245-010-9120-y
URL : https://hal.archives-ouvertes.fr/inria-00636557

D. Goreac and O. Serea, Discontinuous control problems for non-convex dynamics and near viability for singularly perturbed control systems, Nonlinear Anal, pp.2699-2713, 2010.

D. Phd, [. Goreac, and D. , Approximate controllability for linear stochastic di¤erential equations in in…nite dimensions, Appl. Math. Optim, vol.60, issue.1, pp.105-132, 2009.

D. Goreac, A Kalman-type condition for stochastic approximate controllability, Comptes Rendus Mathematique, vol.346, issue.3-4, pp.183-188, 2008.
DOI : 10.1016/j.crma.2007.12.008

D. Goreac, Approximate controllability for linear stochastic di¤erential equations with control acting on the noise Applied analysis and di¤erential equations, World Sci. Publ, pp.153-164, 2007.

D. Goreac, Non-compact-valued stochastic control under state constraints, Bulletin des Sciences Math??matiques, vol.131, issue.8, pp.716-737, 2007.
DOI : 10.1016/j.bulsci.2006.08.001
URL : http://doi.org/10.1016/j.bulsci.2006.08.001

P. Goreac and O. S. Serea, Min-max control problems via occupational measures, Optimal Control Applications and Methods, vol.130, issue.1, 2012.
DOI : 10.1002/oca.2071
URL : https://hal.archives-ouvertes.fr/hal-00879272

D. [. Buckdahn, M. Goreac, and . Quincampoix, Existence of Asymptotic Values for Nonexpansive Stochastic Control Systems, Applied Mathematics & Optimization, vol.18, issue.9, p.pp, 2013.
DOI : 10.1007/s00245-013-9230-4
URL : https://hal.archives-ouvertes.fr/hal-00879274

. [. Goreac, Controllability properties for controlled linear systems of mean-…eld type, p.pp, 2013.

O. [. Goreac and . Serea, Abel-type Results for Controlled Piecewise Deterministic Markov Processes, Differential Equations and Dynamical Systems, vol.24, issue.6, p.pp, 2013.
DOI : 10.1007/s00245-012-9169-x
URL : https://hal.archives-ouvertes.fr/hal-01142323

O. [. Goreac and . Serea, Optimality conditions for stochastic re‡ecting boundary control problems, 2013.

M. [. Goreac and . Kobylanski, Viability and viability kernels for BSDEs in in…nite dimensions, 2013.

D. Goreac, Problèmes de contrôle stochastique : contrôle sous contrainte, contrôlabilité et application à la réassurance, Thèse de Doctorat, 2005.

V. Amarandei, N. Buzduga, D. Goreac, L. Iacob, and . Problems, have problems? (in Romanian : Probleme... cu probleme?, p.pp, 2000.

R. Altarovici, O. Bokanowski, and H. Zidani, A general Hamilton-Jacobi framework for nonlinear state-constrained control problems, ESAIM: Control, Optimisation , and Calculus of Variations, 2012.
DOI : 10.1051/cocv/2012011
URL : https://hal.archives-ouvertes.fr/hal-00653337

A. [. Aubin and . Cellina, Di¤erential inclusions. Set-valued maps and viability theory, 1984.

[. Aubin and G. Da-prato, Stochastic viability and invariance, pp.595-694, 1990.

H. [. Aubin, V. Frankowska-artstein, and . Gaitsgory, Set-valued analysis The value function of singularly perturbed control systems, Applied Mathematics and Optimization, vol.41, issue.3, pp.425-445, 1990.

P. [. Arisawa and . Lions, On ergodic stochastic control, Communications in Partial Differential Equations, vol.318, issue.11-12, pp.11-12, 1998.
DOI : 10.1137/0319020

A. Almudevar, A Dynamic Programming Algorithm for the Optimal Control of Piecewise Deterministic Markov Processes, SIAM Journal on Control and Optimization, vol.40, issue.2, pp.525-539, 2001.
DOI : 10.1137/S0363012999364474

A. [. Asiminoaei and . Rascanu, Approximation and simulation of stochastic variational inequalitie-splitting up method, Numer. Funct. Anal. Optim, vol.18, pp.3-4, 1996.
DOI : 10.1080/01630569708816759

]. M. Ari98 and . Arisawa, Ergodic problem for the Hamilton-Jacobi-Bellman equation. II, Annales de l’Institut Henri Poincare (C) Non Linear Analysis, pp.1-24, 1998.

Z. Artstein, An occupational measure solution to a singularly perturbed optimal control problem, 623–642, Well-posedness in optimization and related topics, p.49060, 2001.

]. J. Aub91 and . Aubin, Viability theory, 1991.

A. Aubin, Viability Solutions to Structured Hamilton???Jacobi Equations under Constraints, SIAM Journal on Control and Optimization, vol.49, issue.5, pp.1881-1915, 2011.
DOI : 10.1137/10079567X
URL : https://hal.archives-ouvertes.fr/inria-00629136

V. [. Bhatt and . Borkar, Occupation measures for controlled Markov processes: Characterization and optimality, Ann. of Probability, vol.24, pp.1531-1562, 1996.

V. [. Basak, M. K. Borkar, and . Ghosh, Ergodic control of degenerate diffusions, Stochastic Analysis and Applications, vol.15, issue.1, pp.1-17, 1997.
DOI : 10.1214/aop/1176990945

I. [. Bardi and . Dolcetta, Optimal control and viscosity solutions of hamilton-jacobi-bellman equations, Systems and Control: Foundations and Applications, 1997.

. Jean-baptiste, A. Bardet, and . Christen, Arnaud Guillin, Florent Malrieu, and Pierre-André Zitt, Total variation estimates for the tcp process, Electron, J. Probab, vol.18, issue.10, pp.1-21, 2013.

R. Buckdahn, B. Djehiche, J. Li, and S. Peng, Mean-field backward stochastic differential equations: A limit approach, The Annals of Probability, vol.37, issue.4, pp.1524-1565, 2009.
DOI : 10.1214/08-AOP442
URL : http://arxiv.org/abs/0711.2162

A. Brandejsky, F. Benoîte-de-saporta, and . Dufour, Numerical method for expectations of piecewise deterministic Markov processes, Commun On ergodic problem for Hamilton-Jacobi-Isaacs equations, ESAIM- Control Optimisation and Calculus of Variations, MR 2979517 [Bet05] P. Bettiol, pp.11-522, 2005.

S. Vivek, M. K. Borkar, and . Ghosh, Controlled di¤usions with constraints, J. Math. Anal. Appl, vol.15291, issue.1, pp.88-108, 1990.

[. Borkar and V. Gaitsgory, On Existence of Limit Occupational Measures Set of a Controlled Stochastic Differential Equation, SIAM Journal on Control and Optimization, vol.44, issue.4, pp.1436-1473, 2005.
DOI : 10.1137/S0363012904443476

V. [. Borkar and . Gaitsgory, Averaging of Singularly Perturbed Controlled Stochastic Differential Equations, Applied Mathematics and Optimization, vol.56, issue.2, pp.169-209, 2007.
DOI : 10.1007/s00245-007-0893-6

H. [. Barron and . Ishii, The Bellman equation for minimizing the maximum cost, Nonlinear Anal., Theory Methods Appl, 1989.

N. [. Buckdahn and . Ichihara, Limit Theorem for Controlled Backward SDEs and Homogenization of Hamilton?Jacobi?Bellman Equations, Applied Mathematics and Optimization, vol.51, issue.1, pp.1-33, 2005.
DOI : 10.1007/s00245-004-0805-3

[. Billingsley, Convergence of probability measures Wiley Series in Probability and Statistics: Probability and Statistics, p.170074960008, 1999.

R. [. Barron and . Jensen, Semicontinuous Viscosity Solutions For Hamilton???Jacobi Equations With Convex Hamiltonians, Communications in Partial Differential Equations, vol.10, issue.12, pp.1713-1742, 1990.
DOI : 10.1007/BF02765025

]. M. Bj02a, R. Bardi, and . Jensen, A geometric characterization of viable sets for controlled degenerate di¤usions, Set-Valued Analysis, vol.10, pp.129-141, 2002.

]. G. Bj02b, E. R. Barles, and . Jakobsen, On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman equations, M2AN, Math. Model. Numer. Anal, 2002.

S. [. Benaïm, F. Le-borgne, P. Malrieu, and . Zitt, Quantitative ergodicity for some switched dynamical systems, Electronic Communications in Probability, vol.17, issue.0, pp.1-14, 2012.
DOI : 10.1214/ECP.v17-1932

[. Buckdahn, J. Li, and S. Peng, Mean-…eld backward stochastic differential equations and related partial di¤erential equations

M. [. Bouchard and . Nutz, Weak Dynamic Programming for Generalized State Constraints, SIAM Journal on Control and Optimization, vol.50, issue.6, p.preprint, 2011.
DOI : 10.1137/110852942
URL : https://hal.archives-ouvertes.fr/hal-00590874

]. V. Bor89 and . Borkar, Optimal control of di¤usion processes, Pitman Research Notes in Math, Longman Scienti…c and Technical, vol.203, 1989.

S. Vivek and . Borkar, Controlled di¤usion processes, Probab. Surv, vol.2, pp.213-244, 2005.

]. B. Bou08 and . Bouchard, Optimal re‡ection of di¤usions and barrier options pricing under constraints, SIAM J. Control Optimization, vol.47, issue.4, 2008.

R. Buckdahn, S. Peng, M. Quincampoix, and C. Rainer, Existence of stochastic control under state constraints, Comptes Rendus de l'Acad??mie des Sciences - Series I - Mathematics, vol.327, issue.1, pp.17-22, 1998.
DOI : 10.1016/S0764-4442(98)80096-7

M. [. Buckdahn, G. Quincampoix, and . Tessitore, A Characterization of Approximately Controllable Linear Stochastic Differential Equations, Lect. Notes Pure Appl. Math, vol.245, pp.53-60, 2006.
DOI : 10.1201/9781420028720.ch6

V. Barbu, A. , and G. Tessitore, Carleman estimates and controllability of linear stochastic heat equations, Appl. Math. Optim, vol.47, issue.2, pp.97-120, 2003.

N. [. Bouchard and . Touzi, Weak Dynamic Programming Principle for Viscosity Solutions, SIAM Journal on Control and Optimization, vol.49, issue.3, pp.948-962, 2011.
DOI : 10.1137/090752328
URL : https://hal.archives-ouvertes.fr/hal-00367355

F. Camilli, A. Cesaroni, L. Grüne, and F. Wirth, STABILIZATION OF CONTROLLED DIFFUSIONS AND ZUBOV'S METHOD, Stochastics and Dynamics, vol.06, issue.03, pp.373-393, 2006.
DOI : 10.1142/S0219493706001803

F. [. Costa and . Dufour, Stability and Ergodicity of Piecewise Deterministic Markov Processes, SIAM Journal on Control and Optimization, vol.47, issue.2, pp.1053-1077, 2008.
DOI : 10.1137/060670109
URL : https://hal.archives-ouvertes.fr/hal-00268162

A. [. Crudu, O. Debussche, and . Radulescu, Hybrid stochastic simplifications for multiscale gene networks, BMC Systems Biology, vol.3, issue.1, p.89, 2009.
DOI : 10.1186/1752-0509-3-89
URL : https://hal.archives-ouvertes.fr/hal-00784449

L. [. Camilli, . L. Grüne-]-d, A. N. Cook, S. J. Gerber, and . Tapscott, Characterizing attraction probabilities via the stochastic Zubov equation, Discrete Contin Modelling stochastic gene expression: Implications for haploinsu¢ciency, Proc. Natl. Acad. Sci. USA 95, pp.15641-15646, 1998.

F. Camilli, L. Grüne, and F. Wirth, A generalization of Zubov’s method to perturbed systems, SIAM J. Control Optim, vol.40, issue.2, p.93058, 2001.

L. [. Camilli, F. Grüne, and . Wirth, Control Lyapunov Functions and Zubov's Method, SIAM Journal on Control and Optimization, vol.47, issue.1, pp.301-326, 2008.
DOI : 10.1137/06065129X

]. O. Cos89 and . Costa, Average impulse control of piecewise deterministic processes, IMA Journal of Mathematical Control and Information, vol.6, issue.4, pp.375-397, 1989.

]. R. Cur86 and . Curtain, Invariance concepts in in…nite dimensions, SIAM J. Control and Optim, vol.24, issue.5, pp.1009-1030, 1986.

]. M. Dav84 and . Davis, Piecewise-deterministic Markov-processes -A general-class of non-di¤usion stochastic-models, Journal of the Royal Statistical Society Series B-Methodological, vol.46, issue.3, pp.353-388, 1984.

]. M. Del40 and . Delbruck, Statistical ‡uctuations in autocatalytic reactions, J. Chem. Phys, vol.8, issue.1, pp.120-124, 1940.

H. [. Dupuis and . Ishii, SDEs with oblique re‡ection on nonsmooth domains, Annals of Probability, vol.1, issue.21, pp.554-580, 1993.

F. Dufour and T. Prieto-rumeau, Conditions for the Solvability of the Linear Programming Formulation for Constrained Discounted Markov Decision Processes, Applied Mathematics & Optimization, vol.48, issue.2, p.preprint, 2012.
DOI : 10.1007/s00245-015-9307-3
URL : https://hal.archives-ouvertes.fr/hal-01246228

[. Dufour and R. H. Stockbridge, On the existence of strict optimal controls for constrained, controlled Markov processes in continuous time, Stochastics An International Journal of Probability and Stochastic Processes, vol.6, issue.1, pp.55-78, 2012.
DOI : 10.1137/S0363012995295516
URL : https://hal.archives-ouvertes.fr/hal-00648221

S. Benoîte-de and F. Dufour, Numerical method for impulse control of piecewise deterministic Markov processes, Automatica J. IFAC, vol.48, issue.5, pp.779-793, 2012.

J. [. Dempster and . Ye, Generalized Bellman-Hamilton-Jacobi optimality conditions for a control problem with a boundary condition, Applied Mathematics & Optimization, vol.16, issue.3, pp.211-225, 1996.
DOI : 10.1007/BF01204702

H. [. Karoui, M. Nguyen, and . Jeanblanc-picqué, Compacti…cation methods in the control of degenerate di¤usions: existence of an optimal control, Stochastics, vol.20, issue.3, pp.169-219, 1987.

M. [. Fernández-cara and J. Garrido-atienza, On the approximate controllability of a stochastic parabolic equation with a multiplicative noise, Comptes Rendus de l'Acad??mie des Sciences - Series I - Mathematics, vol.328, issue.8, pp.675-680, 1999.
DOI : 10.1016/S0764-4442(99)80233-X

V. [. Finlay, I. Gaitsgory, and . Lebedev, Linear programming solutions of periodic optimization problems: approximation of the optimal control, J. Ind. Manag. Optim, vol.3, issue.2, pp.399-413, 2007.

S. [. Frankowska and . Plaskacz, Semicontinuous Solutions of Hamilton???Jacobi???Bellman Equations with Degenerate State Constraints, Journal of Mathematical Analysis and Applications, vol.251, issue.2, pp.145-161, 1998.
DOI : 10.1006/jmaa.2000.7070

]. H. Fra93 and . Frankowska, Lower semicontinuous solutions of Hamilton-Jacobi-Bellman equations, SIAM J. Control Optimization, vol.31, issue.1, pp.257-272, 1993.

W. H. Fleming and H. M. Soner, Controlled Markov processes and viscosity solutions, MR 94e:93004 [FV89] W. Fleming and D. Vermes, Convex duality approach to the optimal control of di¤usions, pp.1136-1155, 1989.

R. [. Frankowska and . Vinter, Existence of Neighboring Feasible Trajectories: Applications to Dynamic Programming for State-Constrained Optimal Control Problems, Journal of Optimization Theory and Applications, vol.35, issue.1, pp.20-40, 2000.
DOI : 10.1023/A:1004668504089

]. V. Gai92 and . Gaitsgory, Suboptimization of singularly perturbed control systems, SIAM J. Control and Optim, vol.30, issue.5, pp.1228-1249, 1992.

M. [. Gaitsgory and . Nguyen, Multiscale Singularly Perturbed Control Systems: Limit Occupational Measures Sets and Averaging, SIAM Journal on Control and Optimization, vol.41, issue.3, pp.954-974, 2002.
DOI : 10.1137/S0363012901393055

]. P. Goa09 and . Goatin, Analyse et approximation numèrique de quelques modèles macroscopiques de tra…c routier, 2009.

]. D. Gor08 and . Goreac, A Kalman-type condition for stochastic approximate controllability, C. R. Math. Acad. Sci. Paris, vol.346, p.93016, 2008.

M. [. Gaitsgory and . Quincampoix, Linear programming approach to deterministic in…nite horizon optimal control problems with discouting, SIAM J. Control Optimization, vol.48, issue.4, 2009.

S. [. Gaitsgory and . Rossomakhine, Linear Programming Approach to Deterministic Long Run Average Problems of Optimal Control, SIAM Journal on Control and Optimization, vol.44, issue.6, 2006.
DOI : 10.1137/040616802

]. G. Gra97 and . Grammel, Averaging of singularly perturbed systems, Averaging of singularly perturbed systems, 1997.

M. Anouar, A. Gassous, E. Rascanu, and . Rotenstein, Stochastic variational inequalities with oblique subgradients, STOCHASTIC PROCESSES AND THEIR APPLICATIONS, vol.122, issue.7, pp.2668-2700, 2012.

]. L. Grü02 and . Grüne, Asymptotic behavior of dynamical and control systems under perturbation and discretization, MR 2003d:37001 [GS11] L. Grüne and O.S. Serea, Di¤erential games and Zubov’s method, p.preprint, 2002.

W. [. Grüne, L. Semmler, and . Bernard, Firm value, diversi…ed capital assets , and credit risk: towards a theory of default correlation, J. Credit Risk, vol.3, pp.81-109, 2007.

L. [. Gautier and . Thibault, Viability for constrained stochastic di¤erential equations, Di¤erential Integral Equations, vol.6, issue.6, pp.1395-1414, 1993.

F. [. Grüne and . Wirth, Computing control Lyapunov functions via a Zubov type algorithm, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187), pp.2129-2134, 2000.
DOI : 10.1109/CDC.2000.914109

X. [. Huang, J. Li, and . Yong, A linear-quadratic optimal control problem for mean-…eld stochastic di¤erential equations in in…nite horizon, pp.1208-5308, 2012.

J. Hasty, J. Pradines, M. Dolnik, and J. J. Collins, Noise-based switches and ampli…ers for gene expression, PNAS, vol.97, issue.5, 2000.

R. Imbert, H. Monneau, and . Zidani, A Hamilton-Jacobi approach to junction problems and application to traffic flows, ESAIM: Control, Optimisation and Calculus of Variations, vol.19, issue.1, pp.129-166, 2013.
DOI : 10.1051/cocv/2012002
URL : https://hal.archives-ouvertes.fr/hal-00569010

]. N. Kry99 and . Krylov, Approximating value functions for controlled degenerate di¤usion processes by using piece-wise constant policies, Electron. J. Probab, vol.4, issue.2, pp.1-19, 1999.

]. N. Kry00 and . Krylov, On the rate of convergence of …nite-di¤erence approximations for Bellman’s equations with variable coe¢cients, Probab. Theory Related Fields, vol.117, issue.1, pp.1-16, 2000.

G. Thomas, R. H. Kurtz, and . Stockbridge, Existence of Markov controls and characterization of optimal Markov controls, SIAM J. Control Optim, vol.3699, issue.2, pp.609-653, 1998.

[. Liu and S. Peng, Infinite horizon backward stochastic differential equation and exponential convergence index assignment of stochastic control systems, Automatica, vol.38, issue.8, pp.1417-1423, 2002.
DOI : 10.1016/S0005-1098(02)00041-9

[. Liu and S. Peng, On controllability for stochastic control systems when the coefficient is time-variant, Journal of Systems Science and Complexity, vol.342, issue.2, pp.270-278, 2010.
DOI : 10.1007/s11424-010-8158-x

S. [. Lehrer and . Sorin, A Uniform Tauberian Theorem in Dynamic Programming, Mathematics of Operations Research, vol.17, issue.2, pp.303-307, 1992.
DOI : 10.1287/moor.17.2.303

]. M. Mal05 and . Maliso¤, Further results on Lyapunov functions and domains of attraction for perturbed asymptotically stable systems, Dyn. Contin. Discrete Impuls. Syst. Ser. A Math. Anal, vol.12, issue.2, pp.193-225, 2005.

]. R. Mer76 and . Merton, Option pricing when underlying stock returns are discontinuous, J. Financ. Econ, vol.3, pp.125-144, 1976.

]. M. Mot95 and . Motta, On nonlinear optimal control problems with state constraints, SIAM J. Control Optim, vol.33, pp.1411-1424, 1995.

M. Mnif and H. Pham, Stochastic optimization under constraints, Stochastic Process, Appl, vol.93, issue.1, pp.149-180, 2001.

G. [. Oliu-barton and . Vigeral, A Uniform Tauberian Theorem in Optimal Control, Advances in Dynamic Games Birkhäuser Boston, p.14, 2013.
DOI : 10.1007/978-0-8176-8355-9_10
URL : https://hal.archives-ouvertes.fr/hal-00661833

]. S. Pen94 and . Peng, Backward stochastic di¤erential equation and exact controllability of stochastic control systems Optimal stopping of controlled jump di¤usion processes: a viscosity solution approach, 274–284. [Pha98] Huyên Pham, pp.27-165014749043, 1994.

S. [. Pardoux and . Peng, Adapted solution of a backward stochastic differential equation, Systems & Control Letters, vol.14, issue.1, pp.55-61, 1990.
DOI : 10.1016/0167-6911(90)90082-6

M. [. Plaskacz and . Quincampoix, Value-functions for di¤erential games and control systems with discontinuous terminal cost, SIAM J. Control Optimization, vol.39, issue.5, 2001.

P. Shi-ge and X. H. Zhu, The viability property of controlled jump diffusion processes, Acta Math. Sin. (Engl. Ser.), vol.24, issue.8, pp.1351-1368, 2008.

M. Quincampoix and J. Renault, On the Existence of a Limit Value in Some Nonexpansive Optimal Control Problems, SIAM Journal on Control and Optimization, vol.49, issue.5, pp.2118-2132, 2011.
DOI : 10.1137/090756818

O. [. Quincampoix and . Serea, The problem of optimal control with re‡ection studied through a linear optimization problem stated on occupational measures, Nonlinear Analysis: Theory, pp.72-2803, 2010.

]. A. Ric09 and . Richou, Ergodic BSDEs and related PDEs with Neumann boundary conditions, Stochastic Processes and Their Applications, pp.2945-2969, 2009.

]. O. Ser02 and . Serea, Discontinuous di¤erential games and control systems with supremum cost, J. Math. Anal. Appl, vol.270, issue.2, pp.519-542, 2002.

]. E. Son83 and . Sontag, A Lyapunov-like characterization of asymptotic controllability Soner, Optimal control with state-space constraint, SIAM J. Control Optim. 462–471. MR I, SIAM J. Control Optim, vol.21, issue.24 6, pp.93015-552, 1983.

1. J. Ss80-]-e, R. J. Schmidt, and . Stern, Invariance theory for in…nite dimensional linear control systems, II, SIAM J. Control Optim. Applied Mathematics and Optimization, vol.24, issue.6 2, pp.113-122, 1980.

G. [. Sirbu and . Tessitore, Null controllability of an infinite dimensional SDE with state- and control-dependent noise, Systems & Control Letters, vol.44, issue.5, pp.385-394, 2001.
DOI : 10.1016/S0167-6911(01)00158-X

]. R. Sto90 and . Stockbridge, Time-average control of a martingale problem. Existence of a stationary solution, Ann. of Probability, vol.18, pp.190-205, 1990.

]. A. Tic52 and . Tichonov, Systems of di¤erential equations containing small parameter near derivatives, Mat. Sbornik, pp.31-575, 1952.

Q. [. Yin and . Zhang, Continuous-time Markov chains and applications. a singular perturbation approach, 1997.

X. [. Yong and . Zhou, Stochastic controls. hamiltonian systems and hjb equations, 1999.

]. A. Zal02 and . Zalinescu, Second-order Hamilton-Jacobi-Bellman inequalities, C.R. Acad

S. [. Zhu and . Peng, The viability property of controlled jump di¤usion processes, Acta Math. Sinica, vol.24, issue.8, 2008.