|
Abstract : |
We consider the problem of call admission control and routing in an in tegrated services network that handles several classes of calls of dioeerent value and with dioeerent resource requirements. The problem of maximizing the average value of admitted calls per unit time (or of revenue maximiza tion) is naturally formulated as a dynamic programming problem, but is too complex to allow for an exact solution. We use methods of neuro-dynamic programming (reinforcement learning), together with a decomposition ap proach, to construct dynamic (state-dependent) call admission control and routing policies. These policies are based on state-dependent link costs, and a simulation-based learning method is employed to tune the parameters that dene these link costs. A broad set of experiments shows the robustness of our policy and compares its performance with a commonly used heuristic. 1, |
