Some random programs to getting used to scipy's stats module
Simple mm1 queue
A custom model, with c servers and 2 passes.
In the first pass, the process goes to one of the server
with probability p_i for each i server. After first pass is over,
in the second pass, we have a probability matrix which decide what is
the probability of a process coming from server i to go to server j
First attempt to start with an initial state
- Making soft inequalities for calculating Queue Size
- Thus in Actor critic I can make reference time as arrival_time[sum_of_state]
Made function setupNextState function which basically starts mm1 simulation for actor_critic with a given initial state
Optimized it
Final actor critic