Markovian Demand Inventory Models

Inventory management is concerned with matching supply with demand and a central problem in Operations Management. The problem is to find the amount to be produced or purchased in order to maximize the total expected profit or minimize the total expected cost. Over the past two decades, several variations of the formula appeared, mostly in trade journals written by and for inventory managers. A critical assumption in the inventory literature is that the demands in different periods are independent and identically distributed. However, in real life, demands may depend on environmental considerations or the events in the world such as the weather, the state of economy, etc. Moreover, these events are represented by stochastic processes - exogenous or controlled.