Maintenance optimisation of a series production system with intermediate buffers using a multi-agent FMDP

Highlights: • The maintenance of medium-size series production systems with buffers is optimised. • The multi-agent FMDP is adopted during the maintenance optimisation. • An ALP algorithm is developed to solve the FMDP model efficiently. • An efficient algorithm of cooperative action selection is proposed. Maintenance decision making of a series production system with intermediate buffers is a research topic of practical significance. The Markov decision process (MDP) is an effective tool to undertake maintenance optimisation of a series production system with buffers due to its capacity in dealing with complex structure of maintenance strategies for such systems. However, the MDP has only been employed to analyse small systems due to the "curse of dimensionality". A multi-agent factored Markov decision process (FMDP) is adopted in this study to remit the "curse of dimensionality". The series production system considered in the study consists of several subsystems, and each subsystem is managed by an agent. A new method is developed to select maintenance actions in cooperation of different agents. An approximate linear programming algorithm is used to solve the FMDP model efficiently. The numerical study shows that the developed methods can deal with medium-scale series production systems with an insignificant small error in maintenance decision making.