Distributed MPC for Large Scale Systems Using Agent-based Reinforcement Learning

In the present work, distributed control and artificial intelligence are combined in a control architecture for Large Scale Systems (LSS). The aim of this architecture is to provide a general structure and methodology to perform optimal control in networked distributed environments where multiple dependencies between sub-***systems are found. Often these dependencies or connections represent control variables so the distributed control has to be consistent for both subsystems and the optimal value of these variables has to accomplish a common goal. The aim of the research described in this paper is to exploit the attractive features of MPC (meaningful objective functions and constraints) in a distributed implementation combining learning techniques to perform the negotiation of these variables in a cooperative Multi Agent environment and over a Multi Agent platform to provide speed, scalability, and computational effort reduction. This approach is based on negotiation, cooperation and learning. Results of the application of this architecture to a small drinking water network show that the resulting trajectories of the levels in tanks (control variables) can be acceptable compared to the centralized solution. The application to a real network (the Barcelona case) is currently under development.