The JET Intershot Analysis: Current Infrastructure and Future Plans

This series of slides covers JET experience of managing Chain-1, it deals with the description of the current infrastructure, then with the extensions planned to meet growing needs of JET and finally with the lessons learned for future experiments. The main disadvantages of the current infrastructure are the absence of status information or control to master node during step execution and the load balancing that is simply based on the number of running jobs which is not always optimal. The now task scheduler allows a load balancing based on current and projected Cpu use. The new Chain-1 monitor and the proposed Chain-1 database are detailed. The feedback experience of Chain-1 managing shows that we have to: -) Consider both software quality and integrity of the output data; -) Provide a flexible framework for integrating externally developed codes; -) Look at the full data life-cycle as a single work-flow; -) Take into account that data production and analysis complexity are continuously increasing and that software and hardware infrastructure must be flexible to adapt for future needs