3.3.5 Barrier

Synchronization of all processes .

• Each of the operations in 3.3.1-3.3.4 works as a barrier.
• Artificial construction of a barrier,
  e.g., via CUBE/SMALL>_DOI($1$,$I$,$J$,$K$,$ViPlus$)
• Most parallel algorithms contain quite naturally a barrier, because at any point in the algorithm a global data exchange (e.g. accumulation) is necessary.