Successive over-relaxation method - SOR

From CFD-Wiki

Introduction

We seek the solution to set of linear equations

$A \phi = b.$

In matrix terms, the successive over-relaxation (SOR) iteration can be expressed as

$\phi^{(k+1)} = \left( {D - \omega L} \right)^{ - 1} \left( {\omega U + \left( {1 - \omega } \right)D} \right)\phi^{(k)} + \omega \left( {D - \omega L} \right)^{ - 1} b$

where $D$ , $L$ , and $U$ represent the diagonal, lower triangular, and upper triangular parts of the coefficient matrix $A$ , $k$ is the iteration count, and $\omega$ is a relaxation factor. This matrix expression is not usually used to program the method, and an element-based expression is used:

$\phi^{(k+1)}_i = (1-\omega)\phi^{(k)}_i+\frac{\omega}{a_{ii}} \left(b_i - \sum_{j<i}a_{ij}\phi^{(k+1)}_j-\sum_{j>i}a_{ij}\phi^{(k)}_j\right),\, i=1,2,\ldots,n.$

Note that for $\omega = 1$ that the iteration reduces to the Gauss-Seidel iteration. As with the Gauss-Seidel method, the computation may be done in place, and the iteration is continued until the changes made by an iteration are below some tolerance.

The choice of relaxation factor is not necessarily easy, and depends upon the properties of the coefficient matrix. For symmetric, positive definite matrices it can be proven that $0<\omega<2$ will lead to convergence, but we are generally interested in faster convergence rather than just convergence.