Mini Review Volume 2 Issue 6
University of Yaounde I, Cameroon
Correspondence: Emmanuel Tonye, National Advanced School of Engineering, Yaounde, Cameroon
Received: January 09, 2017 | Published: June 19, 2017
Citation: Tonye E, Kabiena I. Evaluation of tomographic brain reconstruction techniques: case of the shepp-logan phantom. Int J Biosen Bioelectron. 2017;2(6):169–173. DOI: 10.15406/ijbsbe.2017.02.00042
Carcinogenic tumors are the leading cause of death in the world. When clinicians have excellent shot, they are able to detect a tumor early and eradicate it easily by chemotherapy or by simple surgery. We propose in this paper to compare different methods of tomographic reconstruction of the brain from the point of view of the quality of the image provided, in order to propose to the physicians the algorithms which guarantee them the best image results. We use two comparison metrics based on the PSNR (Peak Signal to Noise Ratio) and the HVS (Human Visual System). The association of these two objective and subjective criteria show that the methods which exploit the reconstruction of the samples by subset provide images of better quality.
Keywords: tumors, cancer, brain, image, quality, tomography, SVH, PSNR
PSNR, peak signal to noise ratio; HVS, human visual system; Fig, figure; SIRT, simultaneous iterative reconstruction technique; ART, algebraic reconstruction technique; ART-DS, algebraic tomographic reconstruction by selective discrimination; SIRT-DS, simultaneous iterative reconstruction technique by selective discrimination; ITU, international telecommunication union; SSCQS, single stimulus continuous quality scale; IC, confidence interval; MOS, mean opinion score
Positron emission tomography is based on the reconstruction of sections of the interior of the human body after injection or ingestion of an active radio isotope. This radioactive isotope, generally the 18F will interact with the human cells specific to the organ we wish to observe, and emit two diametrically opposed gamma (γ) photons.1 A detection ring is then used to detect these photons (Figure 1).2 By measuring a certain number of photon pairs, it will be possible, via mathematical techniques, to obtain an image estimating the overall distribution of the emission sites of these photons. Several reconstruction techniques exist in the literature: analytical methods and iterative methods.3-5 The deterministic iterative methods which allow a better quantification of the noise have been implemented in the framework of this work, the most successful methods are the ART method6-7 in its variants ART-DS,7 kaczmarz,8 Sym-Kaczmarz,9 and the SIRT method10 in its SIRT-DS11 and Cimmino10 variants. These iterative methods consist in the correction of the reconstructed image f by successive iterations. At each iteration k, the error between f(k) and f(k-1) must be as small as possible in order to allow the convergence of the algorithm.
General principle of ART methods
The mathematical expression of the correction according to the ART (Algebraic Reconstruction Technique) method is easily obtained from the equation of the projection of a point on a hyperplane (Figure 2):
Figure 1
(1A): Real tomograph, clinical practice of tomographic examination.
(1B): Source: Military Hospital of Val de Grace.
(1)
This equation is interpreted as follows: each component i of the vector f(k) at the iteration k is corrected by adding to the value fi(k-1) obtained at the preceding iteration a coefficient which is 0 if the Radius j used for correction does not cross point xi (in this case Rji is 0) and is otherwise proportional to the difference between the data pj (the true projection) and the projection recalculated from f (k-1) equal to Rjf (k-1) .The normalization coefficient ‖R_j ‖2 is the norm of the row of the matrix R corresponding to the data j, that is to say in the simple case considered here it is equal to the number of pixels traversed by the ray j. In short, the radius j makes it possible to correct all the pixels that it traverses. At each iteration, a different ray is chosen, for example according to the following rule:
j = k[m]. m ∈IN (2)
When the system p = Rf admits at least one solution, the algorithm converges to the minimum variance solution when it is initialized to 0. On the other hand, when the data is noisy, the system may have no solution and a phenomenon of oscillations occurs.7
General principle of SIRT methods
The SIRT (Simultaneous Iterative Reconstruction Technique) method consists in performing the correction of each fi by using all the ray passing through xi (Figure 3). The equation for evaluating f(k) by correction of f (k-1) is as follows:
= (3)
The summation covering all the indices j such that the radius j crosses the pixel xi. This method is slower than ART and requires more memory.10 The variants of these two methods involve for some a relaxation parameter (sym-kaczmarz, cimmino), and for the others a reconstruction of the fi in subsets (ART-DS, SIRT-DS).
Methods of comparison
To evaluate qualitatively the capacity of each of these different variants to faithfully reconstruct a cut, let's reconstruct a section of the human brain. To do this, we will use the Shepp-Logan phantom (Figure 4), a digital image of synthesis used in tomographic research to model the brain.12 We will then use an objective criterion (PSNR) and a subjective criterion based on the human visual system (SVH), to compare the performances of the different methods.
Objective criterion: The PSNR: This type of metric is very widely used to numerically quantify the quality of reconstruction of an image. The signal-to-noise peak evaluates the distortion between the desired image and that reconstructed by the formula:
(4)
Where D is the image definition domain, f (x, y) the pixel of coordinates (x, y) of the reference image, and G (x, y) the pixel of coordinates (x, y) of the processed image. The effectiveness of this metric is only assured when it is associated with a subjective criterion based on validation by the human eye.13 In our results, we will use Student's statistical test14 for matched samples to show that there is a significant difference between the methods presented. The Student test for matched observations is used to compare the mean of two populations, each element of one of the populations being related to one element of the other. For example, it is possible to compare two treatments, the data being considered as pairs of observations (first observation of the pair receiving treatment 1 and second observation receiving treatment 2). Let xij be the observation j for the pair i (j = 1,2 and i = 1,2, ..., n). For each pair of observations the difference di = xi2 - xi1 is calculated. The statistical test is defined by:
(5)
Where n is the number of pairs of observations, is the average of the differences between observations,and Sd² the variance. More details on the use of this test are presented in.14
Subjective criterion: simple stimulus protocol: Considered as the most reliable means of measuring the real quality, the subjective evaluation calls directly to the human observer. The human observer is required to judge the quality of the images presented to him according to a grid of evaluation with several levels of appreciation. At the end of these tests, a subjective score called MOS (Mean Opinion Score) is obtained. When carrying out these tests, it is important to pay particular attention to certain factors that may affect the participant’s judgments, such as: observation distance, viewing conditions such as surrounding lighting, Screen calibration, image selection, psychological factors, and the nature of the observers. Different subjective assessment methods have been defined by the ITU (International Telecommunication Union).15 There are basically three main families: simple stimulus tests to judge image quality without any information about the original image. Dual stimulus tests where the observer is asked to judge the similarity between two images and the comparative tests whose main objective is to compare two or more stimuli. We present in the following the simple stimulus protocol that was chosen for this exercise, given its approximation with the clinical context of our experiment.
The Single Stimulus Continuous Quality Scale (SSCQS) method allows one to judge the quality of one stimulus at a time (without reference). It should be noted that the mode of presentation, illustrated in Figure 5, is thus limited. The images are presented one by one with a latency time between two presentations. This time allows the observer to assess the quality of the image. Scales with 5, 6, 7 or 100 levels of appreciation can be used. Table 1 presents an example of a scale which is widely used to validate a quantitative or objective metric.
Five-Point Scale Quality |
||
---|---|---|
Quality |
Degradation |
|
Excellent |
5 |
Imperceptible |
Good |
4 |
Perceptible but not annoying |
Fairly good |
3 |
Slightly annoying |
Poor |
2 |
Embarrassing |
Bad |
1 |
Very annoying |
Table 1 Example of rating scale
To evaluate our results, we will apply an objective measure based on the PSNR value obtained for each method and then the human eye will be used as a subjective measure in order to validate the objective measure. The experiments were carried out on a computer with two processors and the software MATLAB 7.5.0342 (R2007b) was used to program and compile our algorithms.
Objective evaluation
We have applied to the image of the human brain of Figure 2 the methods ART-DS, SIRT-DS, Kaczmarz, Sym-kaczmarz, Cimmino, over a noise range of 0 to 15% in 0.5% steps. The evolution of the PSNR as a function of the noise is given by Figure 6: As first observation, it emerges that the PSNR decreases with the increase of the noise. It is also noted that over all this noise range, the curves of the SIRT-DS and ART-DS methods are on top of the others, demonstrating that the quality of the reconstructed image is better with these two methods. This difference is significant from 0 to 2% and from 4 to 15% of noise. For a noise level of 5%, Figure 7 shows the image of the corresponding brain reconstructed by the above methods:
Figure 7 Cut of a non-noisy brain (a) and reconstructed at 5% level of noise by methods ART-DS (b), SIRT-DS (c), kaczmarz (d) and sym-kaczmarz (e), with presence of tumor.
Figure 7 (A) shows the cut of the desired brain, without noise, with the presence of a tumor in red. At a noise level 5%, the tumor remains detectable (weakly) in the brain for the ART-DS (b) methods at 24.8 dB and SIRT-DS (c) at 21 dB, but much less visible for the methods Kaczmarz (d) at 18.1 dB and sym-kaczmarz (e) at 15.5 dB. Since the Cimmino method has the worst results of the objective criterion, it will not be used in the subsequent tests. The evolutionary curve of the PSNR of the SIRT-DS method is below that of the ART-DS method, while for the other methods it is the kaczmark approach that is at the top. Also, by applying the student test between the SIRT-DS and kaczmarz methods, we can also conclude on the consistency of the difference between the ART-DS, SIRT-DS techniques and the other methods. Also, by varying the noise from 0 to 15% in steps of 0.5%, the number of samples is greater than or equal to 30. Table 2 shows the student test results between the SIRT-DS and kaczmarz methods.
Characteristics of Variables |
Student Test for Matched Samples |
|||||
---|---|---|---|---|---|---|
Variables |
Minimum |
Maximum |
Average |
Standard Deviation |
|T| |
|
PSNR SIRT-DS (dB) |
16,80 |
35,70 |
21,29 |
5,75 |
21,21 |
2,045 |
PSNR Kaczmarz (dB) |
13,60 |
31 |
18,29 |
5,83 |
Table 2 Comparison of the PSNR of the SIRT-DS and Kaczmarz methods for the Logan phantom.
| t|: Absolute value of the Student test for matched samples; ddl: degree of freedom; : Order quantile m at n ddl
It appears that the SIRT-DS method is better than the Kaczmarz method. Indeed, the mean number of PSNR for the SIRT-DS method (21,29 dB) is higher than that obtained for the Kaczmarz method (18,29 dB). The Student test for the comparison of two means from two matched samples shows that there is a significant difference between the mean numbers of PSNR for these two methods. It is therefore generally understood that the ART-DS and SIRT-DS techniques are better than the other methods in terms of the quality of the image solution provided.
Subjective evaluation
We have applied the simple stimulus protocol to a population of 50 individuals (doctors). Participants with pathologies of the eye were excluded. The images have been received on their mobile phones and they have been recommended to observe the following guidelines in order to obtain the most reliable evaluation possible:
For reconstructed cuts of the brain, the observers had to attribute a note to the image between 1 and 5 according to the grid of appreciation described in Table 1, for different Algorithms (ART-DS, SIRT-DS, Kaczmarz, Sym-Kaczmarz, the Cimmino method will not be used in this test given the results it provided in the objective assessment) at three distinct noise levels (without, 2%, 5%); Table 3 presents the mean score (MOS) as well as the 95% confidence interval (IC) associated with this mean for each method and for a given noise level. Without additive noise, the mean scores of the ART-DS and SIRT-DS methods resulting from the subset treatments are higher than the mean scores of the Kaczmarz and Sym-kaczmarz methods which obtain similar scores and intervals of confidence almost identical to one another. At this level of noise, the vast majority of the participants manage to locate the tumor zone.
Method |
Without Additive Noise |
With 2% of Additive Noise |
With 5% of Additive Noise |
|||
---|---|---|---|---|---|---|
Mean Score |
IC à 95% |
Mean Score |
IC à 95% |
Mean Score |
IC à 95% |
|
ART-DS |
4,24 |
[4,04; 4,44] |
3,74 |
[3,58 ; 3,90] |
2,92 |
[2,72 ; 3,12] |
SIRT-DS |
4,08 |
[3,85; 4,30] |
3,5 |
[3,34 ; 3,66] |
2,5 |
[2,25 ; 2,75] |
Kaczmarz |
3,96 |
[3,75 ; 4,17] |
3 |
[2,79 ; 3,20] |
1,94 |
[1,71 ; 2,17] |
Sym-Kaczmarz |
3,98 |
[3,75 ; 4,20] |
2,96 |
[2,80 ; 3,12] |
1,78 |
[1,57 ; 1,98] |
Table 3 Mean score and associated IC for each method at different noise levels
With additive noise of the order of 2%, the difference between the ART-DS, SIRT-DS and Kaczmarz, Sym-kaczmarz methods becomes most important. The ART-DS and SIRT-DS approaches keep the best MOS, while the first difficulties of interpretations arise for the Sym-kaczmarz method which obtains a MOS of 2.96. At 5% of additive noise, which represents the maximum noise threshold for our experiment, the MOS show as a whole that for all approaches, the degradation is perceptible. However, the ART-DS and SIRT-DS methods give rise to a tolerance for high noise levels. It emerges that whatever the level of noise considered, the Shepp-Logan phantom representing a section of the brain with tumor, reconstructed by the Methods ART-DS and SIRT-DS receive on average better assessments.
We have demonstrated in this paper, starting from the exploitation of two objective and subjective criteria, that it is judicious for oncologists who give priority to good quality images, to opt for methods based on subset reconstruction like SIRT-DS and ART-DS, instead of other deterministic iterative methods, since they make it possible to detect start of tumors in the encephalon at high levels of noise. However, it is still necessary to validate these results in clinical practice on real subjects.
None.
The author declares no conflict of interest.
©2017 Tonye, et al. This is an open access article distributed under the terms of the, which permits unrestricted use, distribution, and build upon your work non-commercially.