Multiscale Medical Image Fusion in Wavelet Domain

Abstract

Wavelet transforms have emerged as a powerful tool in image fusion. However, the study and analysis of medical image fusion is still a challenging area of research. Therefore, in this paper, we propose a multiscale fusion of multimodal medical images in wavelet domain. Fusion of medical images has been performed at multiple scales varying from minimum to maximum level using maximum selection rule which provides more flexibility and choice to select the relevant fused images. The experimental analysis of the proposed method has been performed with several sets of medical images. Fusion results have been evaluated subjectively and objectively with existing state-of-the-art fusion methods which include several pyramid- and wavelet-transform-based fusion methods and principal component analysis (PCA) fusion method. The comparative analysis of the fusion results has been performed with edge strength ( $Q$ ), mutual information (MI), entropy ( $E$ ), standard deviation (SD), blind structural similarity index metric (BSSIM), spatial frequency (SF), and average gradient (AG) metrics. The combined subjective and objective evaluations of the proposed fusion method at multiple scales showed the effectiveness and goodness of the proposed approach.

This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

1. Introduction

The development of multimodality medical imaging sensors for extracting clinical information has influenced to explore the possibility of data reduction and having better visual representation. X-ray, ultrasound, magnetic resonance imaging (MRI), and computed tomography (CT) are a few examples of biomedical sensors. These sensors are used for extracting clinical information, which is generally complementary in nature. For example, X-ray is widely used in detecting fractures and abnormalities in bone position, CT is used in tumor and anatomical detection, and MRI is used to obtain information about tissues. Thus, none of these modalities is able to carry all complementary and relevant information in a single image. Medical image fusion [1, 2] is the only possible way to combine and merge all relevant and complementary information from multiple source images into single composite image which facilitates more precise diagnosis and better treatment.

The basic requirements for image fusion [3] are as follows: first, fused image should possess all possible relevant information contained in the source images; second, fusion process should not introduce any artifact or unexpected feature in the fused image.

Image fusion can be classified into three categories: pixel level fusion, feature level fusion, and decision or symbol level fusion [4]. Pixel level fusion [5] deals with information associated with each pixel and fused image can be obtained from the corresponding pixel values of source images. In feature level fusion [6], source images are segmented into regions and features like pixel intensities, edges, and textures, are used for fusion. Decision or symbol level fusion [7] is a high-level fusion which is based on statistics, voting, fuzzy logic, prediction and heuristics, and so forth. For present work, we have considered pixel level image fusion due to its simple computation and understanding.

Spatial and transform domains [8] are the two fundamental approaches for image fusion. In spatial domain fusion, the fusion rule is directly applied to the intensity values of the source images. Averaging, weighted averaging, principal component analysis (PCA) [9], linear fusion [10], and sharp fusion [11] are a few examples of spatial domain fusion scheme. One of the major disadvantages of spatial domain fusion method is that it introduces spatial distortions in the resultant fused image and does not provide any spectral information. These spatial distortions have been observed in sharp fusion [11] method for medical images and reported in [12]. Since medical images are generally of poor contrast, the spatial information should be preserved in the medical images without introducing any distortion or noise. These requirements of medical images are better preserved in transform domain fusion.

Therefore, transform domain fusion techniques have been used for fusion to overcome the limitations of spatial domain fusion methods. Pyramid and wavelet transforms [13] have been used for multiscale fusion under category of transform domain methods. Transform domain fusion is performed by decomposing source images into transformed representations followed by application of fusion rules to the transformed representation. Finally, fused image is obtained by inverse transformation. Pyramid and wavelet transforms are the mostly used transforms for image fusion. Several pyramid transforms like Laplacian pyramid [14], gradient pyramid [15], contrast pyramid [16], ratio of low pass pyramid [17], morphological pyramid [18], and FSD pyramid [19] have been used for image fusion. However, pyramid transform based fusion methods suffered from blocking effect [20] in the regions where the input images are significantly different. Further, pyramid-transform-based fusion methods do not provide any directional information and have poor signal-to-noise ratio. In contrast to pyramid transforms, wavelet transforms have better representation of detailed features of image; hence, wavelet domain fusion methods provide better results than pyramid-based fusion methods.

The discrete wavelet transform (DWT) is the most commonly used wavelet transform for medical image fusion. A simple DWT-based medical image fusion, which follows weighted fusion rule, has been introduced by Cheng et al. [21]. Another pixel- and region-based multiresolution image fusion for MRI and CT image is discussed in [22]. Several literatures on medical image fusion using DWT can be easily found in [23–30] which use different fusion rules for merging multimodality medical images. Some advanced wavelet families such as contourlet transform, curvelet transform, and nonsubsampled contourlet transform [31] have been used for medical image fusion and it has been stated that these advanced wavelet families have better performance than wavelet transforms. However, these are computationally costly and require huge memory. Further, the study and analysis of DWT for medical image fusion has not been studied well and it still needs attention of researchers.

Since estimation of decomposition levels for a wavelet transform [32] has always been challenging and literatures on multilevel medical image fusion [33] have been a motivation for us to explore DWT for multiscale image fusion, therefore, in this work, we have used DWT for multimodality medical image fusion and presented a new multiscale fusion approach using maximum selection rule. The multiscale fusion approach provides us flexibility to select appropriate fused medical image. The experiments have been performed over several multimodality medical images at multiple scales. The fusion results have been compared with other state-of-the-art fusion methods which include several pyramid- and wavelet-transform-based fusion methods and PCA fusion method. The quantitative analysis of the fusion results has been performed with edge strength ( $Q$ ), mutual information (MI), entropy ( $E$ ), standard deviation (SD), blind structural similarity index metric (BSSIM), spatial frequency (SF), and average gradient (AG) metrics.

The rest of the paper is organized as follows. Section 2 explains the basics of DWT and its usefulness in image fusion. The proposed fusion method is explained in Section 3. Fusion results and evaluations are given in Section 4. Finally, conclusions of the work are given in Section 5.

2. Wavelet Transform and Image Fusion

Recently, wavelet transforms have emerged as a powerful signal and image processing tool which provides an efficient way of fusion using multiresolution analysis [34]. This section explains the basics of DWT and its usefulness in image fusion.

The DWT of a given signal $F(x)$ is performed by analysis and synthesis of signal using scaling function $\varphi (x)$ and wavelet function $\psi (x)$ [35, 36]. The basic equation of multiresolution theory is the scaling equation $$\begin{array}{}\text{(1)}& \varphi \left(x\right)=\sqrt{\mathrm{2}}{\displaystyle \sum }_k^{}l\left(k\right)\varphi \left(\mathrm{2}x-k\right),\end{array}$$ where $l(k)$ ’s are the approximation or low-pass coefficients and $\sqrt{\mathrm{2}}$ maintains the norm of the scaling factor by a factor of two.

The wavelet function $\psi (x)$ which is responsible for computing high-frequency or detailed coefficients is given by $$\begin{array}{}\text{(2)}& \psi \left(x\right)=\sqrt{\mathrm{2}}{\displaystyle \sum }_k^{}h\left(k\right)\varphi \left(\mathrm{2}x-k\right),\end{array}$$ where $h(k)$ ’s are the high frequency or detailed wavelet coefficients.

Signal decomposition is performed using the scaling coefficients $l(k)$ and the wavelet coefficients $h(k)$ . Forward wavelet analysis of signal $F(x)$ at any scale $J$ is denoted by $$\begin{array}{}\text{(3)}& F\left(x\right)={\displaystyle \sum }_k^{}C\left(j,k\right){\varphi }_{j,k}\left(x\right)+{\displaystyle \sum }_j^{}{\displaystyle \sum }D\left(j,k\right){\psi }_{j,k}\left(x\right),\end{array}$$ where $C(j,k)$ and $D(j,k)$ are scaling and wavelet coefficients at scale $J$ and can be computed by following relation: $$\begin{array}{c}\text{(4)}& C\left(j,k\right)={\displaystyle \sum }_k^{}l\left(k-\mathrm{2}m\right)C\left(j+\mathrm{1},k\right),D\left(j,k\right)={\displaystyle \sum }_k^{}h\left(k-\mathrm{2}m\right)C\left(j+\mathrm{1},k\right).\end{array}$$

Reconstruction of signal can be made by combining scaling and wavelet coefficients, and mathematically, it is represented by $$\begin{array}{}\text{(5)}& C\left(j+\mathrm{1},k\right)={\displaystyle \sum }_k^{}C\left(j,k\right)l\left(m-\mathrm{2}k\right)+{\displaystyle \sum }_k^{}D\left(j,k\right)h\left(m-\mathrm{2}k\right).\end{array}$$

The forward and backward analysis of signals provides us the facility to have multiscale signal representations at varying scales. Further, DWT analysis is capable of providing three spatial orientations, namely, horizontal, diagonal, and vertical. This can be denoted by the following combination of scaling and wavelet functions: $$\begin{array}{c}\text{(6)}& {\varphi }_{\text{LL}}\left(x,y\right)=\varphi \left(x\right)\varphi \left(y\right),{\psi }_{\mathrm{LH}}\left(x,y\right)=\varphi \left(x\right)\psi \left(y\right),\\ {\psi }_{\text{HL}}\left(x,y\right)=\psi \left(x\right)\varphi \left(y\right),\\ {\psi }_{\text{HH}}\left(x,y\right)=\psi \left(x\right)\psi \left(y\right).\end{array}$$

The two-dimensional decomposition process using DWT is shown in Figure 1. This can be easily seen that a 2D-DWT provides multiscale representation at different levels. Figure 1(a) shows the DWT decompositions up to level 3, and Figure 1(b) shows the two-level decomposition of Lena image.

[figures omitted; refer to PDF]

This wavelet decomposition is exploited for image fusion and could be easily understood from Figure 2. The DWT provides an efficient way for performing image fusion at multiple scales with several advantages. These are as follows.

[figure omitted; refer to PDF]

Locality. The information of an image is represented by wavelet coefficients, which is local in space and frequency. Thus, for fusion, we can apply fusion rule locally and that would not affect the other portions of the image.

Multiresolution Analysis. The image can be represented at different scales, and this allows producing fused images at multiple levels [33].

Edge Detection. Wavelet transform can act as local edge detectors. The edges in the image are represented by large wavelet coefficients at the corresponding locations, while noise is generally represented by smaller values. Wavelet transform represents three directional edges: vertical, horizontal, and diagonal. This property helps in preserving the edges and implementation of edge-sensitive fusion methods.

Decorrelation. Most of the wavelet coefficients of an image tend to be approximately decorrelated; that is, dependencies between wavelet coefficients are predominantly local. Thus, during the fusion process if there is some change in wavelet coefficients, then generally this would not affect the other portions of image. This allows applying fusion rule on selected wavelet coefficients without affecting other parts of the image.

Energy Compaction. In wavelet domain, the most essential information of the image is compressed into relatively few large coefficients, which coincides with the area of major spatial activity (edges, corners, etc.). This property facilitates the implementation of energy-based fusion rules which preserve the salient features of images.

3. The Proposed Fusion Approach

The usefulness of DWT made it suitable for medical image fusion, where one wishes to capture all relevant information from a single fused image with reduced cost and storage overhead. The proposed fusion approach follows the framework shown in Figure 2; decomposition was followed by application of fusion rule and reconstruction. We have exploited the concept of multiresolution analysis with multiscale fusion approach. The higher the scale is the more the detailed information is captured from source images to fused image. Since medical images are of poor contrast, more detailed and relevant information should be preserved. Thus, by varying scale, we have flexibility to select appropriate fused image for further operations. For the proposed fusion scheme, we vary the scale from minimum to maximum levels. One of the important issues is the selection of wavelet for decomposition. Regularity, number of vanishing moment, and finite support are the few important criteria for selecting mother wavelet [37]. However, it was shown in [31] that short filter banks for wavelet decomposition are useful and works well for fusion. Also, [38] shows the effectiveness of selecting short length wavelet with a fixed criterion. In both cases, “db3” wavelet has been found suitable for decomposition; therefore, we used “db3” wavelet for the proposed fusion scheme.

The proposed fusion approach is based on the maximum selection scheme as high-valued wavelet coefficients carry salient information such as edges, boundaries, and contours. Therefore, the absolute values of wavelet coefficients have been used for deciding fused wavelet coefficients. For two-source medical images $I_{\mathrm{1}}(x,y)$ and $I_{\mathrm{2}}(x,y)$ , the steps of the proposed fusion scheme are as follows.

(i) Decompose source images using DWT: $$\begin{array}{c}\text{(7)}& W_{\mathrm{1}}^l\left(x,y\right)=\text{DWT}\left[I_{\mathrm{1}}\left(x,y\right)\right],W_{\mathrm{2}}^l\left(x,y\right)=\text{DWT}\left[I_{\mathrm{2}}\left(x,y\right)\right],\end{array}$$ where $W_{\mathrm{1}}^l(x,y)$ and $W_{\mathrm{2}}^l(x,y)$ are the wavelet coefficients of source images $I_{\mathrm{1}}(x,y)$ and $I_{\mathrm{2}}(x,y)$ at scale $l$ .

(ii) Calculate fused wavelet coefficients $W_F^l(x,y)$ at scale $l$ by following the expression: $$\begin{array}{}\text{(8)}& W_F^l\left(x,y\right)=\{\begin{array}{cc}{W}_{\mathrm{1}}^l\left(x,y\right),\hfill & \text{if}\hspace{0.17em}\left|W_{\mathrm{1}}^l\left(x,y\right)\right|\ge \left|W_{\mathrm{2}}^l\left(x,y\right)\right|\hfill \\ W_{\mathrm{2}}^l\left(x,y\right),\hfill & \text{if}\hspace{0.17em}\left|W_{\mathrm{2}}^l\left(x,y\right)\right|>\left|W_{\mathrm{1}}^l\left(x,y\right)\right|.\hfill \end{array}\end{array}$$

(iii) Reconstruct fused image $F^l(x,y)$ at scale $l$ using inverse DWT: $$\begin{array}{}\text{(9)}& F^l\left(x,y\right)=\text{IDWT}\left[W_F^l\left(x,y\right)\right].\end{array}$$

4. Fusion Results and Discussions

In this section, we have shown fusion results for the proposed method. The fusion results have been shown for three sets of medical image pairs of size 256 × 256 shown in Figures 3(a), 3(b), 4(a), 4(b), 5(a), and 5(b), respectively. The proposed method has been experimented at multiple scales varying from level 2 to level 8 (maximum level of scale) for these medical images. We have performed subjective and objective comparisons to evaluate fusion results obtained by the proposed method. To perform subjective comparison, we have selected gradient pyramid (GP), contrast pyramid (CP), ratio pyramid (RP), PCA, DWT with DBSS, and SIDWT with Haar fusion methods which are available on http://www.metapix.de/ and provided by Rockinger [39].

[figures omitted; refer to PDF]

[figures omitted; refer to PDF]

[figures omitted; refer to PDF]

For objective evaluation of proposed fusion approach with other state-of-the-art fusion methods, nonreference metrics are required as no ground truth image is available for comparison. Therefore, we have used nonreference metrics, namely, edge strength ( $Q$ ), mutual information (MI), entropy ( $E$ ), standard deviation (SD), blind structural similarity index metric (BSSIM), spatial frequency (SF), and average gradient (AG) for objective evaluation of our work.

The illustration of fusion results is separately given in Sections 4.1 and 4.2 for subjective and objective evaluations, respectively.

4.1. Subjective Evaluation

The first set of medical images is brain CT and MRI, shown in Figures 3(a) and 3(b). It can be easily seen that the CT image shows the edgy structure while MRI provides information about soft tissues. The results for proposed multiscale fusion method have been shown in Figures 3(c)–3(i) from level 2 to level 8. These results show the variations in contrast of fused image as level progresses. On comparing the obtained fused images from level 2 to level 8 (shown in Figures 3(c)–3(i)) with GP, CP, RP, and PCA fused images, which are shown in Figures 3(j)–3(m), it can be easily concluded that the proposed method outperforms these fusion methods and has good visual representation of fused image. The fused images with GP, CP, RP, and PCA methods are not able to capture the information from CT and MRI pairs. Further, the proposed method has the better quality than DWT with DBSS and nearly same with SIDWT with Haar fusion methods.

The second set of medical images is magnetic resonance angiogram (MRA) and T1-MR image which is shown in Figures 4(a) and 4(b). The comparison of proposed fusion results with GP, CP, RP, PCA, DWT with DBSS, and SIDWT with Haar fusion methods, shown in Figures 4(c)–4(o), clearly implies that the fused images with proposed method have better quality and contrast in comparison to other fusion methods.

Similarly, on observing the third set of medical images (CT and MRI) and fusion results for these images which are shown in Figures 5(a)–5(o), one can easily verify the fact that again the proposed method has been found superior in terms of visual representation over GP, CP, RP, PCA, DWT with DBSS, and SIDWT with Haar fusion methods.

4.2. Objective Evaluation

For objective evaluation of the fusion results, shown from Figures 3–5, we have used seven nonreference fusion metrics: edge strength ( $Q$ ) [40], mutual information (MI) [41], entropy ( $E$ ) [9, 12, 27], standard deviation (SD) [12, 27], blind structural similarity index metric (BSSIM) [33], spatial frequency (SF) [9, 33], and average gradient (AG) [27]. These metrics are well defined in the literature and are used excessively for objective evaluation of fusion results. Higher values of these metrics imply better fused result. We have computed the values of fusion results and tabulated them in Tables 1–3 for fusion results shown in Figures 3–5, respectively.

Table 1

Quantitative evaluation of fusion results for the first set of medical images.

Fusion method	Q	MI	E	SD	BSSIM	SF	AG
Proposed method—level 2	0.7286	2.1396	5.9335	32.9163	0.5251	9.9138	3.7456
Level 3	0.6675	1.6705	6.0177	32.9062	0.5121	10.3127	3.9258
Level 4	0.6097	1.3475	6.1343	32.9446	0.4931	10.4907	4.0249
Level 5	0.5844	1.3666	6.1673	33.7868	0.4856	10.5698	4.0154
Level 6	0.5871	1.3352	6.2107	33.7941	0.4815	10.5912	4.0377
Level 7	0.5862	1.3137	6.2215	33.7733	0.4805	10.5952	4.0422
Level 8	0.5863	1.3204	6.2225	33.7558	0.4799	10.5947	4.0434
GP	0.5784	1.0243	5.4698	19.7350	0.4793	6.6479	2.3911
CP	0.2542	0.9452	1.9243	33.3962	0.5000	14.5826	2.7348
RP	0.2658	0.9901	3.5655	33.1739	0.4794	14.6512	2.9503
PCA	0.6395	2.6305	5.6220	28.3806	0.5371	6.9945	2.6799
DWT with DBSS	0.4269	1.0342	5.5227	22.8441	0.4429	8.7605	3.1299
SIDWT with Haar	0.7014	1.1510	5.3313	25.6650	0.4816	9.4682	3.3500

Table 2

Quantitative evaluation of fusion results for the second set of medical images.

Fusion method	Q	MI	E	SD	BSSIM	SF	AG
Proposed method—level 2	0.5716	4.1388	6.6049	69.0531	0.6744	27.4395	9.1392
Level 3	0.5607	3.9468	6.5807	69.1204	0.6731	27.5336	9.2222
Level 4	0.5581	3.8518	6.5658	69.1764	0.6718	27.4915	9.1901
Level 5	0.5572	3.8099	6.5218	69.3058	0.6758	27.4752	9.1523
Level 6	0.5568	3.8101	6.5220	69.2432	0.6753	27.4637	9.1471
Level 7	0.5561	3.8052	6.5210	69.2423	0.6753	27.4587	9.1388
Level 8	0.5559	3.8046	6.5222	69.3186	0.6751	27.4539	9.1360
GP	0.5726	3.7534	6.2998	46.0875	0.6938	20.3984	6.2247
CP	0.4355	3.4739	5.8564	47.8375	0.6394	23.2630	7.7518
RP	0.4296	3.5713	5.8947	47.9619	0.6326	23.9939	7.9823
PCA	0.6270	6.5147	6.0242	57.8031	0.7220	20.8370	6.6609
DWT with DBSS	0.4981	2.9846	5.9870	53.5355	0.6302	25.5900	7.8574
SIDWT with Haar	0.6130	3.3325	5.8210	54.3584	0.6614	25.8574	7.8436

Table 3

Quantitative evaluation of fusion results for the third set of medical images.

Fusion method	Q	MI	E	SD	BSSIM	SF	AG
Proposed method—level 2	0.4967	4.0205	5.3671	61.9143	0.7500	23.5420	6.3747
Level 3	0.4873	3.5976	5.4120	61.8504	0.7343	24.0667	6.7283
Level 4	0.4861	3.2489	5.5064	61.5818	0.7091	24.2196	6.1282
Level 5	0.4818	3.0343	5.4945	61.0913	0.7004	24.2190	6.7798
Level 6	0.4768	2.8660	5.6753	61.2172	0.6516	24.0972	6.7355
Level 7	0.4745	2.7483	5.6970	61.7318	0.6372	24.0472	6.6961
Level 8	0.4757	2.7412	6.3419	63.5084	0.5174	24.0370	6.7847
GP	0.5228	3.1159	5.7497	49.6324	0.6742	17.0952	4.4506
CP	0.6475	3.2326	4.5518	55.1066	0.7453	23.8488	6.3681
RP	0.6313	3.6672	4.8964	55.8167	0.7522	24.9349	6.6187
PCA	0.3722	3.8902	4.6139	51.7377	0.7968	12.4883	3.3413
DWT with DBSS	0.4386	3.0704	5.2558	54.1881	0.7076	21.0803	5.8365
SIDWT with Haar	0.6097	3.5023	5.0878	54.2085	0.7667	20.3357	5.4552

On observing Table 1, one can easily observe that the fusion measures for proposed multiscale fusion method from level 2 to level 8 have higher values of fusion measures than any of the GP, CP, RP, PCA, DWT with DBSS, and SIDWT with Haar fusion methods. However, the proposed fusion method from level 2 to level 8 has lesser values of SF than CP and RP fusion methods. Also, the proposed method has lesser values of BSSIM than PCA fused image. For these cases, we have performed an overall comparison in Table 1 and it simply states that the proposed multiscale fusion method has better performance for the first set of medical images.

Similarly, observation of Table 2 yields that the proposed fusion method form level 2 to level 8 has higher values of fusion measures than other fusion methods except values of $Q$ for PCA and SIDWT with Haar fusion methods and value of BSSIM for PCA fusion method. However, an overall comparison again shows the superiority of the proposed multiscale fusion scheme for the second set of medical images.

Moreover, Table 3 shows the goodness of the proposed fusion method for the third set of medical images except $Q$ and BSSIM fusion measures. But again by the same criteria chosen for Tables 1 and 2, the proposed multiscale fusion from level 2 to level 8 has better performance than GP, CP, RP, PCA, DWT with DBSS, and SIDWT with Haar fusion methods.

4.3. Combined Evaluation

Since the subjective and objective evaluations separately are not able to examine fusion results, we have combined both, subjective and objective evaluations. The values of fusion measures for fusion results of the first set of medical images (Figure 3) are shown in Table 1. The observations from Table 1 show the variations in the values of SF for CP and RP fusion methods and BSSIM for PCA fusion method. The proposed method from level 2 to level 8 has lesser value of these measures; however, qualitative evaluation of the proposed fusion method from Figure 3 clearly proves the superiority of the proposed method over CP, RP, and PCA fusion methods as these are not able to merge edge and tissue information from source CT and MRI images.

Again, Table 2 shows the higher values of $Q$ for PCA and SIDWT with Haar fusion method and value of BSSIM for PCA fusion method, than the proposed fusion scheme for the second set of medical images. However, from Figure 4, it can be easily seen that the proposed method provides better visual representation than any of these fusion methods. Hence, combined evaluation shows the goodness of the proposed multiscale fusion approach.

The fusion measures of Figure 5 are given in Table 3 for the third set of medical images. The measures show the variations in the value of $Q$ and BSSIM for the proposed method, and the proposed method has lesser values of $Q$ than GP, CP, RP, and SIDWT with Haar fusion methods and lesser values of BSSIM than RP, PCA, and SIDWT with Haar fusion methods. However, qualitative analysis of fusion results shown in Figure 5 clearly shows that GP, CP, RP, and SIDWT with Haar fusion methods have failed to incorporate the features of the source CT and MRI images into one image.

Thus, this combined evaluation for fusion results shown in Figures 3–5 with fusion measures tabulated in Tables 1–3 clearly proves the superiority of the proposed multiscale fusion approach over GP, CP, RP, PCA, DWT with DBSS, and SIDWT with Haar fusion methods.

5. Conclusions

In this work, we have proposed a new multiscale image fusion approach for multimodal medical images in wavelet domain and used DWT for proposed fusion method. The multimodal medical images are fused at multiple scales from level 2 (minimum) to level 8 (maximum) scales with maximum fusion rule. The multiscale image fusion method enables the selection of appropriate fused image with better flexibility. To show the effectiveness of the proposed work, we have performed subjective evaluation and objective evaluation of the proposed fusion method with gradient pyramid (GP), contrast pyramid (CP), ratio pyramid (RP), PCA, DWT with DBSS, and SIDWT with Haar fusion methods. The comparative analysis of the fusion results has been performed with edge strength ( $Q$ ), mutual information (MI), entropy ( $E$ ), standard deviation (SD), blind structural similarity index metric (BSSIM), spatial frequency (SF), and average gradient (AG) fusion metrics. Since the subjective and objective evaluations are separately not sufficient for analysis of fusion results, we have performed combined evaluation which proved the superiority of the proposed multiscale fusion approach over GP, CP, RP, PCA, DWT with DBSS, and SIDWT with Haar fusion methods.

References

[1] V. Barra, J.-Y. Boire, "A general framework for the fusion of anatomical and functional medical images," NeuroImage, vol. 13 no. 3, pp. 410-424, DOI: 10.1006/nimg.2000.0707, 2001.

[2] B. V. Dasarathy, "Information fusion in the realm of medical applications—a bibliographic glimpse at its growing appeal," Information Fusion, vol. 13 no. 1,DOI: 10.1016/j.inffus.2011.06.003, 2012.

[3] O. Rockinger, T. Fechner, "Pixel-level image fusion: the case of image sequences," Signal Processing, Sensor Fusion, and Target Recognition VII, vol. 3374, pp. 378-388, DOI: 10.1117/12.327135, .

[4] C. Pohl, J. L. Van Genderen, "Multisensor image fusion in remote sensing: concepts, methods and applications," International Journal of Remote Sensing, vol. 19 no. 5, pp. 823-854, 1998.

[5] V. Petrovic, Multisensor Pixel-level image fusion [Ph.D. dissertation], 2001.

[6] J. J. Lewis, R. J. O'Callaghan, S. G. Nikolov, D. R. Bull, C. N. Canagarajah, "Region-based image fusion using complex wavelets," pp. 555-562, .

[7] Y. Zhao, Y. Yin, D. Fu, "Decision-level fusion of infrared and visible images for face recognition," Proceedings of the Chinese Control and Decision Conference (CCDC '08), pp. 2411-2414, DOI: 10.1109/CCDC.2008.4597757, .

[8] T. Stathaki, Image Fusion: Algorithms and Applications, 2011.

[9] V. P. S. Naidu, J. R. Raol, "Pixel-level image fusion using wavelets and principal component analysis," Defence Science Journal, vol. 58 no. 3, pp. 338-352, 2008.

[10] J. G. P. W. Clevers, R. Zurita-Milla, "Multisensor and multiresolution image fusion using the linear mixing model," Image Fusion: Algorithms and Applications, pp. 67-84, 2008.

[11] J. Tian, L. Chen, L. Ma, W. Yu, "Multi-focus image fusion using a bilateral gradient-based sharpness criterion," Optics Communications, vol. 284 no. 1, pp. 80-87, DOI: 10.1016/j.optcom.2010.08.085, 2011.

[12] R. Singh, A. Khare, "Fusion of multimodal medical images using Daubechies complex wavelet transform—a multiresolution approach," Information Fusion,DOI: 10.1016/j.inffus.2012.09.005, 2012.

[13] A. B. Hamza, Y. He, H. Krim, A. Willsky, "A multiscale approach to pixel-level image fusion," Integrated Computer-Aided Engineering, vol. 12 no. 2, pp. 135-146, 2005.

[14] P. J. Burt, E. H. Adelson, "The laplacian pyramid as a compact image code," IEEE Transactions on Communications, vol. 31 no. 4, pp. 532-540, 1983.

[15] P. J. Burt, "A gradient pyramid basis for pattern selective image fusion," Proceedings of the SID International Symposium, pp. 467-470, .

[16] A. Toet, L. J. van Ruyven, J. M. Valeton, "Merging thermal and visual images by a contrast pyramid," Optical Engineering, vol. 28 no. 7, pp. 789-792, 1989.

[17] A. Toet, "Image fusion by a ration of low-pass pyramid," Pattern Recognition Letters, vol. 9 no. 4, pp. 245-253, 1989.

[18] A. Toet, "A morphological pyramidal image decomposition," Pattern Recognition Letters, vol. 9 no. 4, pp. 255-261, 1989.

[19] C. H. Anderson, "Filter-subtract-decimate hierarchical pyramid signal analyzing and synthesizing technique," . US Patent 4718104 A, 1998

[20] H. Li, B. S. Manjunath, S. K. Mitra, "Multisensor image fusion using the wavelet transform," Graphical Models and Image Processing, vol. 57 no. 3, pp. 235-245, DOI: 10.1006/gmip.1995.1022, 1995.

[21] S. Cheng, J. He, Z. Lv, "Medical image of PET/CT weighted fusion based on wavelet transform," Proceedings of the 2nd International Conference on Bioinformatics and Biomedical Engineering (iCBBE '08), pp. 2523-2525, DOI: 10.1109/ICBBE.2008.964, .

[22] G. Piella, H. Heijmans, "Multiresolution image fusion guided by a multimodal segmentation," Proceedings of Advanced Concepts for Intelligent Vision Systems (ACIVS '02), pp. 175-182, .

[23] H. Zhang, L. Liu, N. Lin, "A novel wavelet medical image fusion method," Proceedings of the International Conference on Multimedia and Ubiquitous Engineering (MUE '07), pp. 548-553, DOI: 10.1109/MUE.2007.40, .

[24] S. Vekkot, P. Shukla, "A novel architecture for wavelet based image fusion," World Academy of Science, Engineering and Technology, vol. 57, pp. 372-377, 2009.

[25] Y. Yang, "Multiresolution image fusion based on wavelet transform by using a novel technique for selection coefficients," Journal of Multimedia, vol. 6 no. 1, pp. 91-98, DOI: 10.4304/jmm.6.1.91-98, 2011.

[26] J. Teng, X. Wang, J. Zhang, S. Wang, P. Huo, "A multimodality medical image fusion algorithm based on wavelet transform," Advances in Swarm Intelligence, vol. 6146, pp. 627-633, 2010.

[27] Y. Yang, D. S. Park, S. Huang, N. Rao, "Medical image fusion via an effective wavelet-based approach," Eurasip Journal on Advances in Signal Processing, vol. 2010,DOI: 10.1155/2010/579341, 2010.

[28] Y. Yang, "Multimodal medical image fusion through a new DWT based technique," Proceedings of the 4th International Conference on Bioinformatics and Biomedical Engineering (iCBBE '10),DOI: 10.1109/ICBBE.2010.5517037, .

[29] B. Alfano, M. Ciampi, G. D. Pietro, "A wavelet-based algorithm for multimodal medical image fusion," Semantic Multimedia, pp. 117-120, 2007.

[30] G. Qu, D. Zhang, P. Yan, "Medical image fusion by wavelet transform modulus maxima," Optics Express, vol. 9 no. 4, pp. 184-190, 2001.

[31] S. Li, B. Yang, J. Hu, "Performance comparison of different multi-resolution transforms for image fusion," Information Fusion, vol. 12 no. 2, pp. 74-84, DOI: 10.1016/j.inffus.2010.03.002, 2011.

[32] P. S. Pradhan, R. L. King, N. H. Younan, D. W. Holcomb, "Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion," IEEE Transactions on Geoscience and Remote Sensing, vol. 44 no. 12, pp. 3674-3686, DOI: 10.1109/TGRS.2006.881758, 2006.

[33] Z. Xu, "Medical image fusion using multi-level local extrema," Information Fusion,DOI: 10.1016/j.inffus.2013.01.001, 2013.

[34] S. Mallat, A Wavelet Tour of Signal Processing, 1999.

[35] G. Pajares, J. M. de la Cruz, "A wavelet-based image fusion tutorial," Pattern Recognition, vol. 37 no. 9, pp. 1855-1872, DOI: 10.1016/j.patcog.2004.03.010, 2004.

[36] C. S. Burrus, R. A. Gopinath, H. Guo, J. E. Odegard, I. W. Selesnick, Introduction to Wavelets and Wavelet Transforms: A Primer, 1998.

[37] M. Unser, T. Blu, "Wavelet theory demystified," IEEE Transactions on Signal Processing, vol. 51 no. 2, pp. 470-483, DOI: 10.1109/TSP.2002.807000, 2003.

[38] A. Khare, U. S. Tiwary, "Soft-thresholding for denoising of medical images—a multiresolution approach," International Journal on Wavelets, Multiresoultion and Information Processing, vol. 3 no. 4, pp. 477-496, 2005.

[39] O. Rockinger, . http://www.metapix.de/

[40] C. S. Xydeas, V. Petrović, "Objective image fusion performance measure," Electronics Letters, vol. 36 no. 4, pp. 308-309, DOI: 10.1049/el:20000267, 2000.

[41] G. Qu, D. Zhang, P. Yan, "Information measure for performance of image fusion," Electronics Letters, vol. 38 no. 7, pp. 313-315, DOI: 10.1049/el:20020212, 2002.