Joint Multidimensional Pattern for Spectrum Prediction Using GNN

Abstract

In general, judging the use/idle state of the wireless spectrum is the foundation for cognitive radio users (secondary users, SUs) to access limited spectrum resources efficiently. Rich information can be mined by the inherent correlation of electromagnetic spectrum data from SUs in time, frequency, space, and other dimensions. Therefore, how to efficiently use the spectrum status of each SU implementation of reception multidimensional combination forecasting is the core of this paper. In this paper, we propose a deep-learning hybrid model called TensorGCN-LSTM based on the tensor data structure. The model treats SUs deployed at different spatial locations under the same frequency, and the spectrum status of SUs themselves under different frequencies in the task area as nodes and constructs two types of graph structures. Graph convolutional operations are used to sequentially extract corresponding spatial-domain and frequency-domain features from the two types of graph structures. Then, the long short-term memory (LSTM) model is used to fuse the spatial, frequency, and temporal features of the cognitive radio environment data. Finally, the prediction task of the spectrum distribution situation is accomplished through fully connected layers. Specifically, the model constructs a tensor graph based on the spatial similarity of SUs’ locations and the frequency correlation between different frequency signals received by SUs, which describes the electromagnetic wave’s dependency relationship in spatial and frequency domains. LSTM is used to capture the electromagnetic wave’s dependency relationship in the temporal domain. To evaluate the effectiveness of the model, we conducted ablation experiments on LSTM, GCN, GC-LSTM, and TensorGCN-LSTM models using simulated data. The experimental results showed that our model achieves better prediction performance in RMSE, and the correlation coefficient R² of 0.8753 also confirms the feasibility of the model.

1. Introduction

Due to the rapid development of modern wireless communication technology, various new wireless mobile terminals are emerging, and the demand for electromagnetic spectrum resources is increasing rapidly. Currently, wireless transmission services have been allocated in all frequency bands, and the spectrum resources are almost exhausted [1]. However, while the scarcity of spectrum resources is increasing, the problem of inefficient utilization and idleness of static spectrum resource management solutions is also very prominent [2]. Therefore, how to maximize the utilization of spectrum resources is currently an urgent problem that needs to be addressed.

Currently, cognitive radio networks (CRNs), which include key technologies such as dynamic spectrum access (DSA) and opportunistic spectrum access (OSA), are recognized as effective tools for improving the utilization of limited spectrum resources. CRNs perceive, recognize, and utilize the available spectrum in specific task spaces through self-learning and interaction with the surrounding environment, adapting to the constantly changing radio environment. Furthermore, the acquisition of spectrum status information by SUs through spectrum sensing is not only the first step in implementing CRNs but also the foundation for subsequent effective analysis and utilization of idle spectrum resources [3]. However, in practice, SUs often encounter problems such as long delays, high energy consumption, and limited capture range when scanning and sensing the entire spectrum (especially in wideband spectrum sensing tasks), which inevitably hinder the efficient operation of the CRN system [4].

To address the aforementioned problems, researchers have proposed spectrum prediction techniques. SUs can predict the future slot’s received spectrum power by mining and analyzing historical spectrum sensing data and then only sense the spatiotemporal spectrum resources with predicted values below the access power threshold, effectively reducing the time delay and energy consumption of subsequent processing. Early spectrum prediction research mainly focused on time-domain spectrum prediction methods, lacking research on multiple dimensions such as time, frequency, and space, including linear regression models [5], time series prediction models [6], Markov prediction models [7], neural network models [8], etc. The authors of [9] used the multiple attribute decision-making (MADM) methods and artificial neural network architecture to determine the best candidate channel to realize spectrum switching decisions. References [10,11] proposed using fuzzy decision-making principles to estimate handoff spectrum probability, which effectively improved switching efficiency. In recent years, deep learning models have become a powerful tool for spectrum prediction to leverage the potential correlations of frequency data in multiple dimensions such as time, frequency, and space [12,13,14].

In response to the spatial dependence, time dependence, or spectral dependence of spectrum data, composite neural networks such as long-short term memory (LSTM) models and convolutional neural networks (CNN) [15] have been used for joint spectrum prediction in multiple dimensions. Yu et al. [16] proposed a hierarchical dual-CNN and GRU (DCG) model for predicting the local spectrum availability of SUs in CR communication, which can explore the spectral and temporal correlations between spectrum occupancy data. However, simply connecting RNN and CNN still cannot build a comprehensive ability to discover correlations between spatiotemporal multidimensional input data. Reference [17] used transfer learning models for spectrum prediction, but due to the differences in frequency band data, prediction models cannot be directly used across frequency bands. The STS-PredNet [18] models that the received signal strength at a specific spatial location are determined by a weighted linear combination of multiple SUs. The weighting coefficients are obtained using the inverse distance weighting method based on the distance between SUs and the specific spatial location, which ignores the inherent spatial correlation between different observation locations. Model TF²AN [19] based on the preprocessing of the spectrum map, a weighted transfer learning model is introduced to share the spectrum knowledge among multiple locations and frequency bands to improve the performance of the spectrum prediction model. The input of the model SAE-TSS [20] is the image format, and the spectrum sequence is converted into the image format for offline training. The above models are based on the spectral data in space, time, and frequency domains, and make use of the complex correlation between cross-domain knowledge. However, they do not remove the influence of regular data structure and can not extract the inherent correlation of non-Euclidean space well enough. Recently, tensor analysis has been adopted as a framework [21,22] to leverage multidimensional correlations for spectrum prediction. However, using tensor decomposition to handle high-dimensional data requires a long computation time, and to achieve the highest possible prediction accuracy, it also requires the transmission of as much information as possible from the base station.

To address the above issue, this paper proposes a TensorGCN-LSTM hybrid network model to provide an effective method based on mining the implicit rules among electromagnetic data in the spatial, frequency, and temporal domains for cognitive radio task area. More specifically, the proposed approach considers SUs at different spatial locations and the spectrum states of SUs at different frequencies in the task area as nodes and constructs two categories of graph structures accordingly. Tensor graph convolution (TensorGCN) [23] is an effective structure for processing tensor data, which we introduce into the field of spectrum prediction to handle tensor graphs consisting of the two aforementioned graph structures. The essence of the TensorGCN-LSTM model is to utilize graph convolution operations to sequentially discover the correlation rules of spectrum data in the spatial and frequency domains, as well as use LSTM to explore the correlation rules in the temporal domain, thereby improving the accuracy of predicting the change in spectrum state over time and providing a basis for spectrum resource planning and scheduling. Comparative experimental results show that the TensorGCN-LSTM model can provide stable and accurate prediction results.

In summary, our core contributions are three-fold:

• We abstract SUs as nodes and transform the spectrum prediction task into a supervised learning task based on graph tensor structured data. From the existing research literature, we first introduce the concept of graph tensor data structures into the field of spectrum prediction;

• To extract the correlation features of different frequency data over a period received by SUs, we regard the SU’s state of receiving data at different frequencies as nodes (called virtual nodes) and design the inter-frequency graph network structure to extract the frequency-domain correlation features of the spectrum;

• We propose TensorGCN-LSTM, a new joint prediction model in the time, space, and frequency domains, which integrates multidimensional features of task area spectrum data to predict the spectrum state. Ablation experimental results show that compared with other single time-series prediction methods and spatiotemporal prediction methods, the TensorGCN-LSTM model has a more accurate prediction performance.

The rest of this paper is organized into four sections. Section 2 presents the preliminary works, including the establishment of the tensor graph and definition of the spectrum prediction. Section 3 describes the methodology of the deep learning model for forecasting spectrum evolution. Section 4 presents an introduction to the experiment settings and dataset. Section 5 discusses the evaluation of the results. Finally, concluding remarks and future research directions are discussed in Section 6. Section 7 introduces a patent resulting from the work reported in this paper.

2. Preliminaries

In this section, we preprocessed the received signal strength (RSS) of secondary users collected on various frequency bands over time in the cognitive radio task area to form a tensor graph signal. Based on the spatial and frequency domain states of secondary users, we established two types of graphs and composed a tensor graph model.

2.1. Establishment of Tensor Graph Signal

As illustrated in Figure 1, we divided the cognitive wireless task area into equidistant grids. For any secondary user node $v_n,(n=1,2,\dots ,N)$, the received signal strength, distance, and azimuth between the node and the mobile primary user at time slot $t$ and working frequency $f_k$ are denoted as ${\psi }_{v_n}^{(t,f_k)}$, $d_{v_n}^{(t,f_k)}$, and ${\mathsf{\phi }}_{v_n}^{(t,f_k)}$, respectively. We can establish the feature vector of secondary users that varies with time and frequency:

(1)$x_{{}_{v_n}}^{(t,f_k)}=\left[{\psi }_{v_n}^{(t,f_k)},d_{v_n}^{(t,f_k)},{\mathsf{\phi }}_{v_n}^{(t,f_k)}\right]\in {ℝ}^{1\times M}$

where $k=1,2,\dots ,K$ and $M$ represents the number of features of a secondary user node.

Based on the description of the features $x_{{}_{v_n}}^{(t,f_k)}$ of a single secondary user node, we can construct the features matrix $X^{(t,f_k)}$ from the data of $N$ secondary user nodes $V={\left\{v_n\right\}}_{n=1}^N$ at time slot $t$ and working frequency $f_k$:

(2)$X^{(t,f_k)}=\left[x_{{}_{v_1}}^{(t,f_k)},x_{{}_{v_2}}^{(t,f_k)},\dots ,x_{{}_{v_N}}^{(t,f_k)}\right]\in {ℝ}^{N\times M}$

Therefore, the feature tensor of the graph signal ${\mathcal{X}}^{(t)}$, which captures the data of $N$ SUs at $K$ different monitoring frequencies, can be constructed from $X^{(t,f_k)}$ as:

(3)${\mathcal{X}}^{(t)}=\left[X^{(t,f_1)},X^{(t,f_2)},\dots ,X^{(t,f_K)}\right]\in {ℝ}^{K\times N\times M}$

2.2. Establishment of Tensor Graph

We set up the problem of predicting the graph spectrum, as shown in the construction process in Figure 2. From left to right, the figure shows the power spectrum received by secondary users (SU) from monitoring, the spatial distribution of SUs and mobile primary users (PU) within the task area, and the network graph structure constructed by secondary users according to certain rules.

2.2.1. The Spatial Domain Graph Structures

The graph of $N$ SUs in the task area at monitoring frequency $f_k$ is shown in Figure 2 (right). It is referred to as a spatial domain graph structure, which is denoted $G_{f_k}=(V,A_{f_k})$ in Figure 3 (left). $A_{f_k}$ is the adjacency matrix that describes the spatial domain graph $G_{f_k}$, where each element represents the connectivity between nodes.

We assumed that the transmitting and receiving antennas in cognitive radio networks are both omnidirectional antennas. The formula for calculating the path loss (PL) of free space electromagnetic wave propagation is:

(4)$PL={\left(\frac{4\pi •d}{\lambda }\right)}^2={\left(\frac{4\pi f•d}{c}\right)}^2$

where $\lambda$,$f$, respectively, denote the wavelength and frequency of the PU’s transmission carrier. $c=3\times {10}^8$ m/s. $d$ denotes the distance between SUs and PUs. Therefore, the relationship between the received power $P_r$ of the secondary user’s receiver and the transmission power $P_t$ of the primary user is given by:

(5)$P_r=\frac{P_t}{PL}$

As can be seen from Equations (4) and (5), assuming a fixed transmission carrier frequency by the primary user, the critical factor affecting the RSS of the secondary user is the distance between the SU and the PU. Therefore, we adopted the “inverse distance weighting method” to construct the adjacency matrix $A_{f_k}$ of the spatial domain graph, as follows:

(6)$A_{f_k}=\left[\begin{array}{ccccc}{a}_{1,1}& \dots & a_{1,j}& \dots & a_{1,N}\\ ⋮& \ddots & ⋮& \ddots & ⋮\\ a_{i,1}& \dots & a_{i,j}& \dots & a_{i,N}\\ ⋮& \dots & ⋮& \ddots & ⋮\\ a_{N,1}& \dots & a_{N,j}& \dots & a_{N,N}\end{array}\right]$

where $a_{ij}=\{\begin{array}{cc}\frac{1}{d(v_i,v_j)},& i\ne j\mathrm{and}d(v_i,v_j)<th\\ 0,& \mathrm{otherwise}\end{array}$, $d(v_i,v_j)$ denote Euclidean distance between the node $v_i$ and $v_j$. $th$ represents the Euclidean distance threshold for establishing edges between nodes.

2.2.2. The Frequency Domain Graph Structures

In this section, we constructed a graph structure for the state relationships of a node $v_n$ when receiving data at different frequencies, which is called the “frequency domain graph structure”. We refer to the spectrum state corresponding to each frequency signal received by the SU node as a “virtual node”. $v_{n,f_k}=\left[{\psi }_{v_n}^{(t-\mathsf{\Delta }t+1,f_k)},\cdots ,{\psi }_{v_n}^{(t,f_k)}\right]$ denotes the spectrum state of the secondary user node $v_n$ when continuously receiving data for $\mathsf{\Delta }t$ time slots at a certain frequency. ${\widehat{V}}_n={\left\{v_{n,f_k}\right\}}_{k=1}^K$ denotes a collection of virtual nodes at $K$ frequencies. The elements of the adjacency matrix ${\widehat{A}}_n\in {ℝ}^{K\times K}$ defined in Equation (8) represent the frequency domain similarity between virtual nodes from SU $v_n$. Therefore, the frequency domain graph structures can be denoted as ${\widehat{G}}_n=\left({\widehat{V}}_n,{\widehat{A}}_n\right)$ shown in Figure 3 (right).

In the frequency domain graphs, we use correlation coefficients to analyze the inherent frequency domain correlation about the measured spectrum data:

(7)${\rho }_{f_k,f_l}=\frac{\mathrm{cov}(v_{n,f_k},v_{n,f_l})}{{\sigma }_{v_{n,f_k}}{\sigma }_{v_{n,f_l}}}=\frac{E\left[(v_{n,f_k}-{\mu }_{v_{n,f_k}})(v_{n,f_l}-{\mu }_{v_{n,f_l}})\right]}{{\sigma }_{v_{n,f_k}}{\sigma }_{v_{n,f_l}}}$

In Equation (7), $\mathrm{cov}(•)$ represents the covariance operator, while $\mu$ and $\sigma$, respectively, represent the mean value and standard deviation. The closer the absolute value ${\rho }_{f_k,f_l}\in \left[-1,1\right]$ is to 1, the stronger the correlation between the two frequencies $f_k$ and $f_l$ of secondary user $v_n$ during $\mathsf{\Delta }t$. The adjacency matrix ${\widehat{A}}_n\in {ℝ}^{K\times K}$ can be defined as follows:

(8)${\widehat{A}}_n=\left[\begin{array}{ccccc}{\widehat{a}}_{1,1}& \dots & {\widehat{a}}_{1,l}& \dots & {\widehat{a}}_{1,K}\\ ⋮& \ddots & ⋮& \ddots & ⋮\\ {\widehat{a}}_{k,1}& \dots & {\widehat{a}}_{k,l}& \dots & {\widehat{a}}_{k,K}\\ ⋮& \dots & ⋮& \ddots & ⋮\\ {\widehat{a}}_{K,1}& \dots & {\widehat{a}}_{K,l}& \dots & {\widehat{a}}_{K,K}\end{array}\right]$

where ${\widehat{a}}_{k,l}=\{\begin{array}{cc}{\rho }_{f_k,f_l}& v_{n,f_k}\leftrightarrow v_{n,f_l}\mathrm{and}k\ne l\\ 0& \mathrm{otherwise}\end{array}$. Furthermore, a tensor graph can be constructed as $\mathcal{G}=\left[{[G_{f_k}]}_{k=1}^K,{\widehat{G}}_n\right]$.

2.3. The Definition of the Spectrum Prediction Problem

According to the above description, the graph tensor signal received by SUs during $[t-T^{\prime }+1,t]$ in the cognitive radio task area can be represented as $[{\mathcal{X}}^{(t)},\dots ,{\mathcal{X}}^{(t-T^{\prime }+1)}]$. The received RSS by a secondary user in the next $T$ time slots can be represented as ${\mathsf{\Psi }}_n\left(f,t\right)={\left\{{\psi }_{v_n}^{(t,f)}\right\}}_{n=1}^N$, where $f={\left\{f_k\right\}}_{k=1}^K$, $t\in [t+1,t+T]$. Therefore, the graph tensor $\mathcal{G}$ and graph tensor signal ${\mathcal{X}}^{(t)}$ are learned by the proposed composite deep neural network model TensorGCN-LSTM to obtain a mapping function $F$, denoted as Equation (9), which predicts future spectral data using historical spectrum data. Moreover, the model is enabled to implement the prediction of spectrum evolution.

(9)${\mathsf{\Psi }}_n\left(f,t\right)=F({\mathcal{X}}^{(t)},\dots ,{\mathcal{X}}^{(t-T^{\prime }+1)},\mathcal{G})$

3. Methodology

In this section, we elaborate on the implementation process of the prediction method based on the TensorGCN-LSTM hybrid model, shown in detail in Figure 4. The model first performs graph convolution on the node features in the spatial domain graph structure to generate node embedding. Then, it combines the node embedding with the spectral graph structure and performs secondary graph convolution to extract information that integrates spatial and spectral information from secondary users. We refer to the above two graph convolution operations as intra-frequency graph convolution and inter-frequency graph convolution, respectively. They are shown in Figure 4 (upper right). Afterward, the spatial–spectral embeddings are fed into the LSTM model to generate fusion feature information in multiple dimensions of spatial, spectral, and temporal domains. Finally, the fusion features are passed through a fully connected layer to output the predicted RSS results.

According to the processing method adopted by the graph convolutional neural network [24], the forward propagation formula of the graph convolution for US nodes in the spatial domain graph structure is as follows:

(10)$H_{v_n}^{(t,f_k)}={\displaystyle \sum _{r=1}^R{P}_r(\tilde{L})X_{v_n}^{(t,f_k)}{\mathsf{\Theta }}_r}$

where ${\mathsf{\Theta }}_r\in {ℝ}^{M\times W}$ is the parameter matrix of the filter for intra-frequency graph convolution that needs to be learned and updated. $P_r(\tilde{L})\in {ℝ}^{N\times N}$ is the r-th order Chebyshev polynomial and the standardized Laplace matrix $\tilde{L}$ of adjacency matrix $A_{f_k}$ refers to:

(11)$\tilde{L}=\frac{2(I-D^{-\frac{1}{2}}{A}_{f_k}{D}^{-\frac{1}{2}})}{{\lambda }_{\max }}-I$

where ${\lambda }_{\max }$ represents the maximum eigenvalue of the Laplacian matrix $\tilde{L}$. $I$ and, respectively, refer to the identity matrix and degree matrix of the matrix $A_{f_k}$.

$H\in {ℝ}^{1\times W}$ in Equation (10) is the spatial embedding vector extracted by graph convolution. Therefore, ${\widehat{X}}_{v_n}^{(t)}=\left[H_{v_n}^{(t,f_1)},H_{v_n}^{(t,f_2)},\dots ,H_{v_n}^{(t,f_K)}\right]$ serves as the feature matrix for input inter-frequency graph convolution, and the input vector $y_{v_n}^{(t)}$ to the LSTM module can be obtained through the following:

(12)$y_{v_n}^{(t)}={\displaystyle \sum _{r^{\prime }=1}^{R^{\prime }}{P}_{r^{\prime }}(\widetilde{L^{\prime }}){\widehat{X}}_{v_n}^{(t)}{{\mathsf{\Theta }}^{\prime }}_{r^{\prime }}}$

Similar to Equation (10), $\widetilde{L^{\prime }}$ represents the normalized Laplacian matrix corresponding to the adjacency matrix ${\widehat{A}}_n\in {ℝ}^{K\times K}$. ${{\mathsf{\Theta }}^{\prime }}_{r^{\prime }}$ is the filter parameter matrix that needs to be learned and updated through inter-frequency graph convolution. $P_{r^{\prime }}(\widetilde{L^{\prime }})\in {ℝ}^{K\times K}$ is the Chebyshev polynomial of $r^{\prime }$ order. It should be noted that due to the filtering operation being an approximation of the R-th order Laplacian operator, it is localized to R-order neighboring nodes. In our experiments, we set $R=R^{\prime }=2$.

To learn the temporal evolution characteristics of electromagnetic waves, we input the fused spatial and frequency domain embedding $y_{v_n}^{(t)}$ of each secondary user node into an LSTM model [25]. This operation is shown in Figure 5.

At each time slot, the LSTM unit takes the fused embedding $y_{v_n}^{(t)}$ of the node as input, which enables the LSTM model to more comprehensively describe the temporal evolution process of electromagnetic waves based on the integrated frequency and spatial propagation characteristics. We describe the entire process of the LSTM using Equation (13):

(13)$\begin{array}{l}{f}_{v_n}^t=\sigma \left(W_f•\left[h_{v_n}^{t-1},y_{v_n}^{(t)}\right]+b_f\right)\\ i_{v_n}^t=\sigma \left(W_i•\left[h_{v_n}^{t-1},y_{v_n}^{(t)}\right]+b_i\right)\\ {\tilde{C}}_{v_n}^t=\tanh \left(W_c•\left[h_{v_n}^{t-1},y_{v_n}^{(t)}\right]+b_c\right)\\ c_{v_n}^t=f_{v_n,f_k}^t\circ c_{v_n}^{t-1}+i_{v_n}^t\circ {\tilde{C}}_{v_n}^t\\ o_{v_n}^t=\sigma (W_o•\left[h_{v_n}^{t-1},y_{v_n}^{(t)}\right]+b_o)\\ h_{v_n}^t=o_{v_n}^t\circ \tanh (c_{v_n}^t)\end{array}$

Based on the output of the proposed TensorGCN-LSTM model, we finally predict RSS by:

(14)$[{\psi }_{v_n}^{(t+l,f_1)},{\psi }_{v_n}^{(t+l,f_1)},\dots ,{\psi }_{v_n}^{(t+l,f_1)}]=FC(h_{v_n}^t)$

where ${\left\{{\psi }_{v_n}^{(t+l,f_i)}\right\}}_{k=1}^K$ denote the RSS of SU $v_n$ corresponding to $K$ frequencies at the time $t+l$ in the future and $FC(•)$ is a full connection layer.

4. Numerical Experiments

The datasets of the simulation experiment were generated based on the addition of mobile transmitters with random emission frequencies. The position coordinates of the considered transmitters varied randomly and uniformly with time. The lognormal shadowing model adhered to the Gudmundson model [26], which provides the correlation between the PU and SUs. Multiple mobile primary users working on different frequencies were added to the cognitive radio task region, forming experimental data of power spectral density with spatial and frequency domain characteristics that continuously varied over time.

For simplicity, the transmission power of each primary user was set at 1 w. In addition, for the representation of temporal data, we uniformly divided the time axis into windows and aggregated the spectral data within the same time window $\mathsf{\Delta }t$ into one-time steps. Finally, we used discretized time steps to represent continuous temporal data.

4.1. Experiment Settings

According to the spatial resolution requirements of the spectrum prediction task, we divided the cognitive radio task region into a 200 × 200 grid and randomly distributed 174 secondary users uniformly in each grid, as shown in Figure 6. The monitored frequency range was between 800 and 900 MHz, with a frequency resolution and spectrum sensing sweep span of 200 kHz for the spectrum sensor, generating a total of 500 frequency bands.

In the experiment, under the premise of examining whether the prediction model worked and not caring about the accuracy of radio wave propagation attenuation, we only considered the path loss and shadow fading of radio wave propagation for the attenuation of the spectrum sensor’s received power.

For the simulation experiment, the log-normal shadow fading model (${\mu }_{sdw}=0$, ${\sigma }_{sdw}=0.5$) was used to model the shadow fading of the task area. The path propagation loss in the task area was modeled using a logarithmic distance path loss model, which is shown in Equation (15):

(15)$P_r\left(\mathrm{dBm}\right)=P_t\left(\mathrm{dBm}\right)+K\left(\mathrm{dB}\right)-10\gamma {\log }_{10}\frac{d}{d_0}$

where $K$ is a constant coefficient related to the gain of the transmitting antenna, which is generally represented by the measured power value at $d_0$. Here, $d_0$ represents the far field distance of the antenna and is a constant reference distance. $d$ is the distance between the receiver of the secondary user and the transmitter of the primary user. In the simulation experiment, we gridded the target area and set $d_0=1$ to represent the path loss of radio wave propagation attenuated by each grid. $\gamma$ is the path loss exponent, which typically ranges from 3.7 to 6.5 for urban macrocells. In the experiment, $\gamma$ was set to 5.

4.2. Dataset Preparation

We had each secondary user collect spectrum data for each frequency band in the task area over 17,280 time slots. We then divided the dataset into the training set, validation set, and test set in a ratio of 6:2:2. Figure 7 shows the RSS distribution of the task area for 174 secondary users continuously receiving 6 time-slots at 800 MHz.

Following the description in Section 2.2, we constructed spatial- and frequency-domain structure diagrams. As shown in Figure 8a, the spatial-domain structure was constructed for 174 secondary user nodes at different frequencies. The coordinate positions of each node in the diagram corresponded to the spatial coordinates of the secondary users in the task area. To concisely represent the frequency-domain structure, we selected a schematic diagram of the frequency domain graph for 10 frequencies (801 MHz, …, 810 MHz) within the 800–810 MHz frequency range. Each frequency state was treated as a node, and the absolute value of the correlation coefficient between the spectrum data of each frequency was used as the weight for the corresponding edge. This allowed us to construct a graph structure with frequencies as nodes, as shown in Figure 8b.

5. Discussion

To validate the feasibility of conducting power spectral data prediction experiments using simulated datasets, we calculated the data correlations of individual secondary users in the time, frequency, and spatial domains, as shown in Figure 9. Specifically, Figure 9a illustrates the spatial correlation structure among secondary users, indicating a strong spatial correlation among them. Moreover, the proximity of secondary user indices reflected a stronger spatial correlation between closely located secondary users. In Figure 9b, the time-domain correlation of power spectral data for the same secondary user node across different frequency bands is depicted. It can be observed that the values of time-domain correlation were generally large, and the correlation distribution graph demonstrated the regularity of tidal effects in the spatial activity of the primary user. Figure 9c presents the distribution of frequency-domain correlations between any two time slots of the spectral state on a sensing node in the simulated dataset. Although the numerical values of frequency-domain correlation might not be as close to 1 as those of spatial and time-domain correlation, there were still some significant correlation values in certain frequency bands. The occurrence of windowing effects in the 48 frequency points within the frequency range of 800 to 810 MHz indicated a highly correlated spectral state evolution between low-frequency and high-frequency bands.

To validate the effectiveness of the proposed TensorGCN-LSTM model, we conducted experimental comparisons with three other models: LSTM, GCN, and GC-LSTM. We evaluated the generalization ability of each model by analyzing the loss values on the training, validation, and test sets. Additionally, we examined the prediction accuracy of the models using metrics such as the MAE (Mean Absolute Error), RMSE (Root Mean Square Error), and $R^2$ (coefficient of determination). The calculations were performed according to Equation (16):

(16)$\begin{array}{l}MAE=\frac{{\displaystyle \sum _{t=1}^T\left|{\psi }_{v_n}^{(t)}-{\widehat{\psi }}_{v_n}^{(t)}\right|}}{T}\\ RMSE=\sqrt{\frac{{\displaystyle \sum _{t=1}^T{\left({\psi }_{v_n}^{(t)}-{\widehat{\psi }}_{v_n}^{(t)}\right)}^2}}{T}}\\ MAPE=\frac{1}{T}{\displaystyle \sum _{t=1}^T\left|\frac{{\psi }_{v_n}^{(t)}-{\widehat{\psi }}_{v_n}^{(t)}}{{\psi }_{v_n}^{(t)}}\right|}\ast 100\%\\ R^2=1-\frac{{\displaystyle \sum _{t=1}^T{\left({\psi }_{v_n}^{(t)}-{\widehat{\psi }}_{v_n}^{(t)}\right)}^2}}{{\displaystyle \sum _{t=1}^T{\left({\psi }_{v_n}^{(t)}-{\overline{\psi }}_{v_n}\right)}^2}}\end{array}$

where ${\psi }_{v_n}^{(t)}$ and ${\widehat{\psi }}_{v_n}^{(t)}$ represent the true values and predicted values of RSS, respectively. $T$ represents the number of received data samples from secondary users, and ${\overline{\psi }}_{v_n}$ represents the sample mean.

The evaluation results of the loss function metrics for each model were the average values of the predicted results from 174 secondary user nodes. The models were trained using 24 historical samples to predict the data for the next 30 time slots. Table 1 presents the average cumulative losses of the four prediction models on the training, test, and validation sets at a frequency of 810 MHz.

When evaluating the prediction error metrics of the prediction model, we conducted experimental comparisons using the RSS data received at 810 MHz frequency by the secondary user with index 0 ($v_0$) in the spatial domain graph structure shown in Figure 8a. To further explore the temporal variation in the ground-level RSS and four model predictions, we randomly selected the predicted results of 580 consecutive time slots for the secondary user $v_0$. Figure 10 displays the predicted power spectral density values of four models compared to the true power spectral density values. Generally speaking, the prediction curve of the TensorGCN-LSTM model aligned more closely with the actual trend and was closer to the real data. It can be seen that LSTM better grasped the changing trend of data in the time domain. Meanwhile, the spatial prediction model (GCN) showed a tendency to overestimate the ground-true value, and the spatiotemporal prediction model (GC-LSTM) showed an underestimation of the high values.

In Figure 11, the Pearson linear correlation between the predicted and actual values revealed that, as the spatial, temporal, and frequency features fused, the predicted results exhibited a more concentrated numerical distribution with reduced variance. The slope corresponding to the TensorGCN-LSTM model (0.88) was less than one and the largest, indicating that our proposed model achieves a more balanced distribution trend between underestimation of low values and overestimation of high values. This strongly demonstrated that the fusion of multiple feature attributes contributes to the overall smoothness of the model’s predictions. Additionally, the R-value ($R^2=0.8753$) and MAE value ($MAE=0.6478$) of the TensorGCN-LSTM model indicated a strong consistency between the predicted values and the actual values.

Table 2 presents a comparison of prediction errors for four prediction models under different prediction horizons. From the table, it can be observed that the TensorGCN-LSTM model exhibited varying degrees of reduction in prediction errors compared to the other three models, as indicated by RMSE, MAE, and MAPE metrics. The results demonstrated that considering the spatial and frequency distribution characteristics of radio propagation improves the prediction accuracy of the TensorGCN-LSTM model. Looking at the prediction error results of the GCN and LSTM models, it was evident that a neural network structure solely focusing on spatial correlations cannot effectively enhance the predictive accuracy of temporal data. With an increase in the prediction horizon, the uncertainty of all four models’ predictions increased, leading to gradually larger prediction errors. However, based on the comparison results for the 20th–30th horizons, our proposed TensorGCN-LSTM model exhibited better long-term prediction capability. This finding validates the beneficial effects of effectively integrating temporal-, spatial-, and frequency-domain features to enhance the prediction performance of the model.

The purpose of our experiment was to validate the effectiveness of the proposed model. The shadow fading component in the synthetic data generation followed the Gudmundson model, while the actual data were more complex than this. As a result, the complexity of the simulated experimental data may not be as high as that of real measurement data, and the variations in spectrum data may not be significant in the spatial and frequency domain. Consequently, the overall difference in error metrics among the four prediction models is not substantial. However, experiments on the simulated dataset have demonstrated that TensorGCN-LSTM exhibits significant potential in exploring the multidimensional interactions of spectrum prediction.

6. Conclusions

In this paper, we proposed a novel graph neural network deep learning framework called TensorGCN-LSTM for spectrum prediction. First, based on the global spatial distribution map of secondary users in the task area, we utilized the “spatial domain graph structure” to capture the characteristics of electromagnetic wave propagation in spatial space. Additionally, we employ the “frequency domain graph structure” to capture the frequency domain correlation between spectrum states in different service frequency bands. Subsequently, the LSTM model was used to summarize the temporal variation features of the secondary users’ network received power. Finally, by integrating the interaction information of spatial, frequency, and temporal domains through fully connected layers, we achieved the prediction of spectrum trends under the conditions of multi-dimensional information fusion. We showed the success of our approach through experiments on a simulated dataset that explored the multidimensional interactions of spectrum prediction. In future work, we plan to incorporate real measurement data and incorporate additional domain knowledge, such as terrain structures and weather information, to further enhance its accuracy and robustness in spectrum prediction.

7. Patents

There is a patent “A Prediction Method of Radio Environment Map [27]” resulting from the work reported in this manuscript.

Author Contributions

Conceptualization, X.W. and S.F.; Methodology, X.W. and S.F.; Software, X.W.; Validation, X.W.; Formal analysis, H.L.; Data curation, X.W.; Writing—original draft, X.W. and Z.X.; Writing—review & editing, X.W., S.F., Z.X. and H.L.; Funding acquisition, S.F. All authors have read and agreed to the published version of the manuscript.

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Figures and Tables

Figure 1. Illustration of node attribute characteristics (where red and green dots represent the location of the mobile primary user (PU) in two different time slots and working frequencies and blue dots represent different locations of secondary users (SUs) distributed in the wireless task area).

Figure 2. Establishment of the network graph structure by SUs.

Figure 3. The construction of the spatial domain graph and the frequency domain graph. (The green, yellow, and brown dots represent one secondary user node at different monitoring frequencies. The left figure shows the spatial domain graph structures of all secondary user nodes at different monitoring frequencies, while the right figure illustrates the process of extracting frequency domain features of the secondary user node [Forumla omitted. See PDF.] at different monitoring frequencies after completing spatial feature extraction in the left figure).

Figure 4. Schematic diagram of the TensorGCN-LSTM spectrum prediction model. (The green, orange, and brown nodes in [Forumla omitted. See PDF.], [Forumla omitted. See PDF.] and [Forumla omitted. See PDF.] respectively represent the status of the same node at different operating frequencies. The blue and pink nodes in the upper-right sub-graph represent the first-order and second-order neighboring nodes, respectively. In the lower left figure, the three-dimensional data cube is composed of node–frequency–time, which can visually represent the RSS of secondary user nodes at specific frequencies and time points).

Figure 5. Diagram of inputting the fused spatial–frequency domain feature into the LSTM model.

Figure 6. Spatial distribution map of secondary users. (We number the secondary users (0–173) in the cognitive radio task region and highlighted them in blue for clarity).

Figure 7. Time-series plot of RSS distribution.

Figure 8. (a) Graph structure of the spatial domain; (b) Graph structure of the frequency domain.

Figure 9. Correlation verification results of simulated datasets.

Figure 9. Correlation verification results of simulated datasets.

Figure 10. Comparison graph of predicted values and actual data curves of received signal strength for node 0 among four prediction models.

Figure 11. Comparison graph of predicted values and actual data curves of received signal strength for node 0 in Figure 6 among four prediction models. The diagonal line in the figure is determined by the equation: [Forumla omitted. See PDF.]. Among them, [Forumla omitted. See PDF.] and [Forumla omitted. See PDF.] in the black diagonal line indicate that the predicted value is completely consistent with the measured value. The values of [Forumla omitted. See PDF.] and [Forumla omitted. See PDF.] in the red diagonal are given in the bottom right corner of each subfigure. The blue scatter points represent the predicted values of the models corresponding to the measured values.

Figure 11. Comparison graph of predicted values and actual data curves of received signal strength for node 0 in Figure 6 among four prediction models. The diagonal line in the figure is determined by the equation: [Forumla omitted. See PDF.]. Among them, [Forumla omitted. See PDF.] and [Forumla omitted. See PDF.] in the black diagonal line indicate that the predicted value is completely consistent with the measured value. The values of [Forumla omitted. See PDF.] and [Forumla omitted. See PDF.] in the red diagonal are given in the bottom right corner of each subfigure. The blue scatter points represent the predicted values of the models corresponding to the measured values.

Table 1

Comparison of models’ losses on training, validation, and testing sets.

Metric	LSTM	GCN	GCN-LSTM	TensorGCN-LSTM
Train Loss	0.2055	0.3326	0.1674	0.1663
Validate Loss	0.2514	0.3521	0.1705	0.1501
Test Loss	0.2900	0.4601	0.1780	0.1483

Table 2

Comparison of prediction errors among four models when predicting RSS values for different time slot lengths. Best scores are in bold.

Horizon	LSTM			GCN			GC-LSTM			TensorGCN-LSTM
	RMSE	MAE	MAPE	RMSE	MAE	MAPE	RMSE	MAE	MAPE	RMSE	MAE	MAPE
+1	1.1822	0.7458	0.73%	1.4020	1.0769	1.04%	1.1467	0.5888	0.58%	1.1447	0.6078	0.63%
+5	1.7227	1.0656	1.01%	1.9636	1.4541	1.40%	1.7906	1.0530	1.00%	1.5693	0.9702	0.93%
+10	2.2962	1.4032	1.34%	2.4571	1.7205	1.64%	2.5636	1.5061	1.43%	2.2672	1.3650	1.30%
+20	2.7982	1.8130	1.73%	2.9462	1.8509	1.77%	2.7855	1.6400	1.63%	2.7753	1.6443	1.61%
+30	3.2849	2.0980	2.01%	3.3069	2.2141	2.11%	3.0474	1.9949	1.91%	2.8889	1.7110	1.70%

References

1. Khan, A.A.; Rehmani, M.H.; Reisslein, M. Cognitive radio for smart grids: Survey of architectures, spectrum sensing mechanisms, and networking protocols. IEEE Commun. Surv. Tutor.; 2015; 18, pp. 860-898. [DOI: https://dx.doi.org/10.1109/COMST.2015.2481722]

2. Zhang, L.; Xiao, M.; Wu, G.; Muhammad, A.; Liang, Y.C.; Li, S. A Survey of Advanced Techniques for Spectrum Sharing in 5G Networks. IEEE Wirel. Commun.; 2017; 24, pp. 44-51. [DOI: https://dx.doi.org/10.1109/MWC.2017.1700069]

3. Matinmikko, M.; Mustonen, M.; Roberson, D.; Paavola, J.; Hoyhtya, M.; Yrjola, S.; Roning, J. Overview and comparison of recent spectrum sharing approaches in regulation and research: From opportunistic unlicensed access towards licensed shared access. Proceedings of the 2014 IEEE International Symposium on Dynamic Spectrum Access Networks (DYSPAN); McLean, VA, USA, 1–4 April 2014.

4. Ding, G.; Wang, J.; Wu, Q.; Yao, Y.D.; Song, F.; Tsiftsis, T.A. Cellular-Base-Station Assisted Device-to-Device Communications in TV White Space. IEEE J. Sel. Areas Commun.; 2015; 34, pp. 107-121. [DOI: https://dx.doi.org/10.1109/JSAC.2015.2452532]

5. Geirhofer, S.; Tong, L.; Sadler, B.M. Cognitive radios for dynamic spectrum access-dynamic spectrum access in the time domain: Modeling and exploiting white space. IEEE Commun. Mag.; 2007; 45, pp. 66-72. [DOI: https://dx.doi.org/10.1109/MCOM.2007.358851]

6. Su, J.; Wu, W. Wireless spectrum prediction model based on time series analysis method. Proceedings of the 2009 ACM Workshop on Cognitive Radio Networks; New York, NY, USA, 21 September 2009.

7. Saad, A.; Staehle, B.; Knorr, R. Spectrum prediction using hidden Markov models for industrial cognitive radio. Proceedings of the 2016 IEEE 12th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob); New York, NY, USA, 17–19 October 2016.

8. Xing, X.; Jing, T.; Cheng, W.; Huo, Y.; Cheng, X. Spectrum prediction in cognitive radio networks. IEEE Wirel. Commun.; 2013; 20, pp. 90-96. [DOI: https://dx.doi.org/10.1109/MWC.2013.6507399]

9. Preetha, K.S.; Kalaivani, S. An efficient spectrum handoff decision making scheme for cognitive radio networks. Int. J. Internet Technol. Secur. Trans.; 2019; 9, 68. [DOI: https://dx.doi.org/10.1504/IJITST.2019.098158]

10. Alhammadi, A.; Mardeni, R.; Alias, M.Y. Fuzzy logic based negotiation approach for spectrum handoff in cognitive radio network. Proceedings of the 2016 IEEE 3rd International Symposium on Telecommunication Technologies (ISTT); Kuala Lumpur, Malaysia, 28–30 November 2016.

11. Roslee, M.; Alhammadi, A.; Alias, M.Y.; Anuar, K.; Nmenme, P.U. Efficient handoff spectrum scheme using fuzzy decision making in cognitive radio system. Proceedings of the 2017 3rd International Conference on Frontiers of Signal Processing (ICFSP); Paris, France, 6–8 September 2017.

12. López-Benítez, M.; Casadevall, F. Spectrum usage models for the analysis, design and simulation of cognitive radio networks. Cognitive Radio and its Application for Next Generation Cellular and Wireless Networks; Springer: Berlin/Heidelberg, Germany, 2012; pp. 27-73.

13. Chen, D.; Yin, S.; Zhang, Q.; Liu, M.; Li, S. Mining spectrum usage data: A large-scale spectrum measurement study. Proceedings of the 15th Annual International Conference on Mobile Computing and Networking; Beijing, China, 20 September 2009; pp. 13-24.

14. Yu, L.; Wang, Q.; Guo, Y.; Li, P. Spectrum availability prediction in cognitive aerospace communications: A deep learning perspective. Proceedings of the 2017 Cognitive Communications for Aerospace Applications Workshop (CCAA); Cleveland, OH, USA, 27–28 June 2017.

15. Shawel, B.S.; Woldegebreal, D.H.; Pollin, S. Convolutional LSTM-based long-term spectrum prediction for dynamic spectrum access. Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO); A Coruna, Spain, 2–6 September 2019.

16. Yu, L.; Guo, Y.; Wang, Q.; Luo, C.; Li, M.; Liao, W.; Li, P. Spectrum availability prediction for cognitive radio communications: A DCG approach. IEEE Trans. Cogn. Commun. Netw.; 2020; 6, pp. 476-485. [DOI: https://dx.doi.org/10.1109/TCCN.2020.2973572]

17. Lin, F.; Chen, J.; Sun, J.; Ding, G.; Yu, L. Cross-band spectrum prediction based on deep transfer learning. China Commun.; 2020; 17, pp. 66-80. [DOI: https://dx.doi.org/10.23919/JCC.2020.02.006]

18. Agarwal, A.; Gangopadhyay, R. Predictive spectrum occupancy probability-based spatio-temporal dynamic channel allocation map for future cognitive wireless networks. Trans. Emerg. Telecommun. Technol.; 2018; 29, e3442. [DOI: https://dx.doi.org/10.1002/ett.3442]

19. Li, K.; Li, C.; Chen, J.; Zhang, Q.; Liu, Z.; He, S. Boost Spectrum Prediction With Temporal-Frequency Fusion Network via Transfer Learning. IEEE Trans. Mob. Comput.; 2023; 22, pp. 3209-3223. [DOI: https://dx.doi.org/10.1109/TMC.2021.3136941]

20. Pan, G.; Wu, Q.; Ding, G.; Wang, W.; Li, J.; Xu, F.; Zhou, B. Deep Stacked Autoencoder-Based Long-Term Spectrum Prediction Using Real-World Data. IEEE Trans. Cogn. Commun. Netw.; 2023; 9, pp. 534-548. [DOI: https://dx.doi.org/10.1109/TCCN.2023.3254524]

21. Sun, J.; Wang, J.; Ding, G.; Shen, L.; Yang, J.; Wu, Q.; Yu, L. Long-term spectrum state prediction: An image inference perspective. IEEE Access; 2018; 6, pp. 43489-43498. [DOI: https://dx.doi.org/10.1109/ACCESS.2018.2861798]

22. Alkhouri, I.; Joneidi, M.; Hejazi, F.; Rahnavard, N. Large-Scale Spectrum Occupancy Learning via Tensor Decomposition and LSTM Networks. Proceedings of the 2020 IEEE International Radar Conference (RADAR); Washington, DC, USA, 28–30 April 2020; pp. 677-682.

23. Liu, X.; You, X.; Zhang, X.; Wu, J.; Lv, P. Tensor Graph Convolutional Networks for Text Classification. AAAI; 2020; 34, pp. 8409-8416. [DOI: https://dx.doi.org/10.1609/aaai.v34i05.6359]

24. He, M.; Wei, Z.; Wen, J.R. Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisited. Adv. Neural Inf. Process. Syst.; 2022; 35, pp. 7264-7276.

25. Hochreiter, S.; Schmidhuber, J. Long Short-term Memory. Neural Comput.; 1997; 9, pp. 1735-1780. [DOI: https://dx.doi.org/10.1162/neco.1997.9.8.1735] [PubMed: https://www.ncbi.nlm.nih.gov/pubmed/9377276]

26. Teganya, Y.; Romero, D. Deep Completion Autoencoders for Radio Map Estimation. IEEE Trans. Wirel. Commun.; 2022; 21, pp. 1710-1724. [DOI: https://dx.doi.org/10.1109/TWC.2021.3106154]

27. Fang, S.; Wen, X. A Prediction Method of Radio Environment Map. ZL202211469821.0, 7 April 2023.