1. Introduction
The increasing interdependencies among food-energy-water-environmental (FEWE) sectors require integrated coherent planning and coordinated policies for sustainable development and security nexus. The sectors become more interconnected because they utilize common, often rather limited, resources, both natural (e.g., land, water, air quality) and socio-economic (e.g., investments, labor force). For example, land and water are needed not only for agricultural production but also for hydropower generation, coal mining and processing, power plants cooling, renewable energy, and hydrogen production.
The energy sector is one of the largest and fast-growing water consumers. The more water is used by the energy sector, the more vulnerable energy production and production in other water-dependent sectors, becomes [1]. Climate change concerns and rapid energy sector transition towards renewable energy sources tighten the links between energy and agricultural markets. Agricultural commodities have become an important energy resource because of biofuels mandates. Vulnerability of crop yields, increasing grain demand, and price volatility directly and indirectly influence the market for fuel transportation and transportation costs [2]. At the same time, crude oil, gas, and electricity markets and prices have an effect on agricultural production costs and prices [2,3,4].
Additional linkages and interactions in FEWE systems emerge due to the introduction of new technologies, e.g., intermittent renewables, advanced irrigation, hydrogen production, water desalination, etc. The interdependencies can trigger systemic failures if sectoral policies ignore cross-sectoral interconnectedness [5]. The FEWE security nexus management requires an integrated approach to understand and deal with the numerous interactions between the FEWE systems [6]. This approach, compared to independent analysis, contributes immensely to sustainable development within and across sectors and scales.
Comprehensive sectoral models are being developed for planning and policy assessment in respective sectors. These models account for multiple details of sectoral production planning and resource utilization, including the analysis of factors and drivers determining demand, supply, and commodity price relationships [7,8]. For example, energy sector models investigate the interactions between renewables and fossil fuels, address energy market volatilities, and analyze the effects of new technologies and policy interventions to develop energy scenarios [7,8,9,10,11,12]. Land use and agricultural models support decision making regarding agricultural policies, analyze land potentials for the production of sufficient agricultural commodities to fulfill food security and biofuels mandates [13,14,15], and assess the effects of policy responses, including export bans and high export taxes, to cope with production shortfalls and offset increasing prices [2]. As a rule, these models consider and optimize sectoral goals accounting for respective production, demand, resource availability, and environmental quality constraints. Goals, production targets, resource demand, and quality in other sectors are hardly, if at all, accounted for. Thus, the limitation of the detailed sectoral models for FEWE security nexus lies in their restricted ability to consider dependencies and interactions beyond the defined sectoral system [2,3,12], e.g., cross-sectoral resource competition and joint production and demand relationships. Sectoral models cannot properly account for the objectives of a larger system. The feedbacks and interactions among FEWE systems are often analyzed through CGE (Computational General Equilibrium) and/or IAMs (Integrated Assessment models) [6]. These models, unfortunately, suffer from the lack of necessary details of sectoral models. They involve considerable simplifications and aggregations and, therefore, may not be sufficiently fit to provide insightful conclusions [16,17,18,19].
In this situation, the analysis of systemic regulations for FEWE security nexus can rely on distributed models’ optimization and linkage methods enabling the establishment of relationships and dialogues between separate models of FEWE systems for the analysis of coordinated solutions without requiring to share or reveal systems-specific information.
In this paper, we consider the problem of linking sectoral and/or regional linear programming (LP) models into a cross-sectoral integrated model (IM) in the presence of joint constraints when “private” information regarding sectoral/regional models’ is not available or cannot be shared by modeling teams (sectoral agencies), i.e., under asymmetric information (ASI). Such linkage is necessary for producing truly integrative management scenarios, especially when sectors utilize and compete for common resources or act under joint regulatory constraints or environmental mandates. The approach provides a means of decentralized cross-sectoral coordination and enables the investigation of policies in interdependent systems in a “decentralized” fashion. This facilitates more stable and resilient systems’ performance and resource allocation as compared to the independent policies designed by separate models without accounting for interdependencies.
Cross-sectoral policy analysis in the presence of joint constraints can be addressed, e.g., with the generalized Nash equilibrium (GNE) approach [20]. Böhringer and Rutherford (2009) [21] consider linking energy system mathematical programming models into a general equilibrium (GE) model of the overall economy. Ermoliev and von Winterfeldt (2012) [22] discuss the game-theoretic approaches, e.g., the Stackelberg leadership model, and their complexity due to the assumptions that each player (sector/region) has information about other players’ goals and constraints. Traditional integrated deterministic optimization modeling also assumes full knowledge about the systems. It incorporates goals, individual and joint constraints, and data of all systems into a single code (hard integration), which can be considered as a multi-criteria optimization problem [23].
Our approach for linking separate optimization models under ASI is based on the parallel solving of equivalent nonsmooth optimization models by a simple iterative stochastic quasigradient (SQG) procedure [24,25] based on subgradients or generalised gradients [25,26,27] converging to an optimal welfare-maximizing linkage solution, i.e., to the solution of a “hard-integrated” model. This approach does not require sharing details about models’ specifications. We can assume there is a network of distributed computers connecting computer models of a “social planner” (decision-makers or regulatory agencies), who attempt to achieve the best result for all sectors/regions (parties) involved. The linkage procedure can be interpreted as a kind of a “decentralized market system” [28]. According to this procedure, sectors/regions independently and in parallel optimize their goal functions under individual constraints without considering joint constraints. In general, joint constraints impose restrictions on total production, resource use, and emissions by all sectors/regions. The constraints can establish supply–demand relationships between the systems enabling the estimation of optimal production, resource use, and emission quotas for each system. The balance between the total energy (including biofuels) production and demand defines energy security; agricultural production and consumption reflect food security; total emissions and pollution constraints correspond to environmental security. The joint FEWE constraints satisfaction establishes the FEWE security nexus [29]. After independent optimization using initial approximations of various (e.g., production, resource use, emission) quotas, the sectors/regions provide the social planner with the information on their actual production, resource use, and respective shadow prices. The planner checks if the joint constraints are fulfilled. If not, i.e., there is “excess demand” or “excess supply” (i.e., total resource use, production, emissions by all systems are higher/lower than required), the planner revises the individual systems’ quotas via shifting their current approximation in the direction defined by the corresponding dual variables. Thus, shadow prices signal systems to adjust their activities accordingly. Formally, the procedure is described in Section 2.3 and Appendix A.
In this way, the linkage allows us to avoid the “hard linking” of models in a single code, which is not possible because the systems do not want to share the information or because the individual models are too detailed and complex to be “hard-linked”. The approach saves reprogramming efforts and allows parallel distributed (decentralized) computations of sectoral models instead of a large-scale integrated (centralized) model. This also preserves the original models in their initial state for other linkages. The use of detailed sectoral and regional models instead of their aggregated simplified versions also enables us to account for critically important local details. Similar computerized decentralized “negotiation” processes between distributed models (agents) have been developed for the design of robust carbon trading markets (e.g., [30] and references therein) and for the allocation of water quotas (e.g., [31]). The linkage procedure can be considered as a new machine learning algorithm, namely, as a general endogenous reinforced learning problem of how software agents (models) take decisions in order to maximize the cumulative reward (total welfare) [32].
The paper is organized as follows. Section 2 discusses the problem of models’ linkage under joint constraints. Section 2.1 presents a short overview and the main shortfalls of several existing approaches, Section 2.2. formulates the problem of distributed LP models’ linkage in the presence of joint resource constraints and ASI, and Section 2.3 outlines the linkage solution procedure based on the parallel solving of equivalent nonsmooth optimization model following a simple iterative subgradient algorithm. The details and main properties of the algorithms are presented in the Appendix A. Section 3 illustrates the application of the methodology to link detailed energy and agricultural production planning models under joint constraints on water and land use. In addition, the joint constraints can impose restrictions on total energy production by the energy sector (electricity, gas, diesel, etc.) and land use sector (biodiesel, methanol); total energy use by energy and agricultural sectors; total agricultural production by distributed farmers/regions, etc. Section 4 concludes and outlines potential further extensions of the approach, for example, to include more details of energy and natural resources dynamics in general.
2. Linking Distributed Optimization Models under Joint Resource Constraints
2.1. Social Equilibrium Game Approach
In the absence of coordination between systems (sectors, regions), they can act selfishly and aim at maximizing their own objective function. They attempt to secure as high resource quotas as possible. Such a situation can be modeled using the non-cooperative game-theoretic framework. For example, social equilibrium games [20] have been formulated to include joint constraints. The generalized Nash equilibrium (GNE) solution, if it exists, allocates production and resources among systems (sectors/regions), fulfilling the joint constraint. However, the decisions are made independently, and collective efforts for managing common resources are ignored. Importantly, the existence, uniqueness, and stability of the GNE, as well as a realistic large-scale implementation of this concept, cannot be guaranteed, as emphasized by Harker (1991) [20]. Moreover, in [20], it is highlighted that the GNE solutions set are rarely connected. Hence, a complete analysis of equilibriums, in this case, is a complex task, requiring additional assumptions.
The analysis can become even more complex if the joint constraints are based on the equilibrium (optimality) conditions arising from the problem formulated in the form of a principal-agent game or a leader-follower Stackelberg game [22]. For example, in the case of nonsmooth goal functions required for linking systems under ASI (distributed models’ optimization), the use of optimality conditions would require implicit sets of generalized gradients. Due to the computational complexity, heuristic methods are often used; however, they lack rigorous convergence proof.
Linking bottom-up mathematical programming models of the energy system into a top-down general equilibrium model of the overall economy is discussed by Böhringer and Rutherford in [21]. The paper shows that the formulation of market equilibrium conditions using complementarity equations permit the integration of models, but the convergence of the iterative procedure integrating the models cannot be guaranteed. In specific cases, models of general equilibrium are reduced to optimization problems [33].
Ermoliev and von Winterfeldt (2012) [3] demonstrate that the complexity of the game-theoretic approaches is due to quite unrealistic assumptions that each player (sector/region) is in possession of the knowledge on exact and unique responses of other players. Therefore, even in the simplest linear cases, this assumption leads to extremely complex discontinuous problems. More realistic assumptions of uncertain response functions in combination with a concept of robust decisions results in stable large-scale solutions.
There exists a vast literature on important problems and methods for distributed systems’ optimization under joint constraints, e.g., optimal control and economic dispatch in smart grids [34], agricultural production planning for the multi-farmer systems [35], network optimization [36,37,38], and optimal transportation problems [39,40,41]. Yet, these approaches consider the optimization of a total objective function representing a sum of individual objective functions of the involved systems. Thus, the problems assume full information regarding the systems is available to a social planner. They are formulated similarly to traditional integrated “centralized” optimization modeling, combining goals, constraints, and data of all models into a single code.
Our problem is more complex as it deals with the coordination of decentralized systems’ models in the presence of joint constraints and ASI. In this case, the approach is based on a specific iterative nonsmooth optimization procedure (see Section 2.2 and Section 2.3 and Appendix A). As we noted, the integrated solution of separate LP models under ASI cannot be accomplished by LP methods. In Section 2.2, we formulate the problem of distributed systems optimization in the presence of joint resource constraints under ASI, and in Section 2.3, we present the models’ linkage algorithm.
2.2. LP Models under Joint Constraints
Let us formulate the basic problem of separate sectoral or regional LP models optimization under joint resource constraints. Consider separate models of systems in the following LP form:
(1)
(2)
(3)
where components of vector are variables to be determined, vector defines system-specific demand or resource constraints, and vector corresponds to net unit profits, . The dependence of system on common resources are defined by constraint (4)(4)
where defines resource quota allocated to system . Therefore, Formula (3) represents system-specific constraints and Formula (4) establishes systemic relations among systems by allocating quotas . The quotas fulfil the joint resource constraint on the use of common resources(5)
where matrix defines the marginal resource use by system and is the total available resource, . Thus, each system maximizes its objective function (1) by choosing and from the feasible set defined by (2) and (3), so that (4) and (5) are also fulfilled.In the presence of full information regarding a system, the problem of models’ linkage can be formulated and solved by a central planner (regulator) as a total net profit maximization
(6)
s.t. to constraints (2)–(5), . In this model, the net profits are defined as the amount of money left after subtracting production costs from the total profit. In a more general case, the net profits can account for taxes, interest, and other expenses.However, when the information on , , , , of system is not available to the planner, the integrated LP model (2)–(6) under ASI cannot be solved by LP method due to the lack of common information about submodels.
We propose the consistent approach for linking distributed optimization models under ASI based on the parallel solving of equivalent nonsmooth optimization models following a simple iterative subgradient algorithm. The convergence and other properties of the algorithm are presented in Appendix A. The proposed linkage approach does not require full, common information regarding the models’ specification, and it can be seen as an endogenous reinforced learning algorithm describing how distributed agents (models) can make decisions to maximize the “cumulative reward”. Section 2.3. outlines the algorithm.
2.3. Nonsmooth Model and Linking Algorithm
The basic nonsmooth optimization model under ASI can be solved by a specific iterative subgradient linkage algorithm. For a given vector let us denote by the optimal value of function (6) under constraints (2)–(4). Therefore, , where are concave nonsmooth functions. In this function are optimal solutions of (1)–(4).
The required linkage algorithm is defined as a subgradient procedure maximizing function s.t. the joint constraints (5). These constraints identify the feasible set of the algorithm, which can be denoted as . Therefore, an optimal solution maximizing , , also defines an optimal linkage or a solution of the integrated LP model under ASI. In the following, we assume the existence of solutions , , for all .
The linkage algorithm can be summarized as follows. Imagine there is a network of distributed computers connecting submodels, say sectors, with a computer of a social planner. At the initial step, sectors , , use arbitrary chosen vectors of resource quotas. They submit the information on to the central computer. The computer updates quotas by projecting them onto set defining a first feasible approximation All sectors independently solve models (1)–(4) with resource quotas , calculate shadow prices of common resources (constraint (4)), and submit them to the central computer. The central computer calculates with a step-size such that the product corresponds to the scale of . Vector is projected onto to derive quotas . At the iteration the algorithm derives the next approximation of quotas by shifting in the direction of vector , according to the following procedure.
(7)
where is a step-dependent multiplier, which is a method’s parameter, is the orthogonal projection operator onto set defined by (5). Vector is a generalized gradient or a subgradient of function at . The step-size is chosen from rather general and natural requirements: , , , (e.g., , because subgradients (generalized gradients) are not, in general, the increasing directions of functions.At each iteration, all sectors independently calculate stopping criteria and submit values to the central computer. If , where is an admissible accuracy, then the algorithm stops. Otherwise, it continues further.
The convergence theorem shows that the parallel independent optimization (linkage) of sectoral/regional models according to this algorithm without revealing sectoral/regional information is possible due to the additional requirement . This allows us to prove the convergence of solutions (linkages) rather than the convergence of objective function . The convergence of the proposed linkage algorithm under ASI is based on the theory of (continuously) non-differentiable optimization. The details of convergence theorem, stopping criterion, subgradients, and computing projections can be found in Appendix A.
3. Linking Energy and Agricultural Models for Food-Energy-Water Nexus
The proposed iterative algorithm has been applied for linking energy and agricultural sectoral models under joint constraints on water and land use. Both models can be used for optimal energy and agricultural production and allocation planning. In the following, we only briefly outline the models. Further details can be found, for example, in [9,10,11,13,14,15]. The models are spatially explicit, which allows us to link the models across locations and thus control local drivers having significant implications on the overall results of models’ integration.
The energy model incorporates the main stages of energy flows from resources to demands: energy extraction from energy resources, primary energy conversion into secondary energy forms, transport and distribution of energy to the point of end, and conversion into products for end-users to fulfill specific demands. The structure of the model is such that it can incorporate various energy resources, e.g., coal, gas, crude oil, renewables. Primary energy sources include coal, crude oil, gas, solar, wind, etc.; secondary energy sources are fuel oil, methanol, hydrogen, electricity, ammonia, etc.; final energy products are coal, fuel oil, gas, hydrogen, ammonia, methanol, electricity, etc. Demands for useful energy products come from main sectors of the economy: industrial, residential, transport, agricultural, water, and energy. Each technology is characterized by uniting costs, efficiency, lifetime, emissions, etc. Additional sectoral (and cross-sectoral joint) constraints are imposed to capture the requirements and the limitations on natural resource use and availability and investments. The model can include existing technologies, as well as new zero-carbon green technologies, at the beginning of implementation or even in the research stage, e.g., various renewable and carbon-capturing technologies.
The agricultural model includes main crops and livestock production and management systems, characterized by systems-specific production costs, water and fertilizer requirements, emission factors, and other parameters. The supply of crops and livestock products need to cover food, feed, and biofuel demands and fulfill security constraints. The food security constraint requires that the energy and nutrients consumption from grain and livestock products is not less than the required kilocalories and nutrients needed to satisfy dietary requirements in cereals, vegetables, and animal products (meat and dairy products). Livestock feeds fulfill livestock dietary requirements in energy intake measured in megacalories. Biofuel production from crops (and agricultural residues) must fulfill biofuel mandates. In the model, land uses comprise agricultural (crop and pasture) land, grassland, and natural land. Land use changes can be regulated by setting regulatory constraints on land expansion and conversion. Security constraints introduce competition for limited natural resources (land and water) among different land uses.
Energy and agricultural sectors compete for common land and water resources. Assume that regional planners, decision makers, and sectoral authorities pursue a goal to minimize costs and maximize profits from energy and agricultural production under various joint balance (supply-demand) and resource constraints to fulfill the energy and agricultural demands. Namely, the goal is to choose a portfolio of energy technologies to be installed and operated to produce, convert, and transfer energy products among locations; and a portfolio of agricultural technologies and management systems to produce and transfer among locations agricultural commodities fulfilling constraints on natural resources, environmental pollution, and end-product demands. The models include relevant risk-related systems’ performance criteria. These performance measures enable a better understanding of how systems (individually and jointly) might perform in the uncertain environment, in the presence of climate change, weather variability, market uncertainties, etc. A better understanding of how interdependent energy-water-agricultural systems may operate and how dangerous impacts of inappropriate decisions may be can motivate regional and sectoral planners, experts, and involved stakeholders in making cross-sectoral coherent and risk-adjusted robust decisions [9,10,11,14,15,22,29].
3.1. Energy, Water, and Agricultural Security Nexus in Shanxi Province, China
In the case study in Shanxi province, China [15], the energy model includes coal-based industries and processes, i.e., mining, washing, chemical production, and power generation. Most of the electricity in China comes from coal, which accounted for approximately 65% of the electricity generation mix in 2019. The coal-based technologies consume a vast amount of water, for example, for coal mining and washing, coal power plants cooling and steam production. About 51% of China’s coal reserves lie in areas of high or extreme water scarcity, and about 30% are in water-stressed regions. Shanxi province is one of them.
The integrated energy-agricultural-water model is formulated as follows. A regional planner decides on the amount of coal and type , to be extracted in location , transported to location , , and converted by technology . In addition, decisions are made concerning the amount of agricultural commodities k, to be produced in location j and exported to location . The overall goal of the planner is to minimize the total costs related to energy (coal) and agricultural production, transportation, and conversion.
Individual sectoral goal functions are formulated as follows
(8)
and(9)
for energy (8) and agricultural (9) sectors. Production costs define all components of coal production costs, including extraction and washing, of a unit (tonne) coal of type in location , transportation costs represent all costs associated with transporting unit coal from location to location , define conversion costs of a unit coal by technology in location , denote agricultural production cost per unit (tonne) agricultural commodity in location , and stands for the transportation costs of a unit agricultural commodity from to , The energy model includes energy security constraints ensuring consumers demands for end products from coal, for example, electricity, heat, coke, gas, and oil:(10)
where denotes the conversion efficiency of coal in location by technology , the end product , and stands for the end product demand.Agricultural production is required to fulfil food security constraints defined by the sufficient kilocalories and nutrients provided to the population from agricultural commodities k in location :
(11)
where is the required production of agricultural commodity in location m to meet food security requirements, which can be calculated according to daily nutrients and calories requirements per capita approved by the World Health Organization (WHO).Sectoral land use constraints
(12)
and(13)
incorporate land demand by coal (12) and crop (13) production activities, where and are land use constraints for coal and agricultural sectors in location , respectively. In Equation (12), parameter defines the area that can deteriorate (e.g., subside) as a result of coal mining of unit coal in location , is a portion of agricultural land overlapping with a coal field in location , land reclamation rate (or efficiency rate) is defined by parameter for coal in location , and is a coal fraction that allows us to calculate the land under reject material. In Equation (13), parameter defines the area required for a unit crop production in location . Equation (14) introduces the restriction on the total land use in location by energy and agricultural sectors(14)
Total available water for both sectors and sectoral water quotas ( and ) significantly affect the choice of coal and crop (energy) production technologies through water utilization constraints:
(15)
and(16)
where and are quotas on water use by coal and agricultural activities in location , defines water requirement for a unit coal production in location , is water required for a unit coal conversion in location , and is water required for a unit crop k production in location j. Water use for coal and for agricultural production are constrained by the total water available in :(17)
The models can be extended by including various other constraints, for example, water and air quality, SO2 and CO2 emissions targets, biofuel production mandates, etc.
In the condition of ASI, the planner does not have full information regarding separate LP energy ((8), (10), (12) and (15)) and agricultural ((9), (11), (13) and (14)) submodels. To link the models under joint constraints (14) and (17) we implement procedure (7). Thus, at the initial step s = 0, individual sectoral models are solved using initial sectoral land and water quotas , and , . Resource quotas , , at step are adjusted according to (7) using shadow prices (dual variables) of energy and agricultural sectors land and water resource constraints
(18)
(19)
(20)
(21)
and constraints (14) and (17).3.2. Selected Results
Results are compared for three cases: 1. Separately optimized energy and agricultural models; 2. The hard-linked integrated model (one-code model); 3. Separate models integrated via the linkage procedure (7). In case 1, the sectors are not restricted by joint resource constraints, and therefore the net profits can be higher than in cases 2 and 3; however, this is a misleading conclusion. In cases 2 and 3, results show that the iterative linkage process converges rather quickly. In 10 iterations, the optimal value of the integrated linked model (case 3) is almost equal to the optimal value of the integrated “hard-linked” model (case 2). In case 3, the proposed linkage algorithm allows to link models installed on remote computers through an iterative dialogue establishing optimal redistribution of water and land quotas among the sectors and locations.
Figure 1 illustrate the non-monotonic convergence of the linkage algorithm for three different scenarios of initial quotas allocated to energy and agricultural sectors. The choice of the step-size in (7) affects the convergence rate, the value of the product must correspond to the value of solutions .
4. Conclusions
In the paper, we consider the problem of linking separate distributed sectoral and/or regional optimization models into an inter-sectoral integrated model. The approach for linking models is based on an iterative algorithm that does not require models to exchange full information regarding their specifications. The resource quotas for each system and each resource are recalculated by systems independently and in parallel via shifting their current approximation in the direction defined by the corresponding dual variables from the primal sectoral optimization problem. In this way, the approach allows to avoid hard linking of the models in a single code that saves programming time and enables parallel distributed computations of sectoral models instead of a large-scale integrated model, i.e., addressing the well-known “curse of dimensionality” and large-scale data harmonization (management). This also preserves the original models in their initial state for other possible linkages. The proposed computational algorithm is based on an iterative stochastic quasigradient (SQG) procedure of, in general, nonsmooth nondifferentiable optimization converging to a socially optimal solution maximizing an implicit nested non-differentiable social welfare function. The convergence of the algorithm relies on the duality theory and non-differentiable optimization [20]. The iterative solution procedure can be used for robust estimation and machine learning problems. In particular, it can be viewed as an endogenous reinforced learning problem [32].
The iterative SQG-based methods and their stochastic versions are intended for the robust optimization of deterministic and stochastic systems with a large number of decision variables and scenarios of uncertainties due to the ability of these methods to link scenario-simulation and optimization procedures [42,43]. Therefore, the proposed method will be developed further for linking stochastic models enabling integrated management of global systemic risks, which are not detectable under traditional independent sectorial management ignoring cross-sectoral risk exposures. Fundamentally important to the possible extension of the presented method is the case of stochastic sectoral/regional models with interdependent systemic uncertainties and risks shaped by decisions of various agents. This includes the mitigation of floods by new land use decisions, for example, affecting flood scenarios. As a rule, this makes it impossible to separate scenario-generation and optimization processes calling for linking both simulation and optimization procedures in a way similar to algorithm (7), thus combining simulations of scenarios, new optimization steps, new simulation of scenarios, and so on. In this case, we can determine new types of machine learning processes.
In the paper, we referred to linking regional and/or sectoral models. More generally, the problem can address the linkage of models at different spatial and temporal resolutions (e.g., local-global, considering more details of energy and natural resources dynamics in general). Therefore, the linkage problem can be formulated much more generally in terms of sub-models and integrated models, and the approach presented in this paper can still be applicable.
The linkage of models is, in a sense, opposite to decomposition methods. While in the decomposition (e.g., [44,45]), we split an existing integrated optimization model into a number of smaller sub-models, in the linkage, we obtain an integrated model of the system by linking existing explicitly unknown sub-models. The proposed linkage procedure provides flexibility, enabling the simultaneous use of linkage and decomposition procedures, in other words, endogenously disaggregating models to make their further integration (linkage) more efficient.
Conceptualization, Y.E., A.G.Z., V.L.B., T.E., P.H., E.R., N.K. and M.O.; methodology, Y.E., T.E., E.R.; software, Y.E., T.E., E.R.; validation, Y.E., A.G.Z., V.L.B., T.E., P.H., E.R., N.K. and M.O.; formal analysis, Y.E., A.G.Z., V.L.B., T.E., P.H., E.R., N.K. and M.O.; investigation, Y.E., A.G.Z., V.L.B., T.E., P.H., E.R. and N.K.; data curation, T.E. and E.R.; writing—original draft preparation, Y.E., T.E., P.H., E.R. and M.O.; writing—review and editing, Y.E., A.G.Z., V.L.B., T.E., P.H., E.R., N.K. and M.O.; visualization, Y.E., T.E. and E.R. All authors have read and agreed to the published version of the manuscript.
This research was partially funded by EU projects COACCH (776479).
Not applicable.
Not applicable.
The study does not report any data.
The development of linkage algorithms and case studies are part of methodological research of EU projects COACCH (776479) and a joint project between IIASA and National Academy of Sciences (Ukraine) on “Integrated robust management of food-energy-water-land use nexus for sustainable development”.
The authors declare no conflict of interest.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figure 1. Convergence of the iterative linking procedure in terms of the goal function values [Forumla omitted. See PDF.]. Vertical axis displays net profits; the iteration step is marked on the horizontal axis. The three curves (Scen1, Scen2, Scen3) correspond to three different initial land and water quota scenarios at s = 0.
Appendix A
Appendix A.1. Convergence
Proposition (stopping criterion, subgradients): Assume there exist solutions
(a) Functions
(b) The dual problem to (1)–(3) has a solution
From this proposition follows the following important fact ([
(c) For any feasible solution
Therefore, procedure (7) is a specific subgradient algorithm for maximizing the (continuously) non-differentiable concave function
The following proposition shows that
Appendix A.2. Convergence Theorem (Non-Monotonic Convergence)
Assume that
(1) The feasible set
(2) Step size
Then
The following sequence of
Appendix A.3. Computing the Projection
The orthogonal projection
Appendix A.4. Mixed Constraints
Joint constraints (5) may have the following form:
References
1. Carter, N. Energy’s Water Demand: Trends, Vulnerabilities, and Management. CRS (Congressional Research Service) Report for Congress, 7-5700, R41507. 2020; Available online: https://digital.library.unt.edu/ark:/67531/metadc31387/ (accessed on 4 January 2021).
2. Baffes, J.; Dennis, A. Long Term Drivers of Food Prices. Working Paper 2013; World Bank: Washington, DC, USA, 2013.
3. Taghizadeh-Hesary, F.; Rasoulinezhad, E.; Yoshino, N. Energy and food security: Linkages through price volatility. Energy Policy; 2019; 128, pp. 796-806. [DOI: https://dx.doi.org/10.1016/j.enpol.2018.12.043]
4. Van Eyden, R.; Difeto, M.; Gupta, R.; Wohar, M.E. Oil price volatility and economic growth: Evidence from advanced economies using more than a century’s data. Appl. Energy; 2019; 233–234, pp. 612-621. [DOI: https://dx.doi.org/10.1016/j.apenergy.2018.10.049]
5. Grafton, Q.; McLindin, M.; Hussey, K.; Wyrwoll, P.; Wichelns, D.; Ringler, C.; Garrick, D.; Pittock, J.; Wheeler, S.; Orr, S. et al. Responding to global challenges in Food, Energy, Environment and Water: Risks and options assessment for decision-making. Asia Pac. Policy Stud.; 2016; 3, pp. 275-299. [DOI: https://dx.doi.org/10.1002/app5.128]
6. Howells, M.; Hermann, S.; Welsch, M.; Bazilian, M.; Segerstrom, R.; Alfstad, T.; Gielen, D.; Rogner, H.-H.; Fischer, G.; Van Velthuizen, H. et al. Integrated analysis of climate change, land-use, energy and water strategies. Nat. Clim. Chang.; 2013; 3, pp. 621-626. [DOI: https://dx.doi.org/10.1038/nclimate1789]
7. Foster, E.; Contestabile, M.; Blazquez, J.; Manzano, B. The unstudied barriers to widespread renewable energy deployment: Fossil fuel price responses. Energy Policy; 2017; 103, pp. 258-264. [DOI: https://dx.doi.org/10.1016/j.enpol.2016.12.050]
8. Cansado-Bravo, P.; Rodríguez-Monroy, C. The Effects of structural breaks on energy resources in the long run. Evidence from the last two oil price crashes before COVID-19. Designs; 2020; 4, 49. [DOI: https://dx.doi.org/10.3390/designs4040049]
9. Gritsevskyi, A.; Nakicenovic, N. Modeling uncertainty of induced technological change. Energy Policy; 2000; 26, pp. 907-921. [DOI: https://dx.doi.org/10.1016/S0301-4215(00)00082-3]
10. Messner, S.; Golodnikov, A.; Gritsevskyi, A. A stochastic version of the dynamic linear programming model MESSAGE III. Energy; 1996; 21, pp. 775-784. [DOI: https://dx.doi.org/10.1016/0360-5442(96)00025-4]
11. Cano, E.L.; Moguerza, J.M.; Ermolieva, T.; Yermoliev, Y. A strategic decision support system framework for energy-efficient technology investments. TOP; 2016; 25, pp. 249-270. [DOI: https://dx.doi.org/10.1007/s11750-016-0429-9]
12. Dodder, R.; Elobeid, A.; Johnson, T.; Kaplan, P.; Kurkalova, L.; Tokgoz, S. Environmental Impacts of Emerging Biomass Feedstock Markets: Energy, Agriculture, and the Farmer; CARD Working Paper Series; Iowa State University: Ames, IA, USA, 2011.
13. Havlík, P.; Schneider, U.A.; Schmid, E.; Boettcher, H.; Fritz, S.; Skalský, R.; Aoki, K.; de Cara, S.; Kindermann, G.; Kraxner, F. et al. Global land-use implications of first and second generation biofuel targets. Energy Policy; 2011; 39, pp. 5690-5702. [DOI: https://dx.doi.org/10.1016/j.enpol.2010.03.030]
14. Borodina, O.; Borodina, E.; Ermolieva, T.; Ermoliev, Y.; Fischer, G.; Makowski, M.; van Velthuizen, H. Sustainable agriculture, food security, and socio-economic risks in Ukraine. Managing Safety of Heterogeneous Systems, Lecture Notes in Economics and Mathematical Systems; Ermoliev, Y.; Makowski, M.; Marti, K. Springer: Berlin/Heidelberg, Germany, 2012; pp. 169-185.
15. Gao, J.; Xu, X.; Cao, G.; Ermoliev, Y.M.; Ermolieva, T.Y.; Rovenskaya, E.A. Optimizing regional food and energy production under limited water availability through integrated modeling. Sustainability; 2018; 10, 1689. [DOI: https://dx.doi.org/10.3390/su10061689]
16. Gambhir, A.; Butnar, I.; Li, P.-H.; Smith, P.; Strachan, N. A review of criticisms of Integrated Assessment Models and proposed approaches to address these through the lens of BECCS. Energies; 2019; 12, 1747. [DOI: https://dx.doi.org/10.3390/en12091747]
17. Bosetti, V.; Marangoni, G.; Borgonovo, E.; Diaz Anadon, L.; Barron, R.; McJeon, H.C.; Politis, S.; Friley, P. Sensitivity to energy technology costs: A multi-model comparison analysis. Energy Policy; 2015; 80, pp. 244-263. [DOI: https://dx.doi.org/10.1016/j.enpol.2014.12.012]
18. Gielen, D.J.; Gerlagh, T.; Bos, A.J.M. MATTER 1.0—A MARKAL Energy and Materials System–Model Characterisation; ECN Report ECN-C-98-085 ECN: Petten, The Netherlands, 1998.
19. Doukas, H.; Nikas, A.; González-Eguino, M.; Arto, I.; Anger-Kraavi, A. From Integrated to integrative: Delivering on the Paris Agreement. Sustainability; 2018; 10, 2299. [DOI: https://dx.doi.org/10.3390/su10072299]
20. Harker, P.T. Generalized Nash games and quasi-variational inequalities. Eur. J. Oper. Res.; 1991; 54, pp. 81-94. [DOI: https://dx.doi.org/10.1016/0377-2217(91)90325-P]
21. Böhringer, C.; Rutherford, T.F. Integrated assessment of energy policies: Decomposing top-down and bottom-up. J. Econ. Dyn. Control; 2009; 33, pp. 1648-1661. [DOI: https://dx.doi.org/10.1016/j.jedc.2008.12.007]
22. Ermoliev, Y.; von Winterfeldt, D. Systemic risks and security management. Managing Safety of Heterogeneous Systems: Decisions under Uncertainty and Risks. Lecture Notes in Econom. Math. Systems; Ermoliev, Y.; Makowski, M.; Marti, K. Springer: New York, NY, USA, 2012; Volume 658, pp. 19-49.
23. Ogryczak, W. Multiple criteria linar programming model for portfolio selection. Ann. Oper. Res.; 2000; 97, pp. 143-162. [DOI: https://dx.doi.org/10.1023/A:1018980308807]
24. Ermoliev, Y. Two-stage stochastic programming: Stochastic quasigradient methods. Encyclopedia of Optimization; Floudas, C.A.; Pardalos, P.M. Springer: New York, NY, USA, 2009; pp. 3955-3959.
25. Ermoliev, Y. Methods of Stochastic Programming; Nauka: Moscow, Russia, 1976; (In Russian)
26. Ermoliev, Y.; Norkin, V. On nonsmooth and discontinuous problems of stochastic systems optimization. Eur. J. Oper. Res.; 1997; 101, pp. 230-244. [DOI: https://dx.doi.org/10.1016/S0377-2217(96)00395-5]
27. Rockafeller, T. The Theory of Subgradient and Its Application to Problems of Optimization: Convex and Nonconvex Functions; Helderman: Berlin, Germany, 1981.
28. Ermoliev, Y.; Klaassen, G.; Nentjes, A. Incomplete Information and the Cost-Efficiency of Ambient Charges; Working Paper WP-93-72 International Institute for Applied Systems Analysis, IIASA: Laxenburg, Austria, 1993.
29. Ermolieva, T.; Havlik, P.; Ermoliev, Y.; Khabarov, N.; Obersteiner, M. Robust management of systemic risks and food-water-energy-environmental security: Two-stage strategic-adaptive GLOBIOM model. Sustainability; 2021; 13, 857. [DOI: https://dx.doi.org/10.3390/su13020857]
30. Ermoliev, Y.; Ermolieva, T.; Jonas, M.; Obersteiner, M.; Wagner, F.; Winiwarter, W. Integrated model for robust emission trading under uncertainties: Cost-effectiveness and environmental safety. Technol. Forecast. Soc. Chang.; 2015; 98, pp. 234-244. [DOI: https://dx.doi.org/10.1016/j.techfore.2015.01.003]
31. Ermoliev, Y.; Michalevich, M.; Uteuliev, N.U. Economic modeling of international water use (The case of the Aral Sea Basin). Cybern. Syst. Anal.; 1995; 30, pp. 10-19. [DOI: https://dx.doi.org/10.1007/BF02366562]
32. Ermolieva, T.; Ermoliev, Y.; Obersteiner, M.; Rovenskaya, E. Two-Stage Nonsmooth Stochastic Optimization and Iterative Stochastic Quasigradient Procedure for Robust Estimation, Machine Learning and Decision Making. Resilience in the Digital Age. Lecture Notes in Computer Science, Vol 12660; Roberts, F.S.; Sheremet, I.A. Springer: Berlin/Heidelberg, Germany, 2021; pp. 45-74. [DOI: https://dx.doi.org/10.1007/978-3-030-70370-7_4]
33. Norkin, V. Reducing models of general economic equilibrium to optimization problems. Cybern. Syst. Anal.; 1999; 35, pp. 743-753. [DOI: https://dx.doi.org/10.1007/BF02733408]
34. Prakash, R.; Nygard, K.E. Distributed Linear Programming Models in a Smart Grid; Springer International Publishing: Berlin/Heidelberg, Germany, 2017.
35. Alemany, M.; Esteso, A.; Ortiz, A.; Pino, M.D. Centralized and distributed optimization models for the multi-farmer crop planning problem under uncertainty: Application to a fresh tomato Argentinean supply chain case study. Comput. Ind. Eng.; 2021; 153, 107048. [DOI: https://dx.doi.org/10.1016/j.cie.2020.107048]
36. Liang, S.; Wang, L.; Yin, G. Distributed smooth convex optimization with coupled constraints. IEEE Trans. Autom. Control.; 2019; 1, pp. 347-353. [DOI: https://dx.doi.org/10.1109/TAC.2019.2912494]
37. Yang, T.; Yi, X.; Wu, J.; Yuan, Y.; Wu, D.; Meng, Z.; Hong, Y.; Wang, H.; Lin, Z.; Johansson, K. A survey of distributed optimization. Annu. Rev. Control; 2019; 47, pp. 278-305. [DOI: https://dx.doi.org/10.1016/j.arcontrol.2019.05.006]
38. Hughes, J.; Juntao, C. Fair and distributed dynamic optimal transport for resource allocation over networks. Proceedings of the 2021 55th Annual Conference on Information Sciences and Systems (CISS); Baltimore, MD, USA, 24–26 March 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1-6.
39. Dean, R.; Cortés, J. Robust distributed linear programming. IEEE Trans. Autom. Control; 2015; 60, pp. 2567-2582.
40. Villani, C. Optimal Transport: Old and New; Springer: Berlin/Heidelberg, Germany, 2009.
41. Galichon, A. Optimal Transport Methods in Economics; Princeton University Press: Princeton, NJ, USA, 2016.
42. Ermolieva, T.; Obersteiner, M. Abrupt climate change: Lessons from integrated catastrophic risks management. World Resour. Rev.; 2004; 16, pp. 57-82.
43. Ermoliev, Y.M.; Robinson, S.M.; Rovenskaya, E.; Ermolieva, T. Integrated catastrophic risk management: Robust balance between ex-ante and ex-post measures. SIAM News; 2018; 51, 4.
44. Dantzig, G.B.; Wolfe, P. The decomposition principle for linear programming. Econometrica; 1960; 29, pp. 767-778. [DOI: https://dx.doi.org/10.2307/1911818]
45. Kim, K.; Nazareth, J.L. The decomposition principle and algorithms for linear programming. Linear Algebra Appl.; 1991; 152, pp. 119-133. [DOI: https://dx.doi.org/10.1016/0024-3795(91)90270-7]
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Abstract
Traditional integrated modeling (IM) is based on developing and aggregating all relevant (sub)models and data into a single integrated linear programming (LP) model. Unfortunately, this approach is not applicable for IM under asymmetric information (ASI), i.e., when “private” information regarding sectoral/regional models is not available, or it cannot be shared by modeling teams (sectoral agencies). The lack of common information about LP submodels makes LP methods inapplicable for integrated LP modeling. The aim of this paper is to develop a new approach to link and optimize distributed sectoral/regional optimization models, providing a means of decentralized cross-sectoral coordination in the situation of ASI. Thus, the linkage methodology enables the investigation of policies in interdependent systems in a “decentralized” fashion. For linkage, the sectoral/regional models do not need recoding or reprogramming. They also do not require additional data harmonization tasks. Instead, they solve their LP submodels independently and in parallel by a specific iterative subgradient algorithm for nonsmooth optimization. The submodels continue to be the same separate LP models. A social planner (regulatory agency) only needs to adjust the joint resource constraints to simple subgradient changes calculated by the algorithm. The approach enables more stable and resilient systems’ performance and resource allocation as compared to the independent policies designed by separate models without accounting for interdependencies. The paper illustrates the application of the methodology to link detailed energy and agricultural production planning models under joint constraints on water and land use.
You have requested "on-the-fly" machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Show full disclaimer
Neither ProQuest nor its licensors make any representations or warranties with respect to the translations. The translations are automatically generated "AS IS" and "AS AVAILABLE" and are not retained in our systems. PROQUEST AND ITS LICENSORS SPECIFICALLY DISCLAIM ANY AND ALL EXPRESS OR IMPLIED WARRANTIES, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES FOR AVAILABILITY, ACCURACY, TIMELINESS, COMPLETENESS, NON-INFRINGMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Your use of the translations is subject to all use restrictions contained in your Electronic Products License Agreement and by using the translation functionality you agree to forgo any and all claims against ProQuest or its licensors for your use of the translation functionality and any output derived there from. Hide full disclaimer
Details


1 International Institute for Applied Systems Analysis, 2361 Laxenburg, Austria;
2 Bogolyubov Institute for Theoretical Physics, National Academy of Sciences of Ukraine, 03142 Kiev, Ukraine;
3 Timoshenko Institute of Mechanics, National Academy of Sciences of Ukraine, 03142 Kiev, Ukraine;