Content area

Abstract

Quality function deployment (QFD) is a customer-oriented quality management tool used to maximize customer satisfaction by considering the correlations between customer requirements and engineering characteristics. However, the conventional QFD method exhibits some shortcomings when used in real situations, especially in terms of correlation evaluation and engineering characteristic ranking. Therefore, the objective of this study is to propose a new QFD approach based on linguistic distribution assessments and the CRiteria Importance Through Inter-Criteria Correlation (CRITIC) method to improve the effectiveness of the traditional QFD. Specifically, linguistic distribution assessments are utilized to describe the relationships between customer requirements and engineering characteristics. The CRITIC method is extended and used to determine the ranking orders of the engineering characteristics identified in QFD. To demonstrate the feasibility and practicality of the proposed QFD, a case example regarding the performance management system’s development is presented. It is shown that the QFD approach proposed in this paper can not only represent experts’ uncertain linguistic relationship evaluations flexibly but also determine more reliable importance rankings of engineering characteristics in production planning.

Full text

Turn on search term navigation

1. Introduction

Quality function deployment (QFD) is a well-known product planning approach utilized for examining the interrelationships between customer needs and design requirements [1,2]. The core of this approach is the house of quality (HOQ), which comprises both customer needs and design requirements. The objective of QFD is to support research and design teams for transforming customer requirements (CRs) into related engineering characteristics (ECs) during different stages of new product development [3,4]. By employing QFD, the translation process is enhanced, leading to improved product development efficiency and accuracy. QFD holds significant potential for advancing the field of research and design in the context of customer-centric product development [5,6]. Implementing QFD in an organization can shorten cycle times, reduce costs, and improve quality [7,8,9]. Inspired by these attractive properties, QFD has recently been used in various industries to improve the competitiveness of organizations and increase customer satisfaction [10,11,12].

Although QFD is an effective quality management tool, the traditional method has some shortcomings when used in the real world [13,14,15]. The main drawback is the use of exact numbers such as 1, 3, 5, to describe the relationships between CRs and ECs. However, it is often difficult for QFD team members to provide precise numerical values when evaluating the relationships between CRs and ECs due to the limitations in knowledge, the problem complexity, and time pressure. They prefer to use linguistic terms rather than numerical values to express the CR–EC relationship evaluation information [15,16,17]. To represent the linguistic decision information accurately, Zhang et al. [18] proposed the linguistic distribution assessment (LDA) method, in which symbolic proportions are assigned to the linguistic terms in a linguistic term set. The LDA method is a generalization of the two-tuple linguistic method and probabilistic linguistic term sets, and defined as a set of binary relationships between linguistic variables and their symbolic probabilities [19,20]. Compared with other linguistic computing methods, the LDA method can efficiently represent uncertain information and reflect the real experience of decision makers [21,22]. Over the past couple of years, the LDA method has been applied to depict the subjective vagueness and differing evaluations of decision makers in various decision making problems [21,23,24].

On the other hand, determining the priority of ECs in QFD can be considered a multi-criteria decision making (MCDM) problem [13,14,25]. Thus, a lot of MCDM methods have been used to solve QFD problems in previous studies [15,26]. The criteria importance through inter-criteria correlation (CRITIC) method proposed by Diakoulaki et al. [27] is an improved method of the technique for order of preference by similarity to ideal solution (TOPSIS). It is an objective mathematical procedure used to derive the level of significance of the criteria involved in a decision making process. The main advantage of CRITIC is that it can standardize the decision matrix by dealing with the ideal values of cost and benefit criteria at the same time [28,29]. It can measure the similarity of standards by calculating the correlation coefficient between standards according to the values in the decision matrix. By calculating the standard deviation of normalized values, the CRITIC captures the interrelationship among criteria and variability in the preference distribution [30,31]. Recently, the CRITIC method has been used for the analysis and evaluation of criteria weights in MCDM [29,32,33]. In addition, different extensions of the CRITIC method [34,35,36] have been proposed to deal with real-world decision making problems more efficiently.

Based on the aforementioned discussions, the research questions to be addressed in this study are as follows: How do we handle experts’ distributed linguistic relational assessment information between CRs and ECs, and how do we obtain a reliable importance ranking of the identified ECs in QFD? Therefore, the objective of this paper is to propose a new QFD approach based on LDAs and the CRITIC method to improve the effectiveness of the traditional QFD. First, the LDA method is adopted to quantify the linguistic opinions of experts on the relationships between CRs and ECs. Second, the CRITIC method is modified and utilized to derive the importance priorities of ECs by analyzing their correlations. Finally, a real case study of performance management system design is provided to illustrate the feasibility and practicality of the proposed new QFD approach.

The rest of the paper is structured as follows: In Section 2, a brief review of current improved methods for QFD is presented. In Section 3, the basic concepts and operational rules related to LDAs are introduced and the QFD approach using linguistic distribution evaluations and the CRITIC method is developed. Section 4 illustrates the application of the proposed QFD methodology through a practical case study and a comparative analysis. Finally, Section 5 provides the conclusions of this study and points out future research directions.

2. Literature Review

QFD is a systematic framework employed in the design of products and services, aiming to bridge the gap between customer preferences and engineering considerations by effectively translating the voice of the customer into design characteristics [2]. The classical QFD method focuses on customer-driven product development, aiming at converting CRs into ECs to enhance the satisfaction level of customers [3,5]. However, the traditional QFD method shows some deficiencies when used in real situations [15,26]. Therefore, many improved QFD methods have been proposed in previous studies to surmount the limitations of the conventional method. In this section, we reviewed studies which improved the QFD model based on MCDM methods. For example, Fu et al. [37] proposed an interval-valued spherical fuzzy QFD method to identify human-centered ECs to guide the conceptual design process a of metaverse collaborative system. Liu et al. [38] constructed a QFD model based on the spherical fuzzy bipartite graph to consider the dependency relationships between CRs and DRs during assistive product design. Kumar Gangadhari et al. [12] utilized a spherical-fuzzy-based QFD method to assess manufacturing capabilities in alignment with consumer requirements. Du et al. [39] enhanced QFD through the integration of rough sets and ordinal priority approach and applied it to the electric vehicle manufacturing development. Seker and Aydin [6] improved QFD with Fermatean fuzzy sets and employed it for designing a sustainable mobility hub center. Ayyildiz et al. [40] applied the Pythagorean fuzzy analytic hierarchy process (AHP)-integrated QFD method to analyze the cultivation process of grown hazelnuts. In addition, the hesitant fuzzy–QFD (HF-QFD) [41], the linguistic Z-number QFD (LZ-QFD) [42], and the double hierarchy hesitant linguistic QFD [43] have been suggested for improving the prioritization of ECs in QFD.

Recently, it has been a trend to employ consensus-driven methods to handle the diversity and complex linguistic ratings in QFD. For instance, Xiao and Wang [44] introduced an optimization-based consensus-reaching process into QFD for handling incomplete and conflicting customer opinions, where customer opinions were modeled with incomplete linguistic distribution assessments. Wang et al. [13] presented a QFD model using the cooperative game consensus-reaching process and three-way decision theory in which the cooperative game-based consensus mechanism was used to help experts reach a consensus on the CR-EC correlation assessments. Gai et al. [14] developed a QFD model from the perspective of group decision making and social network analysis, and applied it to product design in the Chinese e-commerce scene. In [16], an integrated QFD approach based on the interval two-tuple Pythagorean fuzzy linguistic sets (I2PFLSs), the social network consensus-reaching (SNCR) model, and an extended combined compromise solution (CoCoSo) method was provided. In [25], a hybrid QFD approach based on multi-granular unbalanced linguistic information and a consensus-reaching process was proposed. Other consensus-based QFD methods proposed in the literature include those in [45,46]. A summary of the reviewed QFD methods is shown in Table 1.

The review of the relevant literature shows that various fuzzy and linguistic methods have been used to facilitate relationship assessments between CRs and ECs in aforementioned studies. However, the current methods are incapable of describing complex linguistic expressions related to linguistic distributional expressions in a comprehensible manner. On the other hand, despite the widespread application of MCDM methods to determine the ranking orders of ECs, little research attention has been paid to QFD problems based on the CRITIC method, especially in the LDA environment. To fill these research gaps, this paper introduces a new QFD approach that integrates LDAs with an extended CRITIC method to improve the performance of conventional QFD. The proposed QFD can accurately capture the subjective evaluation information provided by experts, and provide a practical and reliable solution for identifying critical ECs, thereby facilitating quality improvement in product design and planning.

3. Method

This section introduces an improved QFD approach for determining the high importance of ECs in the product development process. The first subsection recalls some fundamental concepts of LDAs. The second subsection explains the two-stage QFD approach based on an integrated LDA-CRITIC method.

3.1. Preliminaries

LDAs were proposed by Zhang et al. [18] for computing with words, in which the linguistic terms are assigned with symbolic proportions in a linguistic term set.

Definition 1

([18]). Let S = {S0,S1,…,Sg} be a linguistic term set, where g + 1 is a granularity of S and st represents a possible linguistic value. Then, an LDA of S is defined as

(1)L=st,βtt=0,1,,g,

where st∈S, βt0, t=0gβt=1, and βt is the symbolic proportion of st.

Definition 2

([18]). Let L=st,βtt=0,1,,g be an LDA of S; the expectation of L is computed by

(2)EL=t=0gβtst.

Definition 3

([18]). Let L1 and L2 be any two linguistic distribution assessments of S:

  • (1) 

    If E(L1) > E(L2), then L1 is bigger than L2;

  • (2) 

    If E(L1) = E(L2), then L1 is equal to L2.

Definition 4

([18]). Considering a set of LDAs L1,L2,,Ln of S with an associated weighting vector w=w1,w2,,wnT satisfying wi0 and i=1nwi=1, the linguistic distributional weighted averaging (LDWA) operator is defined as

(3)LDWAwL1,L2,,Ln=st,βtt=0,1,,g,

where βt=i=1nwiβti,t=0,1,,g.

3.2. The Proposed QFD Approach

In this section, a new integrated QFD approach based on LDAs and the CRITIC method is introduced to acquire the importance priority of ECs. The proposed QFD is divided into two stages: (1) an assessment of the intricate relationships between CRs and ECs by using the LDA method; (2) the determination of the prioritization of ECs with an extended CRITIC method. Details of the procedure of the proposed QFD approach are depicted in Figure 1.

For a QFD analysis problem, suppose that there are m engineering characteristics ECii=1,2,,m and n customer requirements CRjj=1,2,,n. In addition, l experts Ekk=1,2,,l are invited to provide their assessments for the relationships between CRs and ECs, and each expert is assigned a weight λk satisfying λk>0 and k=1lλk=1 to describe their relative importance in QFD analysis. Let Lk=pijkm×n be the LDA correlation matrix provided by Ek, where pijk=stijk,βtijkt=0,1,,g is the linguistic distribution evaluation of ECi with respect to CRj based on the linguistic term set S = {S0,S1,…,Sg}. According to these assumptions, the proposed QFD approach is described as follows:

Stage 1. Construct the collective correlation evaluation matrix.

Step 1. Establish the collective LDA correlation matrix.

By using the LDWA operator, the individual LDA correlation matrices Lkk=1,2,,l can be aggregated to obtain the collective LDA correlation matrix L=pijm×n, in which

(4)pij=LDWAλpij1,pij2,,pijl=stij,βtijt=0,1,,g,

where βtij=k=1lλkβtijk,t=0,1,,g and λ=λ1,λ2,,λlT.

Step 2. Obtain the expectation correlation evaluation matrix.

The expectation correlation evaluation matrix R = (rij)m×n is calculated by the following equation:

(5)rij=Epij,i=1,2,,m; j=1,2,,n.

Stage 2. Determine the importance priority of ECs by the CRITIC method.

The CRITIC method is a highly effective approach for solving MCDM problems as it objectively determines the weights of criteria [31]. It is distinguished by its ability to assign weights that encapsulate both the contrast intensity inherent in each criterion and the degree of conflict among various criteria [33,35]. In this stage, the CRITIC method is employed to determine the importance priority of ECs within the LDA environment.

Step 3. Determine the EC vector.

Let Ri=r1i,r2i,,rni denote the vector of the ith EC; the transformations of performance values can be derived according to the following rules:

  • (1). If rji is a beneficial criterion, then

    (6)rji=rjiriri*ri,

  • (2). If rji is a non-beneficial criterion, then

    (7)rji=rirjiriri*.

Note that ri* and ri are the ideal and the anti-ideal values with respect to ECi.

Step 4. Calculate the importance score of each EC.

Step 4.1. Acquire the square matrix.

The square matrix R˜=r˜ikm×m is composed of elements which are the linear correlation coefficients between the vectors Ri and Rk.

Step 4.2. Compute the importance scores of ECs.

The importance score Hi of each EC can be determined by

(8)Hi=σik=1m1r˜ik,i=1,2,,m,

where σi is the standard deviation of each criterion vector ri.

Step 4.3. Determine the prioritization of ECs.

The bigger the value of the importance score Hi, the more important the engineering characteristics ECi. Therefore, the priority of the m ECs can be determined according to the descending order of their importance degrees Hi (i = 1,2,…,m).

4. Findings and Discussion

In this section, we present an empirical case study on the design of a performance management system [47] to illustrate the applicability and efficacy of our proposed QFD methodology.

4.1. Application

In the environment of uncertainty, complexity and ambiguity, employee performance management is important for organizations in order to adapt the accelerating shift in socio-eco-techno activities. In such conditions, performance management is considered a pivotal tool in aiding strategic decisions pertaining to training, career advancement, compensation, employee transfers, promotions, retention strategies, and termination [47]. Performance management helps employees to align their goals with the strategic plan and objectives of a company. An effective performance management system is widely recognized as an instrument for performance management which can realize employers’ performance expectations. Nevertheless, it is difficult to describe the performance expectations of management in a given language, and there are complex relationships between design features. Thus, the QFD method is introduced into the performance management system’s design to determine which points are potentially needed to enhance corporate performance. In this case study, the proposed QFD approach is used for performance management system design to examine the relationship between employers’ expectations and the conditions necessary to fulfill them.

Through a literature analysis and interviews of experts [47], 10 CRs CRj,j=1,2,,10 and 10 ECs ECi,i=1,2,,10 were determined for the priority of the design targets of the performance management system, which are presented in Table 2. Five experts from different domains Ekk=1,2,,5 were invited to assess the correlations between CRs and ECs based on the following linguistic term set:

S=s0=Very low, s1=Low, s2=Medium, s3=High, s4=Very high

As a result, the linguistic correlation assessments obtained from the five experts could be represented through the utilization of LDAs, so LDA correlation matrixes Lk=pijk10×10k=1,2,,5 were obtained. For instance, the LDA correlation matrix L1 given by the first expert is shown in Table 3.

Next, the introduced QFD approach was employed to determine critical ECs in the performance management system’s design.

Step 1: By using the LDWA operator, the collective LDA correlation matrix L is derived as presented in Table 4, in which the importance of each expert is assumed to be equal, i.e., λk=0.2k=1,2,,5.

Step 2: By Equation (5), the expectation correlation evaluation matrix is computed to be as follows:

R=1.682.522.38003.583.53.30003.5600000001.94003.5800.363.543.541.94003.51.8223.622.4200000.6221.5400000000.6023.58022.04000002.13.583.5820.080000.802.083.543.9200001.9000.72.43.921.8021.90000.70.304.

Step 3: According to Equations (6) and (7), the EC vectors Rii=1,2,,10 are calculated as listed below:

R1=1,0,0,0,0,0,0,0,0,0,R2=1.5,2.12,0,0,0,0,0,0,0,1.19,R3=1.42,0,2.13,2.08,0.37,0,0,0,0,1.13,R4=0,0,0,1.07,1.19,0.36,0,0.48,1.13,0,R5=0,0,0.21,1.19,0.89,0,0,0,0,0,R6=2.13,0,2.08,1.19,2.38,1.19,1.25,1.24,0,0,R7=2.08,0,2.38,2.15,0,2.13,2.13,2.08,0.42,0.42,R8=1.96,0,2.08,1.44,0,0,2.13,2.38,1.43,0.18,R9=0,0,2.38,0,0,1.19,1.19,2.33,2.33,0,R10=0,1.15,1.15,0,0,1.21,0.05,0,1.07,2.38.

Step 4.1: The square matrix R˜=r˜ikm×m is determined as presented in Table 5.

Step 4.2: Via Equation (8), the importance scores of the 10 ECs Hi (i = 1,2,…,10) are obtained as shown in Table 6.

Step 4.3: Based on the descending order of the importance degrees Hi (i = 1,2,…,10), the prioritization of ECs is determined as follows: EC9 > EC10 > EC2 > EC7 > EC8 > EC6 > EC3 > EC4 > EC5 > EC1.

4.2. Comparative Analysis

To further show the effectiveness and benefits of our proposed QFD approach, we conduct a comparative analysis with several existing methods, which include the classical QFD, the HF-QFD [41], and the LZ-QFD [42]. The ranking results of the importance of ECs generated by the listed QFD methods are exhibited in Figure 2.

As can be seen from Figure 2, the top three ECs obtained by HF-QFD, LZ-QFD, and the proposed method of QFD are the same, i.e., EC9, EC10, and EC2. In addition, the ranking orders of four ECs (EC1, EC3, EC4, and EC5) derived by the proposed QFD are consistent with the ones determined by the three compared methods. These outcomes demonstrate the effectiveness of the proposed QFD approach. Furthermore, the results determined by the proposed QFD approach is line with real situations. By analyzing the identified performance expectations with respect to its importance degree in goal achievement, the current status of employee performance and the planned target performance level illustrate reasonable outcomes [48]. For example, EC9 (access to training and growth opportunities inside or outside the company) is an enduring technical requirement for employees to perform well on the given parameters [47]. Human resource policy formulation should include this technical design feature, which has a strong positive relationship with the performance indicator [49].

On the other hand, there are still some differences between the EC importance rankings obtained by the proposed QFD approach and those obtained by the other three methods. First, there is a large difference between the two sets of EC priority rankings produced by the proposed approach and the classical QFD method. The explanations for the inconsistent ranking results may be as follows: (1) Crisp numbers are used in classical QFD to describe the correlations between CRs and ECs, which are unable to handle the uncertainty in experts’ judgments [8,50]. (2) A compensatory method was used to determine the importance rankings of ECs in classical QFD, which may have resulted in biased rankings [6,43].

Second, the proposed QFD approach gives different rankings for EC7 and EC8 in comparison with the HF-QFD and the LZ-QFD methods. This could be attributed to the fact that different evaluation and prioritization mechanisms are used by the compared methods. Specifically, HF-QFD adopts double-hierarchy hesitant linguistic term sets to evaluate the CR-EC relationships and the axiomatic design method to determine the importance priority of ECs [41]. LZ-QFD uses linguistic Z-numbers to deal with the vague relationship evaluation information and the evaluation based on distance from average solution (EDAS) method to rank ECs [42]. The two compared methods cannot describe complex linguistic expressions related to linguistic distributional expressions in QFD.

From the aforementioned analyses, it can be concluded that a rational and robust result for the ranking of ECs can be obtained by using the proposed QFD approach. This not only offers engineers a more practical solution but also contributes significantly to the design of performance management systems.

4.3. Managerial Implications

Considering the findings of this study, the proposed QFD approach has some practical implications for mangers and designers to improve performance management systems for reducing costs and enhancing customer satisfaction. They should focus on the critical ECs, such as “Access to training and growth opportunities inside or outside the company”, “Employee empowerment”, and “Appropriate compensation for the role and responsibility”, to achieve planned performance. In addition, the proposed QFD approach exhibits the following benefits in real-world applications: Frist, the utilization of LDAs allows for a more precise representation of the uncertain linguistic evaluation data provided by experts. Consequently, the proposed QFD offers a convenient and flexible way to obtain comprehensive and reliable correlation evaluations. Second, the proposed QFD incorporates an expanded CRITIC methodology for determining the order of importance of ECs. Because it quantifies informational content to differentiate between ECs, the ranking outcomes generated by the proposed approach are more rational and reliable.

5. Conclusions

In this study, we proposed a new QFD approach by integrating LDAs with the CRITIC method to improve the efficiency of QFD implementation. First, the LDA method is introduced to manage evaluations of the intricate relationships between CRs and ECs provided by experts. Subsequently, the standard CRITIC method is modified and utilized to determine the rankings of the importance of ECs in performing QFD. Finally, a case study regarding performance management system design is conducted to illustrate the proposed QFD approach and to compare it with previously existing methods. The results show that the proposed QFD approach not only captures the uncertainty and diversity of assessment information provided by domain experts, but also acquires more precise and dependable importance rankings of ECs, ultimately contributing to performance management system improvement.

The proposed QFD approach has some limitations worth addressing in future studies. First, the proposed approach fails to consider the correlations among ECs, which may exist in some practical situations. Thus, incorporating the correlations between ECs into the proposed QFD approach is a promising direction to take in future research. Second, inconsistent and conflicting relationship assessments between CRs and ECs are not discussed in this study. Sometimes, experts may provide conflicting opinions due to their differing professional knowledge and experience backgrounds. Therefore, using a consensus-reaching process to ensure that experts reach a consensus viewpoint in QFD is a recommendable research direction. In addition, the proposed approach can be applied to address QFD problems in other industries in the future to further verify this approach’s feasibility and practicality.

Author Contributions

Conceptualization, L.-X.M. and A.C.; methodology, J.L. and H.S.; writing—original draft preparation, L.-X.M. and A.C.; writing—review and editing, J.L. and H.S.; visualization, H.S.; supervision, H.-C.L. All authors have read and agreed to the published version of the manuscript.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Figures and Tables
View Image - Figure 1. Framework of the proposed QFD model.

Figure 1. Framework of the proposed QFD model.

View Image - Figure 2. EC ranking results obtained by different methods.

Figure 2. EC ranking results obtained by different methods.

Summary of QFD studies related to the topic covered in this paper.

Authors Years Correlation Assessment Methods EC Ranking Methods Research Aims Main Results
Fu et al. [37] 2024 Interval-valued spherical fuzzy sets VIKOR method To develop an interval-valued spherical fuzzy QFD method for metaverse collaborative system design The proposed QFD approach for metaverse collaborative systems is able to handle uncertainty and vagueness in design processes
Liu et al. [38] 2024 Spherical fuzzy sets Bipartite graph prioritization To introduce a spherical fuzzy bipartite graph-based QFD method for assistive product design The proposed QFD method can enhance product design efficiency in assistive technologies
Kumar Gangadhari et al. [12] 2024 Spherical fuzzy sets Weighted average method To redefine N95 respirator design using QFD-based optimization model The presented optimized design method can improving functionality and compliance with new standards for N95 respirators
Du et al. [39] 2024 Rough sets Ordinal priority mehtod To enhancing QFD throughthe integration of rough sets and ordinal priority method The proposed QFD can effectively prioritize engineering characteristics in the electricvehicle manufacturing
Seker and Aydin [6] 2023 Fermatean fuzzy sets Weighted average method To apply fermatean fuzzy QFD method to sustainable mobility hub center design The proposed method is helpful forthe related authorities while designing mobility hubs to meet passenger needs and requirements
Ayyildiz et al. [40] 2023 Interval-valued Pythagorean fuzzy sets Weighted average method To integrate interval-valued Pythagorean fuzzy AHP with QFD for hazelnut production optimization The proposd method is practical for farmers and companies to improve the quality of hazelnut production
Wang et al. [41] 2021 Double hierarchy hesitant fuzzy linguistic term sets Axiomatic design method To develop a QFD methodology using double hierarchy hesitant fuzzy linguistic term sets and axiomatic design The new method can capture the ambiguity and hesitancy in experts’ evaluation information and obtain aaccurate prioritization of ECs
Mao et al. [42] 2021 Linguistic Z-numbers Evaluation based on distance from average solution (EDAS) method To propose a linguistic Z-numbers-based QFD approach integrated with EDAS The method can represent experts’ evaluation information flexibly and produce a reasonable prioritization of ECs
Shi et al. [43] 2022 Double hierarchy hesitant linguistic term sets Improved ORESTE method To prioritize ECs in QFD using improved ORESTE with hesitant linguistic information The proposed method is flexibility in handling experts’ hesitant evaluations and effective in ranking ECs
Xiao and Wang [44] 2024 Incomplete linguistic distribution assessments Multi-criteria optimization To handle incomplete and conflicting opinions in QFD through consistency and consensus-reaching processes Improved the robustness of QFD methodologies in scenarios with incomplete and conflicting stakeholder inputs
Wang et al. [13] 2024 Probabilisticlinguistic term sets Three-way decision method To develop a new QFD approach combining cooperative game-based consensus and three-way decision making The proposed method can help domain experts acquire more consensual correlation evaluations betweenCRs and ECs
Gai et al. [14] 2024 Hesitant fuzzy linguistic term sets Prospect theory To enhance QFD using social network and group decision-making techniques The proposed method can generate effective and stable results for QFD implementation
Wang et al. [16] 2023 Interval 2-tuple Pythagorean fuzzy linguisticsets Extended CoCoSo method To propose a new QFD approach based on social network analysis and interval 2-tuple Pythagorean fuzzy linguistic information The new QFD can express experts’ uncertain linguistic assessments and deal with experts’ consensus in correlation assessment process
Han et al. [25] 2023 Multi-granular unbalanced linguistic term sets Extended CoCoSo method To develop a QFD method based on multi-granular unbalanced linguistic information and consensus reaching process The proposed approach canrepresent complex linguistic relationship assessments and determine accurate priority orders of ECs
Xiao et al. [45] 2022 Two-tuple linguistic method Weighted average method To propose a QFD using a consensus-based approach withminimum-maximum adjustments The propsoed method can manage diversity and complex linguistic ratings in QFD
Xiao et al. [46] 2022 Two-tuple linguistic method; Comparative linguistic expressions Extended TOPSIS method To propose a consensus-based QFD to derive the consensual prioritization of ECs The proposed method is able to deal with diverse and conflicting ratings in QFD prioritization tasks
The current study 2025 Linguistic distribution assessments Extended CRITIC method To develop a QFD based on linguistic distribution assessments and CRITIC method The proposed approach can represent experts’ uncertain linguistic relationship evaluations and determine reliable importance ranking of ECs

CRs and ECs identified in the case.

CRs Customer Requirements ECs Engineering Characteristics Units
CR1 Budget adherence EC1 Realistic budget Deviation from budget allocated
CR2 Right compensation for responsibility level EC2 Appropriate compensation for the role and responsibility Comparing with industry average
CR3 Contribution in increase in overall profit EC3 Clear objectives derived from company’s vision Extent to which goals are assigned to the employees
CR4 Successful internal customer relationships EC4 Clearly defined policies and organizational hierarchy Number of deviations when the policy documents could not be linked to decisions made
CR5 Successful external customer relationships EC5 Improved post-sale service/supplier relationships Number of customer/supplier complaints
CR6 Task completed on schedule EC6 Improved departmental communication and coordination system Number of events of miscommunication/delays due to lack of coordination
CR7 Task success rate EC7 Quality of production/service process Number of deviations
CR8 Resource efficiency EC8 Clarity in product/service specifications Quantity of rejected products
CR9 Trainings undertaken EC9 Access to training and growth opportunities inside or outside the company Number of relevant training opportunities provided by company
CR10 Number of improvement suggestions made EC10 Employee empowerment Number of employee suggestions applied/executed

The linguistic distribution assessments given by the first expert.

EC1 EC2 EC3 EC4 EC5 EC6 EC7 EC8 EC9 EC10
CR1 s 1 , 0.5 , s 2 , 0.5 s 2 , 0.5 , s 3 , 0.5 s 2 , 0.5 , s 3 , 0.5 s 3 , 0.5 , s 4 , 0.5 s 3 , 0.5 , s 4 , 0.5 s 2 , 0.2 , s 3 , 0.3 , s 4 , 0.5
CR2 s 3 , 0.2 , s 4 , 0.8 s 1 , 0.3 , s 2 , 0.7
CR3 s 3 , 0.5 , s 4 , 0.5 s 0 , 0.5 , s 1 , 0.5 s 3 , 0.5 , s 4 , 0.5 s 4 , 1 s 3 , 0.5 , s 4 , 0.5 s 4 , 1 s 1 , 0.3 , s 2 , 0.7
CR4 s 2 , 0.1 , s 3 , 0.3 , s 4 , 0.6 s 2 , 1 s 2 , 1 s 2 , 1 s 3 , 0.5 , s 4 , 0.5 s 2 , 0.5 , s 3 , 0.5 s 0 , 1
CR5 s 0 , 0.5 , s 1 , 0.5 s 2 , 1 s 1 , 0.5 , s 2 , 0.5 s 4 , 1
CR6 s 0 , 0.4 , s 1 , 0.6 s 1 , 0.3 , s 2 , 0.4 , s 3 , 0.3 s 3 , 0.5 , s 4 , 0.5 s 2 , 1 s 2 , 1
CR7 s 2 , 0.9 , s 3 , 0.1 s 3 , 0.5 , s 4 , 0.5 s 3 , 0.5 , s 4 , 0.5 s 2 , 1 s 0 , 1
CR8 s 0 , 0.2 , s 1 , 0.8 s 2 , 1 s 3 , 0.5 , s 4 , 0.5 s 4 , 1 s 4 , 1
CR9 s 1 , 0.5 , s 2 , 0.5 s 0 , 0.3 , s 1 , 0.7 s 2 , 0.6 , s 3 , 0.4 s 4 , 1 s 1 , 0.2 , s 2 , 0.8
CR10 s 2 , 1 s 1 , 0.5 , s 2 , 0.5 s 0 , 0.3 , s 1 , 0.7 s 0 , 0.6 , s 1 , 0.4 s 4 , 1

The collective LDA correlation matrix L.

EC1 EC2 EC3 EC4 EC5 EC6 EC7 EC8 EC9 EC10
CR1 s 1 , 0.32 , s 2 , 0.68 s 2 , 0.48 , s 3 , 0.52 s 2 , 0.62 , s 3 , 0.38 s 3 , 0.34 , s 4 , 0.64 s 3 , 0.5 , s 4 , 0.5 s 2 , 0.2 , s 3 , 0.3 , s 4 , 0.5
CR2 s 3 , 0.44 , s 4 , 0.56 s 1 , 0.06 , s 2 , 0.94
CR3 s 3 , 0.42 , s 4 , 0.58 s 0 , 0.64 , s 1 , 0.36 s 3 , 0.5 , s 4 , 0.5 s 4 , 1 s 3 , 0.5 , s 4 , 0.5 s 4 , 1 s 1 , 0.06 , s 2 , 0.94
CR4 s 2 , 0.1 , s 3 , 0.3 , s 4 , 0.6 s 1 , 0.2 , s 2 , 0.8 s 1 , 0.04 , s 2 , 0.92 , s 3 , 0.04 s 2 , 1 s 3 , 0.38 , s 4 , 0.62 s 2 , 0.58 , s 3 , 0.42 s 0 , 1
CR5 s 0 , 0.38 , s 1 , 0.62 s 2 , 1 s 1 , 0.5 , s 2 , 0.5 s 4 , 1
CR6 s 0 , 0.4 , s 1 , 0.6 s 1 , 0.3 , s 2 , 0.4 , s 3 , 0.3 s 3 , 0.42 , s 4 , 0.58 s 2 , 1 s 2 , 0.96 , s 3 , 0.04
CR7 s 2 , 0.9 , s 3 , 0.1 s 3 , 0.42 , s 4 , 0.58 s 3 , 0.42 , s 4 , 0.58 s 2 , 1 s 0 , 0.96 , s 2 , 0.04
CR8 s 0 , 0.2 , s 1 , 0.8 s 2 , 0.92 , s 3 , 0.08 s 3 , 0.5 , s 4 , 0.5 s 4 , 1 s 3 , 0.08 , s 4 , 0.92
CR9 s 1 , 0.1 , s 2 , 0.9 s 0 , 0.3 , s 1 , 0.7 s 2 , 0.6 , s 3 , 0.4 s 3 , 0.08 , s 4 , 0.92 s 1 , 0.2 , s 2 , 0.8
CR10 s 2 , 1 s 1 , 0.1 , s 2 , 0.9 s 0 , 0.3 , s 1 , 0.7 s 0 , 0.7 , s 1 , 0.3 s 4 , 1

The square matrix R˜.

0.44 0.28 −0.29 −0.18 0.38 0.24 0.28 −0.31 −0.30
0.44 1.00 0.01 −0.54 −0.35 −0.35 −0.41 −0.33 −0.58 0.32
0.28 0.01 1.00 −0.08 0.46 0.36 0.38 0.27 −0.19 0.02
−0.29 −0.54 −0.08 1.00 0.67 0.07 −0.27 −0.13 0.04 −0.35
−0.18 −0.35 0.46 0.67 1.00 0.38 −0.02 −0.13 −0.39 −0.42
0.38 −0.35 0.36 0.07 0.38 1.00 0.47 0.31 −0.01 −0.62
0.24 −0.41 0.38 −0.27 −0.02 0.47 1.00 0.68 0.36 −0.37
0.28 −0.33 0.27 −0.13 −0.13 0.31 0.68 1.00 0.56 −0.50
−0.31 −0.58 −0.19 0.04 −0.39 −0.01 0.36 0.56 1.00 0.02
−0.30 0.32 0.02 −0.35 −0.42 −0.62 −0.37 −0.50 0.02 1.00

The importance scores of ECs.

H1 H2 H3 H4 H5 H6 H7 H8 H9 H10
2.54 8.25 6.37 4.86 3.74 6.86 7.69 7.62 9.73 8.70

References

1. Mehrjerdi, Y.Z. Quality function deployment and its extensions. Int. J. Qual. Reliab. Manag.; 2010; 27, pp. 616-640. [DOI: https://dx.doi.org/10.1108/02656711011054524]

2. Chan, L.K.; Wu, M.L. Quality function deployment: A literature review. Eur. J. Oper. Res.; 2002; 143, pp. 463-497.

3. Song, W.; Ming, X.; Han, Y. Prioritising technical attributes in QFD under vague environment: A rough-grey relational analysis approach. Int. J. Prod. Res.; 2014; 52, pp. 5528-5545. [DOI: https://dx.doi.org/10.1080/00207543.2014.917213]

4. Wang, Y.-M.; Chin, K.-S. Technical importance ratings in fuzzy QFD by integrating fuzzy normalization and fuzzy weighted average. Comput. Math. Appl.; 2011; 62, pp. 4207-4221. [DOI: https://dx.doi.org/10.1016/j.camwa.2011.10.005]

5. Huang, J.; You, X.-Y.; Liu, H.-C.; Si, S.-L. New approach for quality function deployment based on proportional hesitant fuzzy linguistic term sets and prospect theory. Int. J. Prod. Res.; 2019; 57, pp. 1283-1299. [DOI: https://dx.doi.org/10.1080/00207543.2018.1470343]

6. Seker, S.; Aydin, N. Fermatean fuzzy based Quality Function Deployment methodology for designing sustainable mobility hub center. Appl. Soft Comput.; 2023; 134, 110001. [DOI: https://dx.doi.org/10.1016/j.asoc.2023.110001]

7. Erol, I.; Ar, I.M.; Peker, I.; Searcy, C. Alleviating the Impact of the barriers to circular economy adoption through blockchain: An investigation using an integrated MCDM-based QFD with hesitant fuzzy linguistic term sets. Comput. Ind. Eng.; 2022; 165, 107962. [DOI: https://dx.doi.org/10.1016/j.cie.2022.107962]

8. Liu, H.-C.; Wu, S.-M.; Wang, Z.-L.; Li, X.-Y. A new method for quality function deployment with extended prospect theory under hesitant linguistic environment. IEEE Trans. Eng. Manag.; 2021; 68, pp. 442-451. [DOI: https://dx.doi.org/10.1109/TEM.2018.2864103]

9. Kutlu Gündoğdu, F.; Kahraman, C. A novel spherical fuzzy QFD method and its application to the linear delta robot technology development. Eng. Appl. Artif. Intell.; 2020; 87, 103348. [DOI: https://dx.doi.org/10.1016/j.engappai.2019.103348]

10. Nisha, G.R.; Ravi, V. Implementation of Quality 4.0 framework in the electronics sector using ANP and QFD methodologies. Int. J. Qual. Reliab. Manag.; 2024; [DOI: https://dx.doi.org/10.1108/IJQRM-07-2023-0234]

11. Moktadir, M.A.; Ren, J. Global semiconductor supply chain resilience challenges and mitigation strategies: A novel integrated decomposed fuzzy set Delphi, WINGS and QFD model. Int. J. Prod. Econ.; 2024; 273, 109280. [DOI: https://dx.doi.org/10.1016/j.ijpe.2024.109280]

12. Gangadhari, R.K.; Tarei, P.K.; Chand, P.; Rabiee, M.; Delen, D. Navigating the new normal: Redefining N95 respirator design with an integrated text mining and quality function deployment-based optimization model. Comput. Ind. Eng.; 2024; 189, 109962. [DOI: https://dx.doi.org/10.1016/j.cie.2024.109962]

13. Wang, J.; Liu, H.-C.; Zhang, J.; Shi, H.; Zhang, Q.-Z. New approach for quality function development based on cooperative game-based consensus mechanism and three-way decision method. Int. J. Prod. Econ.; 2024; 276, 109380. [DOI: https://dx.doi.org/10.1016/j.ijpe.2024.109380]

14. Gai, T.; Wu, J.; Liang, C.; Cao, M.; Zhang, Z. A quality function deployment model by social network and group decision making: Application to product design of e-commerce platforms. Eng. Appl. Artif. Intell.; 2024; 133, 108509. [DOI: https://dx.doi.org/10.1016/j.engappai.2024.108509]

15. Hariri, A.; Domingues, P.; Sampaio, P. Integration of multi-criteria decision-making approaches adapted for quality function deployment: An analytical literature review and future research agenda. Int. J. Qual. Reliab. Manag.; 2023; 40, pp. 2326-2350. [DOI: https://dx.doi.org/10.1108/IJQRM-02-2022-0058]

16. Wang, J.; Liu, H.-C.; Shi, H.; Guo, W.; Zhu, J.-Y. New approach for quality function deployment based on social network analysis and interval 2-tuple Pythagorean fuzzy linguistic information. Comput. Ind. Eng.; 2023; 183, 109554. [DOI: https://dx.doi.org/10.1016/j.cie.2023.109554]

17. Finger, G.S.W.; Lima-Junior, F.R. A hesitant fuzzy linguistic QFD approach for formulating sustainable supplier development programs. Int. J. Prod. Econ.; 2022; 247, 108428. [DOI: https://dx.doi.org/10.1016/j.ijpe.2022.108428]

18. Zhang, G.; Dong, Y.; Xu, Y. Consistency and consensus measures for linguistic preference relations based on distribution assessments. Inf. Fusion; 2014; 17, pp. 46-55. [DOI: https://dx.doi.org/10.1016/j.inffus.2012.01.006]

19. Tian, Z.P.; Xu, F.X.; Nie, R.X.; Wang, X.K.; Wang, J.Q. An adaptive consensus model for multi-criteria sorting under linguistic distribution group decision making considering decision-makers’ attitudes. Inf. Fusion; 2024; 108, 102406. [DOI: https://dx.doi.org/10.1016/j.inffus.2024.102406]

20. Ding, X.; Chang, W.; Liao, B. A group stability-based consensus model for multi-criteria group decision-making problems with linguistic distribution assessments. J. Oper. Res. Soc.; 2024; [DOI: https://dx.doi.org/10.1080/01605682.2024.2386379]

21. Tian, Y.; Song, S.; Bao, S.; Zhou, D.; Wei, C. Canonical triangular interval type-2 fuzzy linguistic distribution assessment EDAS approach with its application to production supplier evaluation and ranking. Appl. Soft Comput.; 2024; 154, 111309. [DOI: https://dx.doi.org/10.1016/j.asoc.2024.111309]

22. Liang, Y.; Zhang, T.; Tu, Y.; Zhao, Q. A group consensus reaching model balancing individual satisfaction and group fairness for distributed linguistic preference relations. Appl. Intell.; 2024; 54, pp. 12697-12724. [DOI: https://dx.doi.org/10.1007/s10489-024-05732-3]

23. Jia, X.; Wang, Y.M.; Martínez, L. Enhancing reliability of failure modes and effects analysis dealing with linguistic distribution assessments: A consistency based approach. Eng. Appl. Artif. Intell.; 2024; 133, 108333. [DOI: https://dx.doi.org/10.1016/j.engappai.2024.108333]

24. Fan, C.; Wang, J.; Zhu, Y.; Zhang, H. A consensus-based 360 degree feedback evaluation method with linguistic distribution assessments. Mathematics; 2024; 12, 1883. [DOI: https://dx.doi.org/10.3390/math12121883]

25. Han, Y.-J.; Cao, M.-M.; Liu, H.-C. New approach for quality function deployment based on multi-granular unbalanced linguistic information and consensus reaching process. Appl. Soft Comput.; 2023; 144, 110490. [DOI: https://dx.doi.org/10.1016/j.asoc.2023.110490]

26. Huang, J.; Mao, L.X.; Liu, H.C.; Song, M.S. Quality function deployment improvement: A bibliometric analysis and literature review. Qual. Quant.; 2022; 56, pp. 1347-1366. [DOI: https://dx.doi.org/10.1007/s11135-021-01179-7]

27. Diakoulaki, D.; Mavrotas, G.; Papayannakis, L. Determining objective weights in multiple criteria problems: The critic method. Comput. Oper. Res.; 1995; 22, pp. 763-770. [DOI: https://dx.doi.org/10.1016/0305-0548(94)00059-H]

28. Bilişik, Ö.N.; Duman, N.H.; Taş, E. A novel interval-valued intuitionistic fuzzy CRITIC-TOPSIS methodology: An application for transportation mode selection problem for a glass production company. Expert Syst. Appl.; 2024; 235, 121134. [DOI: https://dx.doi.org/10.1016/j.eswa.2023.121134]

29. Xiao, S.; Kremantzis, M.D.; Kyrgiakos, L.S.; Vlontzos, G.; Pardalos, P.M. Embracing fairness within a cross-efficiency hierarchical network DEA system. Oper. Res.; 2024; 24, 4. [DOI: https://dx.doi.org/10.1007/s12351-023-00811-8]

30. Atawi, I.E.; Abuelrub, A.; Al-Shetwi, A.Q.; Albalawi, O.H. Design of a wind-PV system integrated with a hybrid energy storage system considering economic and reliability assessment. J. Energy Storage; 2024; 81, 110405. [DOI: https://dx.doi.org/10.1016/j.est.2023.110405]

31. Tripathi, D.K.; Nigam, S.K.; Cavallaro, F.; Rani, P.; Mishra, A.R.; Hezam, I.M. A novel CRITIC-RS-VIKOR group method with intuitionistic fuzzy information for renewable energy sources assessment. Group Decis. Negot.; 2023; 32, pp. 1437-1468. [DOI: https://dx.doi.org/10.1007/s10726-023-09849-7]

32. Wang, W.; Chen, Y.; Wang, Y.; Deveci, M.; Moslem, S.; Coffman, D.M. Unveiling the implementation barriers to the digital transformation in the energy sector using the Fermatean cubic fuzzy method. Appl. Energy; 2024; 360, 122756. [DOI: https://dx.doi.org/10.1016/j.apenergy.2024.122756]

33. Song, W.; Rong, W.; Tang, Y. Quantifying risk of service failure in customer complaints: A textual analysis-based approach. Adv. Eng. Inform.; 2024; 60, 102377. [DOI: https://dx.doi.org/10.1016/j.aei.2024.102377]

34. Wang, Z.; Zhong, Y.; Chai, S.L.; Niu, S.F.; Yang, M.L.; Wu, G.R. Product design evaluation based on improved CRITIC and comprehensive cloud-TOPSIS—Applied to automotive styling design evaluation. Adv. Eng. Inform.; 2024; 60, 102361. [DOI: https://dx.doi.org/10.1016/j.aei.2024.102361]

35. Krishankumar, R.; Dhruva, S.; Ravichandran, K.S.; Kar, S. Selection of a viable blockchain service provider for data management within the internet of medical things: An MCDM approach to Indian healthcare. Inf. Sci.; 2024; 657, 119890. [DOI: https://dx.doi.org/10.1016/j.ins.2023.119890]

36. Hou, J.; Gao, T.; Yang, Y.; Wang, X.; Yang, Y.; Meng, S. Battery inconsistency evaluation based on hierarchical weight fusion and fuzzy comprehensive evaluation method. J. Energy Storage; 2024; 84, 110878. [DOI: https://dx.doi.org/10.1016/j.est.2024.110878]

37. Fu, Q.; Liu, Q.; Lu, X.; Hu, T.; Wang, Y.; Pan, J. Interval-valued spherical fuzzy quality function deployment methodology: Metaverse collaborative system design application. Eng. Appl. Artif. Intell.; 2024; 133, 108644. [DOI: https://dx.doi.org/10.1016/j.engappai.2024.108644]

38. Liu, Q.; Chen, X.; Tang, X. Spherical fuzzy bipartite graph based QFD methodology (SFBG-QFD): Assistive products design application. Expert Syst. Appl.; 2024; 239, 122279. [DOI: https://dx.doi.org/10.1016/j.eswa.2023.122279]

39. Du, J.L.; Liu, S.F.; Javed, S.A.; Goh, M.; Chen, Z.S. Enhancing quality function deployment through the integration of rough set and ordinal priority approach: A case study in electric vehicle manufacturing. IEEE Trans. Eng. Manag.; 2024; 71, pp. 7541-7552. [DOI: https://dx.doi.org/10.1109/TEM.2023.3282228]

40. Ayyildiz, E.; Yildiz, A.; Taskin, A.; Ozkan, C. An interval valued Pythagorean fuzzy AHP integrated quality function deployment methodology for hazelnut production in Turkey. Expert Syst. Appl.; 2023; 231, 120708. [DOI: https://dx.doi.org/10.1016/j.eswa.2023.120708]

41. Wang, Z.-L.; Liu, H.-C.; Xu, J.-Y.; Ping, Y.-J. A new method for quality function deployment using double hierarchy hesitant fuzzy linguistic term sets and axiomatic design approach. Qual. Eng.; 2021; 33, pp. 511-522. [DOI: https://dx.doi.org/10.1080/08982112.2021.1912763]

42. Mao, L.-X.; Liu, R.; Mou, X.; Liu, H.-C. New approach for quality function deployment using linguistic Z-numbers and EDAS method. Informatica; 2021; 32, pp. 565-582. [DOI: https://dx.doi.org/10.15388/21-INFOR455]

43. Shi, H.; Mao, L.-X.; Li, K.; Wang, X.-H.; Liu, H.-C. Engineering characteristics prioritization in quality function deployment using an improved ORESTE method with double hierarchy hesitant linguistic information. Sustainability; 2022; 14, 9771. [DOI: https://dx.doi.org/10.3390/su14159771]

44. Xiao, J.; Wang, X. An optimization method for handling incomplete and conflicting opinions in quality function deployment based on consistency and consensus reaching process. Comput. Ind. Eng.; 2024; 187, 109779. [DOI: https://dx.doi.org/10.1016/j.cie.2023.109779]

45. Xiao, J.; Wang, X.; Zhang, B.; Zhang, H. Consensus-driven methodology to managing diversity and complex linguistic ratings in quality function deployment: An optimization-based approach. J. Oper. Res. Soc.; 2022; 74, pp. 2165-2186. [DOI: https://dx.doi.org/10.1080/01605682.2022.2129482]

46. Xiao, J.; Wang, X.; Zhang, H. Coping with diversity ratings in prioritizing design requirements in quality function deployment: A consensus-based approach with minimum-maximum adjustments. Comput. Ind. Eng.; 2022; 163, 107799. [DOI: https://dx.doi.org/10.1016/j.cie.2021.107799]

47. Agarwal, A. Investigating design targets for effective performance management system: An application of balance scorecard using QFD. J. Adv. Manag. Res.; 2021; 18, pp. 353-367. [DOI: https://dx.doi.org/10.1108/JAMR-05-2020-0075]

48. Bauwens, R.; Audenaert, M.; Decramer, A. Performance management systems, innovative work behavior and the role of transformational leadership: An experimental approach. J. Organ. Eff.; 2024; 11, pp. 178-195. [DOI: https://dx.doi.org/10.1108/JOEPP-03-2022-0066]

49. Culasso, F.; Broccardo, L.; Giordino, D.; Crocco, E. Performance management systems and digital technologies: An exploratory analysis of practitioners and academics’ perspectives. Ind. Manag. Data Syst.; 2024; 124, pp. 2870-2898. [DOI: https://dx.doi.org/10.1108/IMDS-11-2023-0834]

50. Wang, J.; Yu, L.; Rong, Y. A new CoCoSo ranking-based QFD approach in Pythagorean fuzzy environment and its application on evaluating design attributes of mobile medical App. J. Intell. Fuzzy Syst.; 2024; 46, pp. 3677-3700. [DOI: https://dx.doi.org/10.3233/JIFS-233229]

© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.