51³Ô¹Ïapp

Professor Yingjie Yang

Job: Professor of Computational Intelligence

Faculty: Computing, Engineering and Media

School/department: School of Computer Science and Informatics

Research group(s): Centre for Computational Intelligence (CCI) and De 51³Ô¹Ïapp University Interdisciplinary Group in Intelligent Transport Systems (DIGITS)

Address: De 51³Ô¹Ïapp University, The Gateway, Leicester, LE1 9BH, United Kingdom

T: +44 (0)116 257 7939

E: yyang@dmu.ac.uk

W: /cci

 

Personal profile

Dr. Yingjie Yang was awarded his first PhD in Engineering from Northeastern University in 1994, and his second PhD in Computer Science in 2008. He has published more than 100 papers in international journals and conferences. He has been involved in more than 90 international conferences as a member of program committees and organised a number of international conferences and special sessions such as 2015 IEEE International Conference on Grey Systems and Intelligent Service, IEEE SMC 2014 and IEEE WCCI2008. As a senior member of IEEE, Dr. Yang serves as a co-chair of the Technical Committee on Grey Systems, IEEE Systems, Man and Cybernetics Society and the vice chair for the task force for competition in IEEE Fuzzy Systems Technical Committee. He is serving also as an associate editor for 5 international academic journals, including IEEE Transactions on Cybernetics. He had been invited to give plenary speech at a number of international confertences, such as the 2013, 2011 and 2009 IEEE Conferences on Grey Systems and Intelligent Services and the 2001 international conference on Airport Management.

Research group affiliations

Publications and outputs


  • dc.title: MFFGD: An adaptive Caputo fractional-order gradient algorithm for DNN dc.contributor.author: Huang, Zhuo; Mao, Shuhua; Yang, Yingjie dc.description.abstract: As a primary optimization method for neural networks, gradient descent algorithm has received significant attention in the recent development of deep neural networks. However, current gradient descent algorithms still suffer from drawbacks such as an excess of hyperparameters, getting stuck in local optima, and poor generalization. This paper introduces a novel Caputo fractional-order gradient descent (MFFGD) algorithm to address these limitations. It provides fractional-order gradient derivation and error analysis for different activation functions and loss functions within the network, simplifying the computation of traditional fractional order gradients. Additionally, by introducing a memory factor to record past gradient variations, MFFGD achieves adaptive adjustment capabilities. Comparative experiments were conducted on multiple sets of datasets with different modalities, and the results, along with theoretical analysis, demonstrate the superiority of MFFGD over other optimizers. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: Forecasting the output of high-tech industry in China: A novel nonlinear grey time-delay multivariable model with variable lag parameters dc.contributor.author: Zhou, Huimin; Yang, Yingjie; Geng, Shuaishuai dc.description.abstract: Under the rapidly developing economy in China, accurate forecasting holds vital significance for policymaking and operational planning within the high-tech industry. However, the influencing factors affecting the output, accompanied by the time-delay effect, could be nonlinear, and uncertain. Thereby, this paper proposes a new nonlinear grey multivariable model with time-varying lag parameters. To be specific, the newly designed time delay function and power exponent are introduced, which can significantly enhance the adaptability and flexibility of the proposed method. The Grey Wolf Optimization algorithm is utilized to calculate the dynamic time lag parameters and power exponent to improve the prediction reliability. Furthermore, this new approach is applied to predict the high-tech industry’s output in China, Shanghai Municipality, and the Eastern Region, with due consideration given to the time-delay effect between input factors and outputs. To assess its efficacy, some leading models are selected for comparison to the proposed model. Furthermore, the utilization of Monte-Carlo simulation, the Probability Density Analysis, and the simulations are used to demonstrate the robustness and stability of this new method. The findings show that the proposed model is a feasible and applicable approach for prediction, exhibiting outstanding accuracy. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: A generalized grey model with symbolic regression algorithm and its application in predicting aircraft remaining useful life dc.contributor.author: Liu, Lianyi; Liu, Sifeng; Yang, Yingjie; Guo, Xiaojun; Sun, Jinghe dc.description.abstract: As a sparse data analysis method, a grey model faces challenges in interpretability for its effective application in uncertain systems. This study proposes a generalized grey model (GGM) based on symbolic regression, designed to improve the intelligence and adaptability of grey models. The GGM serves as a unified framework, integrating various grey model families and addresses regression challenges to determine the model structure. Symbolic regression in the GGM identifies symbolic input-output relationships, offering an interpretable approach for structure determination. By leveraging the non-uniqueness principle in grey system theory and employing structural penalty parameters, the model balances complexity and interpretability. A comparative analysis between GGM and conventional grey function models is conducted focusing on the differences in modeling, structure identification, and parameter optimization. Validation on the M3 competition dataset demonstrated the GGM's superior performance, achieving a significant reduction in prediction error compared to other grey forecasting models. Additionally, a rigorous analysis of aircraft lifespan data underscored the robustness and accuracy of GGM in practical engineering applications. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: Explainable rumor detection based on grey clustering: Fusion of manual features and deep learning features dc.contributor.author: Tan, Xianlong; Mao, Shuhua; Xiao, Xiping; Yang, Yingjie dc.description.abstract: The importance of rumor detection on social media is self-evident. However, many existing studies have focused on exploring potential features in text content and propagation patterns, while neglecting a key aspect—the explainability of the model. The comment content can provide support for the credibility of the detection. Nevertheless, most studies that use comments encode them into specific models, rarely considering their semantic attitudes and standpoints, making it difficult for models to explain why a post is a rumor. In this study, we propose an Explainable rumor detection model based on Grey clustering called MDE-Grey, which combines Manual features and Deep learning features. In terms of manual features, we constructed a relevant vocabulary based on the specific comment environment of rumors to capture comment standpoints. In terms of deep learning features, we have designed a GCN sub network that includes two attention mechanisms to capture noteworthy content in posts and comments. Finally, we constructed a new grey clustering model to fuse the two types of features and obtain the final prediction. In the grey clustering model, we designed new whitening functions to capture the intrinsic relationship between features and rumor categories, ensuring the traceability of prediction results. The experiments on three datasets and case studies have demonstrated the effectiveness of the MDE-Grey model in detecting rumors and explaining the results. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: Uncertainty-Aware Reservoir Permeability Prediction using Gaussian Processes Regression and NMR Measurements dc.contributor.author: Lawal, Ahmad; Yang, Yingjie; Baisa, Nathanael L.; He, Hongmei dc.description.abstract: This study investigates the challenges of permeability prediction in reservoir engineering, focusing on addressing uncertainties inherent in the data and modelling process, and leveraging Nuclear Magnetic Resonance (NMR) log data from the Northern Sea Volve field. The study uses a probabilistic machine learning method called Gaussian Process Regression (GPR) with different kernels, such as Matern52, Matern32, and Radial Basis Function (RBF). LSboost, K-nearest neighbour (KNN), and XGBoost are some of the existing models that are used for comparison. Performance metrics including Mean Absolute Error (MAE), Mean Squared Error (MSE), and coefficient of determination ($R^{2}$) are utilized for assessment. Additionally, the uncertainty associated with different GPR kernels is analyzed, and confidence intervals are generated to provide insights into model behaviour. The inclusion of confidence intervals enhances interpretability by quantifying the range within which the true permeability value is likely to fall with a specified level of confidence, offering valuable information for decision-making processes in reservoir engineering applications. Findings demonstrate the effectiveness of GPR with Matern52 and Matern32 kernels in permeability prediction, offering competitive performance and robust uncertainty quantification. This research contributes to advancing reservoir engineering by providing a comprehensive and uncertainty-aware approach to permeability prediction.

  • dc.title: Forecasting the amount of domestic waste clearance in Shenzhen with an optimized grey model dc.contributor.author: Zeng, Bo; Xia, Chao; Yang, Yingjie dc.description.abstract: As a leading economic center in China and an international metropolis, Shenzhen has great significance in promoting sustainable urban development. To predict its amount of domestic waste clearance, a new multivariable grey prediction model with combinatorial optimization of parameters is established in this paper. Firstly, the new model expands the value range of the order r of a grey accumulation generation operator from positive real numbers (R+) to all real numbers (R), which enlarges the optimization space of parameter and has positive significance for improving model performance. Secondly, the dynamic background-value coefficient λ is introduced into the new model to improve the smoothing effect of the nearest neighbor generated sequences. Thirdly, with the objective function of minimizing the mean absolute percentage error(MAPE), the particle swarm optimization (PSO) is employed to optimize parameters r and λ to improve the overall performance of the new model. The new model is used to simulate and predict the amount of domestic waste clearance in Shenzhen, and the MAPE of the new model is only 0.27%, which is far superior to several other similar models. Lastly, the new model is applied to predict the amount of domestic waste clearance in Shenzhen. The results indicate the amount of domestic waste clearance in 2028 could be 9.96 million tons, an increase of 20.58% compared to 2021.This highlights the significant challenge that Shenzhen faces in terms of urban domestic waste treatment. Therefore, some targeted countermeasures and suggestions have been proposed to ensure the sustainable development of Shenzhen's economy and society. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: A novel grey prediction model with four-parameter and its application to forecast natural gas production in China dc.contributor.author: Song, Nannan; Li, Shuliang; Zeng, Bo; Duan, Rui; Yang, Yingjie dc.description.abstract: Due to the non-homology problem and the simple structural characteristics, a grey prediction model will have defects in modeling. In this paper, the structure of the model is deformed, and additional parameters are added. A novel four-parameter grey prediction model NFGM(1,1) is established to avoid the non-homology problem. The accumulation order of the NFGM(1,1) model is optimized to enhance its performance. This paper first introduces a nonlinear term and a linear term into the to compensate for its structural defects, which can enhance the accuracy of the model in modeling complex modeling sequences. Secondly, a simplified basic formula of the model is proposed to estimate its parameters and iteratively establish the model, which can avoid the problem of non-homologous errors during modeling. Then a novel four-parameter grey prediction model NFGM(1,1) is constructed. Thirdly, the unbiasedness of NFGM(1,1) is proved and verified by matrix theory. Fourthly, by optimizing the order of the NFGM(1,1) model, the model is more flexible and adjustable, and a novel fractional-order four-parameter grey prediction model FNFGM(1,1) can be obtained. Finally, the FNFGM(1,1) model is applied to the prediction of natural gas production in China. The model results show that the FNFGM(1,1) model exhibits superior performance compared to the NFGM(1,1), TWGM(1,1), TDGM(1,1), DGM(1,1), and GM(1,1) models, with the mean relative simulation/prediction/comprehensive percentage errors of 0.92%/1.42%/1.07%, respectively. According to the predicted results, China's natural gas production will reach 3542.9 × 108 m3 in 2027 and some relevant policy recommendations are put forwarded. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: A recursive polynomial grey prediction model with adaptive structure and its application dc.contributor.author: Liu, Lianyi; Liu, Sifeng; Yang, Yingjie; Fang, Zhigeng; Shuqi Xu dc.description.abstract: As a sparse data analysis algorithm, ensuring a reasonable model structure is an important challenge for grey models to identify the control mechanism of the uncertain system from observational data. To improve the intelligence and adaptability of the model, this study presents a synchronized optimization strategy for data prioritization and model structure for discrete polynomial grey prediction model. The proposed polynomial grey model contains two hyper-parameters: memory factor parameter and structural parameter. The memory factor is introduced into the discrete model to reconstruct the objective function of structural parameter optimization, thereby avoiding the problem of information superposition. The structural parameter is used to enhance the adaptability of grey prediction model in uncertain data analysis tasks. By employing a recursive estimation approach, an adaptive strategy for estimating model hyper-parameters is proposed, which focuses on minimizing prediction errors within the in-sample data. Additionally, a comparison is made between the proposed improved polynomial grey model and existing polynomial grey models in terms of data information mining, estimation stability, and robustness against measurement noise. The proposed model is applied to the practical engineering application of wear prediction, further validating the effectiveness of the proposed approach in non-equidistant time series prediction tasks. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: A novel fractional order variable structure multivariable grey prediction model with optimal differential background-value coefficients and its performance comparison analysis dc.contributor.author: Xia, Chao; Zeng, Bo; Yang, Yingjie dc.description.abstract: Purpose – Traditional multivariable grey prediction models define the background-value coefficients of the dependent and independent variables uniformly, ignoring the differences between their physical properties, which in turn affects the stability and reliability of the model performance. Design/methodology/approach – A novel multivariable grey prediction model is constructed with different background-value coefficients of the dependent and independent variables, and a one-to-one correspondence between the variables and the background-value coefficients to improve the smoothing effect of the background value coefficients on the sequences. Furthermore, the fractional order accumulating operator is introduced to the new model weaken the randomness of the raw sequence. The particle swarm optimization (PSO) algorithm is used to optimize the background-value coefficients and the order of the model to improve model performance. Findings – The new model structure has good variability and compatibility, which can achieve compatibility with current mainstream grey prediction models. The performance of the new model is compared and analyzed with three typical cases, and the results show that the new model outperforms the other two similar grey prediction models. Originality/value – This study has positive implications for enriching the method system of multivariable grey prediction model. dc.description: The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.

  • dc.title: Spectrum analysis of moving average operator and construction of time-frequency hybrid sequence operator dc.contributor.author: Lin, Changhai; Liu, Sifeng; Fang, Zhigeng; Yang, Yingjie dc.description.abstract: Purpose – The purpose of this paper is to analyze the spectral characteristics of moving average operator and to propose a novel time-frequency hybrid sequence operator. Design/methodology/approach – Firstly, the complex data is converted into frequency domain data by Fourier transform. An appropriate frequency domain operator is constructed to eliminate the impact of disturbance. Then, the inverse Fourier transform transforms the frequency domain data in which the disturbance is removed, into time domain data. Finally, an appropriate moving average operator of N items is selected based on spectral characteristics to eliminate the influence of periodic factors and noise. Findings – Through the spectrum analysis of the real-time data sensed and recorded by microwave sensors, the spectral characteristics and the ranges of information, noise and shock disturbance factors in the data can be clarified. Practical implications – The real-time data analysis results for a drug component monitoring show that the hybrid sequence operator has a good effect on suppressing disturbances, periodic factors and noise implied in the data. Originality/value – Firstly, the spectral analysis of moving average operator and the novel time-frequency hybrid sequence operator were presented in this paper. For complex data, the ideal effect is difficult to achieve by applying the frequency domain operator or time domain operator alone. The more satisfactory results can be obtained by time-frequency hybrid sequence operator.

Key research outputs

  • R-Fuzzy sets: a novel combination of fuzzy sets with rough sets with capability to represent some situations difficult with other extensions;
  • Grey sets: a formal formulation of the concept of grey sets and its operations;
  • Relative Strength of Effect: a factor analysis method based on trained neural networks;
  • Application of neural networks in overlay operation of GIS
  • Airport noise simulation using neural networks

Research interests/expertise

Dr. Yang’s research interests are mainly with uncertainty models and their applications. His theoretical work involves fuzzy sets, rough sets, grey systems and neural networks. In applications, his interests are transportation planning, environment evaluation and civil engineering simulation and analysis.

Areas of teaching

  • Databases
  • Data Warehousing
  • AI programming

Qualifications

  • PhD in Engineering (1994 from Northeastern University, China)
  • PhD in Computer Science (2008 from Loughborough University, UK)

Courses taught

  • IMAT5167
  • IMAT5118
  • IMAT5103
  • IMAT2427
  • PHAR5350

Honours and awards

Best Paper Award, the 2013 IEEE Conference on Computational Intelligenceand Computing Research.

Membership of external committees

  • Co-chair of the Technical Committee on Grey Systems of IEEE Systems, Man,and Cybernetics Society, 2012 -- present
  • Vice-chair of the Task Force on Competitions for Fuzzy Systems Technical Committeeof IEEE Computational Intelligence Society, 2011 -- present
  • PC members for over 90 international academic conferences

Membership of professional associations and societies

  • Senior Member of IEEE, 2013 -- present
  • Member of IEEE, Mar 2007 -- 2013
  • Member of the Rail Research UK Association, May 2013 -- present

Current research students

First supervisor for:

  • Manal Alghieth
  • Mohammad Al Azawi
  • Arjab Khuman
  • Nguyen Thi Mai Phuong
  • Tarjana Yagnik

Externally funded research grants information

    • "International Network on Grey Systems and its Applications", Leverhulme Trust, PI, £124997, 2015--2018.

    • "Grey Systems and Its Application to Data Mining and Decision Support", EU FP7 Marie Curie International IncomingFellowship, PI, €309235, 2015--2016.

    • "Modeling Conditions, Mechanism and Characters of Grey Prediction Model GM(1,1)", Leverhulme Trust InternationalVisiting Fellowship, PI, £25500, 2013--2014.

    • "Grey Systems and Computational Intelligence", Royal Society, PI, £12000, 2011-- 2013.

    • "ITRAQ: Integrated Traffic Management and Air Quality Control Using Space Services", Europe Space Agency, CI, €97834, 2011--2012.

    • "Conference grant", Royal Academy of Engineering, PI, £500, Oct 2007.

Internally funded research project information

  • "Project application on Grey Systems and Uncertainty", 51³Ô¹Ïapp Research Leave scheme, PI, £7104, 2012--2013.

  • "Initial preparation for EU research network on grey systems", 51³Ô¹Ïapp RIF Fund, PI, £7000, 2011--2012.

  • "Emerging uncertainty models and their applications", 51³Ô¹Ïapp PhD scholarship, PI, £55080, 2012--2016.

  • "Conference grant", 51³Ô¹Ïapp RITI Fund, PI, £1500, Jun 2009.

  • "Conference grant", 51³Ô¹Ïapp RITI Fund, PI, £1500, Jun 2008.

Professional esteem indicators

Editorial board:

  • Associate Editor of IEEE Transaction on Cybernetics (Institute of Electrical and Electronics Engineers) ISSN: 1083-4419
  • Associate Editor of Scientific World Journal (Hindawi Publishing Corporation) ISSN: 2356-6140
  • Associate Editor of Journal of Intelligent and Fuzzy Systems (IOS Press) ISSN: 1064-1246
  • Assocaite Editor of Journal of Grey Systems (Research Information Ltd) ISSN: 0957-3720
  • Associated Editor of Grey Systems: Theory and Applications (Emerald) ISSN: 2043-9377

Plenary talks and academic seminars

  • Keynote speaker at the 2013 IEEE International Conference on Grey Systems and Intelligent Services, Macau, 2013
  • Seminar on grey numbers at Nanjing University of Aeronautics and Astronautics, Nanjing, 2012
  • Keynote speaker at the 2011 IEEE International Conference on Grey Systems and Intelligent Services, Nanjing,2011
  • Seminar on grey numbers at Nanjing University of Aeronautics and Astronautics, Nanjing, 2011
  • Seminar series on computational intelligence at Nanjing University of Aeronautics and Astronautics, full financialsupport from Nanjing University of Aeronautics and Astronautics, Nanjing, 2010
  • Keynote speaker at the 2009 IEEE International Conference on Grey Systems and Intelligent Services, Nanjing,2009
  • Seminar on grey systems at University of Hull, 2008
  • Keynote speaker at the Airport Environmental Management Workshop in Singapore, full financial support fromSingapore Aviation Academy (organisor), Singapore, 2001

Conference management

  • Chair of the Program Committee for the 2015 IEEE International Conference on Grey Systems and Intelligent Services,Leicester, 2015
  • Chair of the Program Committee for the 2015 International Conference on Advanced Computational Intelligence,Wuyi, 2015
  • Chair of the Program Committee for the 2013 IEEE International Conference on Grey Systems and Intelligent Services,Macau, 2013
  • Co-chair of the special session on grey systems at the 2014 IEEE International Conference on Systems, Man and Cybernetics, San Diego, 2014
  • Co-chair of the special session on grey systems at the 2012 IEEE International Conference on Systems, Man and Cybernetics, Seoul, 2012
  • Co-chair of the special session on grey systems at the 2011 IEEE International Conference on Systems, Man and Cybernetics, Anchorage, 2011
  • Co-chair of the Program Committee for the 2011 IEEE International Conference on Grey Systems and IntelligentServices, Nanjing, 2011
  • Co-chair of the Program Committee for the 2009 IEEE International Conference on Grey Systems and Intelligent Services, Nanjing, 2009
  • Session chair for 3 regular sessions at the 2008 IEEE World Congress of Computational Intelligence, Hong Kong,2008
  • Co-chair of the special session on grey systems at the 2008 IEEE World Congress of Computational Intelligence,Hong Kong, 2008
  • Member of the organising committee of the 2007 IEEE International Conference on Grey Systems and Intelligent Services, Nanjing, 2007