Expert judgment Z-Numbers as a ranking indicator for hierarchical fuzzy logic system

Shaiful Bakhtiar bin Rodzman, Normaly Kamal Ismail, Nurazzah Abd Rahman, Syed Ahmad Aljunid, Zulhilmi Mohamed Nor, Ku Muhammad Naim Ku Khalif

Abstract


In this article, the researchers main contribution is to investigate three factors which may correlate in implementation of Expert Judgment Z-Numbers as new Fuzzy Logic Ranking Indicator such as: expert relevance judgment or score, the expert confidence and the level of expertise. The Expert Judgment Z-Numbers then will be an input to the Hierarchical Fuzzy Logic System of Domain Specific Text Retrieval, along with other indicators such as Ontology BM25 Score, Fabrication Rate, Shia Rate and Positive Rate of hadith document. The results showed, the proposed system, with the additional new indicator of Expert Judgment Z-Numbers, may improve the original BM25 ranking function, by yielding better results on 26 queries, on all evaluation metrics that are measured in this research such as P@10, %no measures and MAP, and has achieved better results in 28 queries on P@10 alone, compared to the BM25 original score, that only yield better results in 2 queries on all evaluation metrics, and also yield better results in 4 queries on the MAP alone. The results proved that the proposed system has a capability to utilize the expert confidence and their relevant judgment that are represented in Z-Number, as an indicator to optimize the existing ranking function system and has a potential for a further research to be conducted on these domains. For the future works, the researchers would like to enhance this research by including a variety of expert’s level confidence and their judgment, also a new calculation to represent the value of Z-Numbers.


Keywords


BM25 model; Domain specific text retrieval; Expert judgment; Fuzzy logic; Ranking indicator; Z-Numbers

Full Text:

PDF


DOI: http://doi.org/10.11591/ijai.v8.i3.pp244-251

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

IAES International Journal of Artificial Intelligence (IJ-AI)
ISSN/e-ISSN 2089-4872/2252-8938 
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).

View IJAI Stats