We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CY

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computers and Society

Title: Abnormal-aware Multi-person Evaluation System with Improved Fuzzy Weighting

Authors: Shutong Ni
Abstract: There exists a phenomenon that subjectivity highly lies in the daily evaluation process. Our research primarily concentrates on a multi-person evaluation system with anomaly detection to minimize the possible inaccuracy that subjective assessment brings. We choose the two-stage screening method, which consists of rough screening and score-weighted Kendall-$\tau$ Distance to winnow out abnormal data, coupled with hypothesis testing to narrow global discrepancy. Then we use Fuzzy Synthetic Evaluation Method(FSE) to determine the significance of scores given by reviewers as well as their reliability, culminating in a more impartial weight for each reviewer in the final conclusion. The results demonstrate a clear and comprehensive ranking instead of unilateral scores, and we get to have an efficiency in filtering out abnormal data as well as a reasonably objective weight determination mechanism. We can sense that through our study, people will have a chance of modifying a multi-person evaluation system to attain both equity and a relatively superior competitive atmosphere.
Comments: 13 pages, 5 figures
Subjects: Computers and Society (cs.CY); Machine Learning (cs.LG); Applications (stat.AP)
Cite as: arXiv:2205.00388 [cs.CY]
  (or arXiv:2205.00388v1 [cs.CY] for this version)

Submission history

From: Shutong Ni [view email]
[v1] Sun, 1 May 2022 03:42:43 GMT (1151kb,D)

Link back to: arXiv, form interface, contact.