
An evaluation and benchmarking of these systems are important towards understanding the most suitable for fulfilling all essential requirements. Many studies have recently developed real-time sign language recognition system (SLRS)-based DataGlove wearable electronic devices for deaf and dumb to assort hand gestures as having an identical meaning in spoken language. The robustness of the formulated methods is evaluated using systematic ranking, sensitivity analysis and comparison analysis. In the ranking results, a variation of ranking is scored by each expert, and group decision-making is applied to solve the individual ranking variety. The result of Pm-PFWZIC shows that the criterion of ‘finger movements’ has the highest weight amongst the rest of the criteria, whereas ‘misclassification error’ has the lowest weight. Secondly, the description of the real-world case study of the evaluation and benchmarking of the sign language recognition systems is adapted and presented. Firstly, the mechanisms of Pm-PFWZIC and Pm-PFDOSM are formulated and integrated into the development phase. The research methodology is presented as follows.

Such extensions, called Pythagorean -polar fuzzy-weighted zero-inconsistency (Pm-PFWZIC) method and Pythagorean -polar fuzzy decision by opinion score method (Pm-PFDOSM), are formulated to weight the evaluation criteria followed by alternative ranking progressively. With the practical features of -polar fuzzy set in combination with PFS, this paper employs it to extend two considerable MCDM methods, namely, fuzzy decision by opinion score method and fuzzy-weighted zero inconsistency. Thus, -polar fuzzy set is utilized and applied with other fuzzy sets because of its remarkable ability as a tool for depicting fuzziness and uncertainty under multipolar information in many circumstances. On the other hand, multipolar technology is used to operate large-scale systems in real-life situations, especially in dealing with dissatisfaction and indeterminacy grades for the alternatives of the reference set. On the one hand, PFS still does not have sufficient ability and flexibility to deal with such issues. In this context, researchers have developed the Pythagorean fuzzy set (PFS) to overcome the limitation of intuitionistic fuzzy set in the description of decision-maker information such as imposing restrictions on the representation of membership and nonmembership grades. In the fuzzy multicriteria decision-making approach, a committee of decision-makers is usually involved in the assessment of the suitability of different alternatives based on the evaluation criteria by using linguistic terms and their equivalent fuzzy numbers. Software: Practice and Experience published by John Wiley & Sons Ltd. (2) Internal and external aggregations show that the enhanced watermarking approach demonstrates better performance than the original watermarking approach. However, in the case of selection where the priority weights are generated from the evaluators, group decision making is the recommended solution to solve the trade-off reflected in the benchmarking process for digital watermarking approaches. The findings of this research are as follows: (1) group and individual decision making provide the same result in this case study. Therefore, selecting the proper context with different aggregation operators to benchmark the results of experiment 1 (i.e., digital watermarking approaches) is recommended. In the decision making solution, the technique for order of preference by similarity to the ideal solution with different contexts (e.g., individual and group) is utilized. The analytic hierarchy process is used to measure evaluator preference.

Weight measurement with a decision making solution is required to solve this issue. In the second experiment, the situation in which digital watermarking evaluators have different preferences is discussed. A total of 120 samples were evaluated according to three different metrics, namely, quality, payload, and complexity, to generate a set of digital watermarking samples. Sixty audio samples from different audio styles are tested with two algorithms. In the first experiment, a noise gate-based digital watermarking approach is developed, and the scheme for the noise gate digital watermarking approach is enhanced. Therefore, this paper presents a new methodology for digital watermarking evaluation and benchmarking based on large-scale data by using external evaluators and a group decision making context. Well-known benchmarking approaches are limited to robust watermarking.

However, these approaches still possess a number of limitations, such as fixing several attributes on the account of other attributes. A few approaches have been presented to implement digital watermarking evaluation and benchmarking frameworks.

Digital watermarking evaluation and benchmarking are challenging tasks because of multiple evaluation and conflicting criteria.
