Introduction
Laboratory is an important place for research and learning in universities and institutes. In laboratories, students can practice based on the theoretical concepts learned in the classroom [
1,
2]. In this regard, the laboratory work is a crucial part of the curriculum. There is strong evidence to support that chemicals and equipment in laboratories can be harmful to students or other people who work in this setting. Laboratory environments are known as places with numerous work-related hazards, such as long-lasting toxic gases and vapors, radiation, and gas cylinders. The students in the chemistry and pharmacy fields of study are constantly in contact with various laboratory chemicals or equipment. Irritating, toxic, flammable, corrosive, radioactive, and explosive features are the hazardous characteristics of chemicals that can cause skin burns, eye irritation, or death due to acute exposure [
2]. Despite numerous risk factors in the laboratory environment, the use of an occupational health and safety (OHS) management system can significantly reduce unsafe incidents.
Improving unsafe behaviors is one of the main objectives of using safety signs [
3]. In general, safety signs are labels with a specific color and shape that are used to represent safety instructions or information. They are widely used to draw attention to potential risks, prevent injuries, and ultimately reduce unsafe behaviors [
4]. Safety signs can reduce the risk of occupational accidents [
5]. Although safety signs are widely used, some do not have the necessary efficiency based on the defined purpose and cannot represent information properly [
6]. Many safety signs do not meet the usability and effectiveness criteria and are often not evaluated by target groups before use. Therefore, evaluation of safety signs before installation is necessary to ensure comprehensibility and prevent misunderstanding. Five criteria have been proposed for evaluating the usability of products including guessability, learnability, experienced user performance, system potential, and re-usability [
7, 8]. Moreover, some cognitive-related features have been recommended for evaluating signs, viz. familiarity, concreteness, simplicity, meaningfulness, and semantic closeness [
9]. Familiarity refers to the rate at which people have frequently encountered the sign. Concreteness indicates the possible connections of the signs with the real objects. Simplicity refers to the degree to which the signs are detailed. Meaningfulness refers to how much a sign is considered meaningful by people. Semantic closeness indicates the closeness of the relationship between what a sign depicts and what it wants to represent. These features are related to cognitive ability and individuals’ perception [
10]. Several studies have shown that the success of a sign in representing a message depends on both the demographic characteristics of people and these five cognitive features [
4,
11].
In literature, the comprehension of safety signs has been assessed in students, workers, and disabled people [
4,
11]. Duarte et al. assessed the comprehension of safety signs by students, adult workers, and disabled people. According to their results, students had the highest comprehension (42%), followed by workers (39%) and disabled people (21%) [
4]. Banstola found that only 49% of final-year pharmacy students at an Indian college were aware of pharmacy pharmaceutical symbols [
12]. The comprehension evaluation among diverse populations should be conducted to compare and increase the generalizability of the results. Several studies have revealed that older adults or people with low education levels are less able to understand safety signs [
13-
16].
Students frequently adhere to laboratory safety procedures, but there are still violations that have resulted in accidents and fatalities in the laboratory [
17]. Some studies have revealed that students have misunderstandings and are unaware of the use of hazardous chemicals [
18]. Wiediger and Hutchinson stated that if students misunderstand the information provided on chemical containers, there will be a risk of an accident in the laboratory [
19]. however, no study has examined the cognitive features and comprehensibility of safety signs in Iranian pharmacy students who are continuously present in laboratories. There is a critical gap in the effectiveness of laboratory safety signs for pharmacy students. Therefore, this research aims to assess the cognitive sign features and guessability of laboratory safety signs in Iranian pharmacy students.
Materials and Methods
Study design and participants
This descriptive-analytical study was conducted during 2021-2022. The study population consists of pharmacy students from Mazandaran University of Medical Sciences who are completing practical courses in a lab environment. The sample size was determined utilizing a single population proportion formula, considering a 95% confidence interval, test power of 90%, proportion of 0.5, and a margin of error of 0.05. Sixty-one male and female students were selected to participate in the study. The inclusion criteria were age 20-30, active participation in practical laboratory courses, and normal color vision based on a standard assessment. Exclusion criteria were prior laboratory experience (whether through coursework, workshops, or research involvement) and unwillingness to continue participation after providing informed consent. Finally, 55 students participated in this study.
Safety signs
According to international and national standards, there are many laboratory safety signs that primarily focus on alarming hazards or preventing unsafe behaviors. In this study, ISO 7010 was used to get a list of graphical safety signs [
20]. The most common safety signs in the academic laboratories were selected based on the frequency of use, hazard level, clarity, and universality and according to the opinions of five experts (three laboratory specialists with more than 10 years of experience and two academic researchers in the field of safety and ergonomics). The signs were selected because their meanings are perceived only through symbols and were not combined with other signs to communicate a message. Also, in a previous study, these signs had guessability lower than 60% [
3]. The safety signs should have the following features to be included in the experiment: Being the label of chemicals or equipment, observation by experts in other laboratories, and being simple or useful. Finally, 22 safety signs were selected and categorized into four groups: Guide signs (n=4), mandatory signs (n=7), prohibition signs (n=5), and warning signs (n=6). The code and meaning of safety signs are presented in
Table 1.
Instrument
A questionnaire was designed to assess the color vision status of students and record their demographic information. The study objectives and instructions were explained to them before the experiment, followed by a computer presentation of the questionnaire. The first part of this questionnaire surveys demographic information. In the second part, a color vision test [
21] was used to screen out those who had red-green color problems. The experiment was conducted using a Samsung tablet with a 12-inch LED screen. The safety signs were presented on the tablet in a uniform size as Microsoft PowerPoint slides so that the subjects could examine the signs self-paced.
Quessabiliy test
The guessabiliy test was designed based on a previous study in this field [
3]. Five non-listed safety signs were shown to the participants as a trial to ensure the procedure was correctly understood. Then, 22 safety signs were randomly presented, and the students were asked to guess their meaning within 10 seconds. For each safety sign, there were five verbal labels: One correct answer, two partly correct answers, and two wrong answers. For example, the five labels for code 04 were “do not enter your hands,” “risk of injury to the hands,” “do not take the items,” “do not touch,” and “handling without personal protective equipment is prohibited.” The correct answer should be “do not touch”; the partly correct answers were “do not enter your hands”, “risk of injury to the hands”, and the wrong answer was “do not take the items” and “handling without personal protective equipment is prohibited”. Participants received a score of two marks if they chose the correct answer. A score of one mark was given for partially correct answers, and a zero mark for the wrong answers [
3]. No feedback for guessing performance was provided. This approach continued until the individual gave the guessed answers for all the signs. To prevent fatigue, a 1-minute break was provided after testing 22 signs.
Safety sign feature evaluation
The participants were briefed about the meanings of cognitive features. Five cognitive criteria (familiarity, concreteness, simplicity, meaningfulness, and semantic closeness) were used to assess cognitive sign features [
22]. The participants were asked to give a rating from 0 to 100 for familiarity (0=very unfamiliar to 100=very familiar), concreteness (0=definitely abstract to 100=definitely concrete), simplicity (0=very complex to 100=very sample), meaningfulness (0=completely meaningless to 100=completely meaningful), and semantic closeness (0=very weakly related) to 100=very strongly related) as shown in
Table 2.

A 0–100 point scale was used because of its high reliability and validity [
23].
Statistical analysis
The data from returned questionnaires were coded and entered into Microsoft Excel. The statistical analysis was carried out in SPSS software, version 23. The Kolmogorov-Smirnov test was used to evaluate the normality of the data distribution. Data were analyzed using descriptive statistics, box plots, and the Spearman correlation test. P<0.05 was considered statistically significant.
Results
In this study, 48% of the participants were male. The mean age of participants was 24.2±3.9 years. None of them had color vision problems.
Guessability test results
In this study, the guessability test score indicates the accuracy in guessing the correct meaning of each safety sign. The Kolmogorov-Smirnov test results showed that the guessability ratings for the signs were not normally distributed (P<0.05). The descriptive statistics of guessability scores for the safety signs are presented in
Table 3.

The lowest mean score was 1.08% for the general mandatory action sign (code 07), and the highest mean score (100%) was for no smoking (code 15). Mean scores of the guessability test for the safety signs based on categories (guide, mandatory, prohibition, and warning) are shown in
Table 4.

The box plot was used to check if there was a significant difference in the variability of the guessability score between the signs (
Figure 1).
The general mandatory action sign with code 07 (353.72%) and disconnect before carrying out maintenance or repair with code 13 (292.65%) were illustrated as outliers above the box, indicating that the dispersion of guessed answers for these two signs was more than for other signs. The mean guessability score for all safety sign groups was more than 50%, and the total Mean±SD were 70.2% and 14%, respectively.
Cognitive sign feature evaluation results
Table 5 reports the descriptive statistics for the cognitive feature evaluation of safety signs.

Approximately, the mean scores of the cognitive features for all signs were at the mid-point (50) of the 0-100 scale, indicating that all five criteria for the safety signs were met, except for code 13 (disconnect before carrying out maintenance or repair).
The ratings of cognitive sign features in different categories are presented in
Table 6.

The highest value for familiarity was 73.82% (for prohibition and warning signs); for concreteness, 81.30% (for prohibition signs); for simplicity, 82.78% (for prohibition signs); for meaningfulness, 82.62% (for prohibition signs); and for semantic closeness, 83.30% (for guide signs). Overall, the simplicity criteria had the highest value (85.73%). Code 15 (no smoking) had the highest score (in terms of familiarity), whereas code 13 (disconnect before carrying out maintenance or repair) had the lowest score (in terms of semantic closeness).
The relationship between guessing score and cognitive sign features
The coefficients of correlation between cognitive sign features and guessability score are shown in
Table 7.

The results indicated that all cognitive sign features significantly correlated with guessability scores except for concreteness and familiarity. The highest coefficient was reported between guessability score and semantic closeness (r=0.469, P<0.001).
Discussion
This study measured the comprehension of commonly used laboratory safety signs in Iranian pharmacy students and examined the effect of cognitive sign features on the guessability of signs. Out of 22 safety signs assessed in this study, only 10 signs met the ISO 9186:2001 acceptance criteria, indicating that students cannot perceive the messages of the lab safety signs. The sign “disconnect before carrying out maintenance or repair”, which was graphically very simple, had a low cognitive score. Recently, studies have focused on prospective-user factors as a strong predictor of guessing performance, such as driving, working at laboratories or construction sites, laboratory or construction site visit experience, and injury experience due to ignorance of safety signs [
3,
24, 25]. In this study, we did not investigate prospective-user factors since the safety signs utilized in pharmaceutical labs in Iran are not well defined. There has been no study on the relationship between the cognitive features and guessability of the meaning of the laboratory safety signs among pharmaceutical students to compare the results.
Consistent with previous studies, the safety signs that had less decorative details and were more generally simple scored higher guessability scores. As mentioned above, only 10 signs obtained the ISO 9186:2001 acceptability criteria (67%) [
26]. The signs “no smoking” and “flammable materials” got the highest guessability score, while “the general mandatory action sign” and “disconnect before carrying out maintenance or repair” had the lowest score. It seems that if people do not encounter safety signs frequently, it will be difficult for them to understand [
11,
27]. Generally, the “no smoking” signs are installed in public places, classrooms, and dormitories. In addition, the safety signs related to fire, such as the location of fire extinguishers or emergency exits, are present in faculties and are often encountered by students. The two signs with the lowest guessability score were related to the signs that people rarely encountered them. Rosson and Carrol suggested that the familiarity criterion should be considered in designing safety signs [
28]; however, it may not be easy since a sign familiar to a person may not be familiar to others.
Consistent with other studies [
3,
11], the results showed that the guessability scores were higher for the signs that had better cognitive features (e.g. simple and concrete signs). As mentioned above, previous experience can play a critical role in correct comprehension of safety signs. It can also be true about cognitive features. For instance, the sign “disconnect before carrying out maintenance or repair” with the lowest guessability score, surprisingly had the lowest score based on cognitive sign features evaluation, because the students had no previous experience or could not adapt to a real shape. This confirms that appropriate cognitive sign features alone cannot be relied upon to convey messages correctly. In some previous studies, when people gave higher comprehension scores for simple signs than for more complex signs, one of the simple signs had the lowest cognitive sign features [
29, 30], which is not consistent with this claim. It is important to note that cultural and social differences may be the reasons for these discrepancies. People face problems in different ways according to their thinking styles [
31]. Although the validity of the Persian version of the questionnaire for cognitive sign features evaluation has been confirmed [
32], further studies are recommended, especially on using other rating systems [
33].
Despite this study reporting a causal relationship between guessability and cognitive sign features, there were possible limitations that should be considered. In our study, the participants were young college students. Therefore, it should be cautious about generalizing the results to older people. We used a multiple-choice test to evaluate the guessability of signs. A multiple-choice test lacks ecological validity in capturing the real-world issue of sign comprehension compared to an open-ended test [
34]. However, we used a multiple-choice test because of its efficiency, low requirement for cross-checking, excellent inter-rater reliability, and content coverage in tests [
35].
Conclusion
This study revealed the important role of guessability and cognitive sign features for the lab safety signs in conveying their message. The lab safety signs without accompanying text or those that are not frequently encountered are difficult for pharmacy students to be perceived correctly.
Ethical Considerations
Compliance with ethical guidelines
This study was approved by the Ethics Committee of Mazandaran University of Medical Sciences, Sari, Iran (Code: IR.MAZUMS.REC.1399.8363).
Funding
This research was funded by Mazandaran University of Medical Sciences, Sari, Iran (Code: 8363).
Authors contributions
Conceptualization and study design: Hajiomid Kalteh and Siavash Etemadinezhad; Analysis, data interpretation, and writing the original draft: Jamshid Yazdani Cherati, Siavash Etemadinezhad, and Solale Ramzani; Review and editing: Hajiomid Kalteh, Aghigh Salarian, and Solale Ramzani; Final approval: All authors.
Conflict of interest
The authors declared no conflict of interest.
Acknowledgements
The authors would like to thank the Deputy for Research of Mazandaran University of Medical Sciences, Sari, Iran for financial support and all the students who participated in this study for their cooperation.
References
- Walters AU, Lawrence W, Jalsa NK. Chemical laboratory safety awareness, attitudes and practices of tertiary students. Safety Science. 2017; 96:161-71. [DOI:10.1016/j.ssci.2017.03.017]
- Adane L, Abeje A. Assessment of familiarity and understanding of chemical hazard warning signs among university students majoring chemistry and biology: A case study at Jimma University, Southwestern Ethiopia. World Applied Sciences Journal. 2012; 16(2):290-9. [Link]
- Chan AH, Ng AW. Investigation of guessability of industrial safety signs: Effects of prospective-user factors and cognitive sign features. International Journal of Industrial Ergonomics. 2010; 40(6):689-97. [DOI:10.1016/j.ergon.2010.05.002]
- Duarte E, Rebelo F, Teles J, Wogalter MS. Safety sign comprehension by students, adult workers and disabled persons with cerebral palsy. Safety Science. 2014; 62:175-86. [DOI:10.1016/j.ssci.2013.08.007]
- Wei J, Yuan-Chi X. Study on the role of the accident statistics in the design of coal mine safety signs. Journal of Mines, Metals and Fuels. 2021 ;69(5):143-8. [DOI:10.18311/jmmf/2021/28074]
- Davoudian-Talab A, Meshkani M, Mofidi A, Mollakazemiha M. Evaluation of the perception of workplace safety signs and effective factors. International Journal of Occupational Hygiene. 2013; 5(3):117-22. [Link]
- Jordan PW, Draper SW, MacFarlane KK, McNulty S-A. Guessability, learnability, and experienced user performance. In: Diaper D, Hammond N (editors). People and Computers VI. Cambridge: Cambridge University Press, 1991. [Link]
- Jordan PW, Thomas B, McClelland IL, Weerdmeester B. Usability evaluation in industry. London: CRC Press; 1996. [DOI:10.1201/9781498710411]
- McDougall SJ, Curry MB, de Bruijn O. Measuring symbol and icon characteristics: Norms for concreteness, complexity, meaningfulness, familiarity, and semantic distance for 239 symbols. Behav Res Methods Instrum Comput. 1999; 31(3):487-519. [DOI:10.3758/BF03200730] [PMID]
- Chan AH, Ng AW. Perceptions of implied hazard for visual and auditory alerting signals. Safety Science. 2009; 47(3):346-52. [DOI:10.1016/j.ssci.2008.06.003]
- Ng AW, Chan AH. The guessability of traffic signs: Effects of prospective-user factors and sign design features. Accident Analysis & Prevention. 2007; 39(6):1245-57. [DOI:10.1016/j.aap.2007.03.018] [PMID]
- Banstola A. Awareness of pictograms among the undergraduate pharmacy students in a pharmacy college in Karnataka, India: A preliminary study. International Journal of Pharmacy Teaching & Practices. 2013; 4(1):442-6. [Link]
- Hancock HE, Rogers WA, Fisk AD. Understanding age-related differences in the perception and comprehension of symbolic warning information. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 1999; 43(9):617-21. [DOI:10.1177/154193129904300906]
- Handcock HE, Rogers WA, Schroeder D, Fisk AD. Safety symbol comprehension: Effects of symbol type, familiarity, and age. Human Factors. 2004; 46(2):183-95. [DOI:10.1518/hfes.46.2.183.37344] [PMID]
- Lesch M, Horrey WJ, Wogalter MS, Powell WR. Age-related differences in warning symbol comprehension and training effectiveness: effects of familiarity, complexity, and comprehensibility. Ergonomics. 2011; 54(10):879-90. [DOI:10.1080/00140139.2011.606924] [PMID]
- Mishra RC, Dasen PR. The Influence of schooling of cognitive development: A review of research in India. Paper presented at: 16th International Congress of the International Association for Cross-Cultural Psychology. 15-19 July 2002; Yogyakarta, Indonesia. [DOI: 10.4087/UVUS4854]
- Shariff AM, Norazahar N. At-risk behaviour analysis and improvement study in an academic laboratory. Safety Science. 2012; 50(1):29-38. [DOI:10.1016/j.ssci.2011.06.008]
- Alaimo PJ, Langenhan JM, Tanner MJ, Ferrenberg SM. Safety teams: An approach to engage students in laboratory safety. Journal of Chemical Education. 2010; 87(8):856-61. [DOI:10.1021/ed100207d]
- Wiediger SD, Hutchinson JS. The significance of accurate student self-assessment in understanding of chemical concepts. Journal of Chemical Education. 2002; 79(1):120. [DOI:10.1021/ed079p120]
- International Organization for Standardization (ISO). ISO 7010:2019: Graphical symbols- safety colours and signs registered safety signs. Geneva: ISO; 2019. [Link]
- Birch J. Efficiency of the Ishihara test for identifying red-green colour deficiency. Ophthalmic and Physiological Optics. 1997; 17(5):403-8. [DOI:10.1111/j.1475-1313.1997.tb00072.x] [PMID]
- Chan AH, Ng AW. Effects of sign characteristics and training methods on safety sign training effectiveness. Ergonomics. 2010; 53(11):1325-46. [DOI:10.1080/00140139.2010.524251] [PMID]
- Preston CC, Colman AM. Optimal number of response categories in rating scales: Reliability, validity, discriminating power, and respondent preferences. Acta Psychologica. 2000; 104(1):1-15. [DOI:10.1016/S0001-6918(99)00050-5] [PMID]
- Chan AH, Ng AW. The guessing of mine safety signs meaning: Effects of user factors and cognitive sign features. International Journal of Occupational Safety and Ergonomics. 2012; 18(2):195-208. [DOI:10.1080/10803548.2012.11076928] [PMID]
- Shirali G, Hosseinzadeh T, Afshari D, Moradi M. [Investigation of ability to guess safety signs based on cognitive features in one of the petrochemical industries (Persian)]. Journal of Health and Safety at Work. 2015; 5(2):35-46. [Link]
- International Organization for Standardization (ISO) Graphical symbols-Test methods for judged comprehensibility and for comprehension. Geneva: International Organization for Standardization; 2001. [Link]
- Shinar D, Dewar R, Summala H, Zakowska L. Traffic sign symbol comprehension: A cross-cultural study. Ergonomics. 2003; 46(15):1549-65. [DOI:10.1080/0014013032000121615] [PMID]
- Rosson MB, Carroll JM. Usability engineering: Scenario-based development of human-computer interaction. Amsterdam: Elsevier Science; 2002. [Link]
- Dewar R. Design and evaluation of public information symbols. In: Zwaga H, Boersema T, Hoonhout H, editors. Visual information for everyday use. Florida: CRC Press; 1998. [Link]
- Marcus A. Icon and symbol design issues for graphical user interfaces. In: Heimgärtner R (editor). International users interface. Berlin: Springer International Publishing; 1996. [Link]
- Yang, KS. Chinese personality and its change. In: Bond MH, editors. The psychology of the Chinese people. Oxford: Oxford University Press; 1986. [Link]
- Taheri F, Saremi M, Faghihnia Torshizi Y. The validity and reliability of the Persian version of cognitive features questionnaire of symbolic signs (with the use of traffic signs). Iran Occupational Health Journal. 2018; 15(2):21-30. [Link]
- Annett J. Subjective rating scales: Science or art? Ergonomics. 2002; 45(14):966-87. [DOI:10.1080/00140130210166951] [PMID]
- Wolff JS, Wogalter MS. Comprehension of pictorial symbols: Effects of context and test method. Human factors. 1998; 40(2):173-86. [DOI:10.1518/001872098779480433]
- Farthing DW, Jones DM, McPhee D. Permutational multiple-choice questions: An objective and efficient alternative to essay-type examination questions. ACM SIGCSE Bulletin. 1998; 30(3):81-5. [DOI:10.1145/290320.283036]