ABSTRACT
Aim:
The purpose of this study is to evaluate the quality and reliability of YouTube videos about infertility, erectile dysfunction and sex relationship with coronavirus disease-2019 (COVID-19).
Methods:
In this prospective study, videos were selected on 20.12.2020 and variable parameters were studied on the same day. Non-variable parameters such as quality and reliability were studied until 25.12.2020. “Corona, infertility”, “corona, erectile dysfunction”, “corona, sex”, “COVID, infertility”, “COVID, erectile dysfunction”, COVID, sex”, “pandemic, infertility” “pandemic, erectile dysfunction” and “pandemic, sex” search words scanned in a private search mode on the YouTube website. Unrelated, not English, do not contain any information videos excluded. The remaining videos were evaluated according to the presenter source and the presented audience with modified discern and Global Quality Scala (GQS) forms.
Results:
Fourteen (14%) of 100 videos were about erectile dysfunction, 56 (56%) were about infertility and 30 (30%) were about sex. Fifteen (15%) of the videos were presented by individual sources, 4 (4%) by non-physician healthcare professionals, 48 (48%) by individual physicians, 17 (17%) by physician groups, 13 (13%) by news agencies, and 3 (3%) by private companies. While 87 (87%) of the target group was the general public, 13 (13%) of them were healthcare professionals. According to the presenter source, the modified discern and GQS scores of the physician group were higher than the other groups. However, the number of views and likes in these two groups was low.
Conclusion:
Videos offered by physician groups and targeted by healthcare professionals on YouTube are of higher quality and more reliable. However, the popularity of videos is not a suitable indicator of quality.
Introduction
The new coronavirus disease-2019 (COVID-19) epidemic that started in Wuhan, China in December 2019 caused a serious health crisis worldwide in a short time (1). This infection, which was declared a pandemic by the World Health Organization on March 11 2020, has now caught more than 80 million people and nearly two million people have died (1). Despite social distancing and isolation measures, the number of cases is still increasing.
Pneumonia is the most common complication of COVID-19 (2). However, many studies have shown that other organs are also affected (3).
Andrologically, studies have indicated that the virus can cause erectile dysfunction and infertility (4,5). However, most of these studies are not yet strongly proven. However, such information has led to speculation on websites, news programs, and especially on social media, and has made people nervous (6). It has been stated that incomplete or incorrect information on social media is one of the most damaging issues to fight COVID-19 (7). It is possible that failure to inform the society completely and correctly can cause social chaos and panic (8). Therefore, it is important to filter information sources in this global crisis.
YouTube, which we used in our study, is the largest video site in the world and the second largest search page. This site has more than one billion users and hundreds of millions of videos (9,10). However, since videos do not pass any filter on this site, false and harmful information is shared as well as true information. In a study on breast cancer, most of the YouTube videos have misrepresented self-examination and by explaining that breast cancer is seen only in women, it has been observed that there are false and harmful directions (11). YouTube videos on Zika and Ebola infections from previous public health crises have been viewed millions of times. However, studies have shown that most of the videos are misleading (12,13). For these reasons, it is important to evaluate videos in terms of quality and reliability.
In this study, the videos shared on the YouTube website about infertility, erectile dysfunction and sexuality relationship with COVID-19 were evaluated in terms of quality and reliability.
Methods
In this prospective study, after the approval of the local ethics committee (dated 01.12.2020 and numbered 2020/09-22), the videos were selected on 20.12.2020. At the same time, the number of likes, dislikes, views and comments, which are the variable data of the videos, was studied. The unvariable parameters (quality and reliability) were studied until 25.12.2020. On the YouTube website “corona, infertility”, “corona, erectile dysfunction”, “corona, sex”, “COVID, infertility”, “COVID, erectile dysfunction”, COVID, sex” the keywords “pandemic, infertility” “pandemic, erectile dysfunction” and “pandemic, sex” were searched. The searches were made in incognito mode in the cache-cleared web browser where all updates were available. The upload date from the filters was adjusted according to “this year” and the ranking criterion relevance. Videos with keywords in the video title were included in the study.
After searching, 152 videos were evaluated. Videos that were repeated, non-English, irrelevant, or did not contain any audio or visual information were excluded.
The remaining 100 videos after these exclusion criteria were evaluated separately by two expert urologists (MD, RE). Reliability among experts was calculated by kappa statistics. When no consensus was reached, a third expert (RA) was consulted.
The duration of the videos included in the study, the number of views, upload time, number of comments, likes and dislikes were recorded. The videos were evaluated according to host sources and target audiences. Server sources were categorized into 6 groups as individual, non-physician healthcare provider, individual physician, physician group, journalist and private company.
The target audiences were categorized as healthcare professionals and the general audience.
Video topics were divided into 3 as erectile dysfunction, infertility, sex (transmission during sex, protection, sexual interference, etc.).
The Global Quality Score (GQS) form was used to evaluate the overall quality of the videos. This form consists of five degrees that question the quality, flow, information content and usefulness of the videos. GQS: 1 indicates poor quality, while GQS: 5 shows excellent quality (14).
Discern short modified form was used to evaluate the reliability of the videos. It is a modified version of the form developed by Modified Discern Charnock and Shepperd (15). In this form with a 5-rating, videos with 3 points are considered medium quality, while those who score more than 3 are considered quality, areas less than 3 are considered low quality.
Statistical Analysis
Descriptive statistics for continuous variables; it is expressed as average, standard deviation, minimum and maximum values, and expressed as numbers and percentages for categorical variables. One-way analysis of variance was used to compare group averages in terms of continuous variables. Following the variance analysis, Duncan multiple comparison test was used to identify different groups. Pearson correlation coefficients were calculated to determine the relationship between these variables. Chi-square test was used to determine the relationship between the groups and categorical variables. The statistical significance level was taken as 5% in the calculations and the SPSS statistical package program was used for calculations.
Results
After 152 videos were evaluated according to exclusion criteria, the remaining 100 videos were included in the study. The average upload time of the videos is 224.43±197 days, the length is 859.05±1.313 sec, the number of likes is 293.49±1110.55, the dislike is 112.14±477.60, the number of views is 26586.8±74207.1, and the number of comments is 10.8±397.94. The kappa coefficient among experts (MD, RE) was 0.91.
While there were 14 (14%) videos about erectile dysfunction, 56 (56%) were about infertility, and 30 (30%) were about sex. According to the topics of videos, the groups were homogeneous regarding length, number of likes and dislikes, views, comments, Discern and GQS results. Fifteen (15%) of the videos were individual sources, 4 (4%) non-physician healthcare professionals, 48 (48%) individual physicians, 17 (17%) physicians, 13 (13%) news agencies, 3 (3%) of them were offered by private firms. The properties of the videos by the server source are listed in Table 1.
While 87 (87%) of the target audience in the videos was the public, 13 (13%) were healthcare professionals. Considering the target audience of the videos, the duration of the videos made for healthcare professionals was significantly longer (p=0.001). However, there was no significant difference in terms of upload time, likes, dislikes, views and comments of the videos. Videos with GQS 5 were significantly longer than other videos (p=0.001). While there was no significant difference in the number of likes according to the GQS values, the GQS 5 was significantly lower in the dislike numbers (p=0.02).
The number of views was highest in GQS 2 with an average of 71421.20 (p=0.02). There was no statistically significant difference in the number of comments compared to the GQS values. GQS scores according to the video source and target audience are in Table 2,3. According to the server, the Discern score was significantly higher in the physician group and compared to the target group in the healthcare group (Table 4).
Discussion
Today, the Internet has become a platform where information about health can be easily obtained. More than 80% of Americans use the Internet to obtain health information (16). The Internet is an easily accessible tool to obtain information on issues that have become taboo in society, especially sexual and reproductive health (17,18).
YouTube is the most popular video website with over 1 billion users and millions of videos. In a study conducted on male infertility, it was observed that Twitter, one of the social media platforms, refers to YouTube videos with the hashtag #maleinfertility and online traffic is directed to YouTube (19). In the study by Fode et al. (20), they showed that every month millions of people watch erectile dysfunction videos on YouTube.
In addition, according to YouTube data, 95% of Internet users use YouTube (21). For these reasons, the results we obtained are generalizable.
It was seen that most of the videos about the relationship between COVID-19 and ED, infertility and sexual health was shared by individual physicians, targeting the public. The highest scores in terms of the quality and usefulness of the videos were the videos of the physician group. It is natural that there is more than one physician as a scientific resource in the physician group, and scientific quality increases due to the exchange of ideas and the transformation of speech into a scientific environment. Despite this, Discern and GQS scores of both physician groups and individual physicians were not at a satisfactory level in our study. The reason for this may be that the relationship between COVID-19 and andrological diseases is dark, the literature is inadequate, and there is no consensus among international health organizations. In the study in which Culha et al. (22) evaluated YouTube videos about pelvic floor muscle exercises, it was seen that the quality and reliable information was shared by healthcare professionals (doctors, nurses, physiotherapists) regardless of the branch. In addition, the Discern scores of the videos presented by healthcare professionals were higher than our study. This may be due to the general lack of knowledge between COVID-19 and andrological diseases. In the same study, healthcare providers obtained the highest GQS scores in line with our study (22). In addition, when the target audience in our study was healthcare professionals, it is thought that the increase in both the quality and reliability of the videos is because the information is given with more detailed and literature information.
In a study evaluating erectile dysfunction videos on YouTube, it was observed that the videos provided by groups of healthcare professionals were of higher quality than individual professionals and nonprofessional groups, in accordance with our study (13). Similar results were also obtained in a study on laryngeal cancer (23). Ku et al. (24) stated that YouTube videos can be useful for informing about infertility, but high-quality videos are needed. In the field of urology, Fode et al. (20) found the videos suspicious in their study, where they evaluated videos on erectile dysfunction on YouTube (20). In a study by Gul and Diri (25), they stated that there were many misleading videos about prematüre ejeculation on YouTube and they suggested that they should be removed. In our study, although the Discern and GQS scores were higher in the videos presented by the physician groups, it was still not at the desired level. In addition, these scores decrease even more in groups other than the physician group. These data also show that YouTube videos are not reliable and of sufficient quality.
In our study, it was observed that high-quality and reliable videos had a small number of views and likes. In another study on YouTube videos about COVID-19 and pregnancy relationship, it was observed that news agencies were the most watched videos, but their discern scores were low (26). Therefore, popularity does not seem to be a suitable criterion for predicting video quality. However, according to the results of our study, the number of dislikes can be a criterion in terms of reliability and quality.
Study Limitations
Our working together with all of these has some limitations. Since YouTube has a dynamic structure, new videos can be added and removed constantly, and the number of views, likes and dislikes can change. However, as only English language videos were used in our study, it had a relatively small sample. It should be kept in mind that although the video searches are made in incognito mode with the cache cleared, our geographic location and computer language may affect the search results.
Conclusion
As a result, although YouTube website has an important source of information in terms of COVID-19 and andrological problems, it is important to be careful in terms of the reliability and quality of the videos. It should also be known that non-physician server resources are unreliable enough.
Authorship Contributions
Concept: M.D., K.T., K.E., Design: M.D., K.T., R.E., R.A., K.E., Data Collection or Processing: M.D., K.T., R.E., R.A., K.E., Analysis or Interpretation: M.D., K.T., R.E., R.A., K.E., Literature Search: M.D., K.T., R.E., R.A., K.E., Writing: M.D., R.A., R.E.
Conflict of Interest: No conflict of interest was declared by the authors.
Financial Disclosure: The authors declared that this study received no financial support.