{"id":93012,"date":"2023-11-27T12:00:47","date_gmt":"2023-11-27T12:00:47","guid":{"rendered":"https:\/\/touchoncology.com\/?p=93012"},"modified":"2024-03-18T10:14:14","modified_gmt":"2024-03-18T10:14:14","slug":"quality-and-reliability-of-spanish-language-youtube-videos-on-breast-cancer","status":"publish","type":"post","link":"https:\/\/touchoncology.com\/breast-cancer\/journal-articles\/quality-and-reliability-of-spanish-language-youtube-videos-on-breast-cancer\/","title":{"rendered":"Quality and Reliability of Spanish-language YouTube Videos on Breast Cancer"},"content":{"rendered":"
Breast cancer is the leading cause of cancer death in Hispanic women in the USA. According to the American Cancer Society, as many as one in nine Hispanic women will develop invasive breast cancer during their lifetime and one in 49 Hispanic women will die from invasive breast cancer.1<\/sup><\/span>\u00a0Female breast cancer is also the most common and leading cause of cancer death in Latin American and Caribbean countries, with an estimated 114,900 new diagnoses and 37,000 deaths each year.2,3<\/sup><\/span><\/p>\n Patients who receive a cancer diagnosis are often faced with difficult decisions regarding their treatment and prognosis and thus they rely on multiple sources of information to make an informed decision. The internet is an increasingly important source of health-related information for patients in the USA and worldwide. According to a National Health Interview Study survey from 32,139 adults, approximately 43% reported searching the internet for health information.4<\/sup><\/span>\u00a0Fox and colleagues found that 83% of Hispanic adults living in the USA obtained health information from media sources, with 79% of those acting on the health-related information obtained from these sources.5<\/sup><\/span><\/p>\n YouTube, a global repository of videos and social networking platforms, is a popular way for people to access health-related information, with over a billion hours viewed every day.6<\/sup><\/span>\u00a0According to a study conducted by the Pew Research Center, 72% of adults online use some form of video-sharing platform, of whom 63% use YouTube as a source of health-related information.7<\/sup><\/span>\u00a0A variety of online outlets \u2013 including advertisers, government agencies, news agencies, patient health portals, patients and health professionals \u2013 produce health-related videos and upload them to YouTube. However, several studies have questioned the quality and reliability of health-related information on YouTube.8\u201310<\/sup><\/span>\u00a0A study published in 2018 evaluating breast self-examination videos on YouTube found 54 out of 87 videos misleading.11<\/sup><\/span><\/p>\n While previous studies have evaluated the quality and reliability of online information in English, no studies have assessed the quality and reliability of YouTube videos in Spanish containing health-related information pertaining to breast cancer.11\u201316<\/sup><\/span>\u00a0For Spanish-speaking-only patients, who face language barriers in receiving health information, high-quality, reliable online health-related information that is available in Spanish is essential.17,18<\/sup><\/span>\u00a0Our main objective was to determine the quality and reliability of online videos in Spanish regarding breast cancer.<\/p>\n We conducted a descriptive analysis of Youtube videos using the search terms “cancer de mama<\/em>” (translation: “breast cancer”) to investigate what patients would find when they are seeking information via YouTube. We chose these words over other options because this is the most broadly used set of words to describe breast cancer in Spanish. Search history, cookies and caches were cleared from the personal computers of the investigators to avoid any possible influence from prior browsing history. We created a new YouTube account in Harlingen, Texas. The first 200 video results from uniform resource locators of the search engine results page were transferred onto a playlist to avoid daily variances in search results using the default search filters. All inactive videos, duplicates, non-Spanish duplicates, or those with audio only, or without accompanying audio were excluded. Out of the initial 200 videos, a total of 173 were included in the study for further analysis. Twenty-seven videos (15%) were excluded because they had no audio (n=5), no relevant information (n=8), were in a non-Spanish language (n=10), in multiple parts (n=3) or were duplicates (n=1).<\/p>\n All videos were viewed in their entirety, with information collected from each video, including the number of \u2018likes\u2019, \u2018dislikes\u2019, total number of views, country of origin, video length and video upload date. Videos were categorized into one of five typology groups according to the source of upload: ‘commercial’ (for-profit companies), ‘government\/news agencies’, ‘health portal’ (health information website), ‘personal’ (patient or family), and ‘Professional’ (university, hospital, physician groups or non-profit physician) (Table 1<\/span>). The content of each video was assessed for the following: signs and symptoms, screening and detection, risk factors, diagnosis, research, treatment, reconstruction, survivorship\/advocacy, and male breast cancer.<\/p>\n Table 1: <\/span><\/b>Description of video typologies<\/b><\/p>\n Typology<\/b><\/p>\n<\/td>\n Description<\/b><\/p>\n<\/td>\n<\/tr>\n<\/thead>\n\n Commercial<\/p>\n<\/td>\n Videos that buy, sell or offer a service for a fee<\/p>\n<\/td>\n<\/tr>\n Government\/news agency<\/p>\n<\/td>\n Videos created and\/or managed by an official government body<\/p>\n<\/td>\n<\/tr>\n Health portal<\/p>\n<\/td>\n Videos created by an organization that offers health information on a variety of health topics<\/p>\n<\/td>\n<\/tr>\n Personal<\/p>\n<\/td>\n Videos created by individuals, patients and familes of patients<\/p>\n<\/td>\n<\/tr>\n Professional<\/p>\n<\/td>\n Video created by health professionals, experts and professional organizations<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n Video quality and reliability were assessed using three validated tools. The Journal of the American Medical Association (JAMA) Benchmark Criteria utilizes four core standards to evaluate online health information and identify the essential components of transparency and reliability: authorship, attribution of references, currency and disclosure of any potential conflict of interest. A point is given for the presence of each criterion, with a minimum score of 0 and a maximum score of 4.4<\/sup><\/span>\u00a0The Global Quality Score (GQS) is a subjective tool graded on a 5-point Likert scale, with a score of 1 representing poor quality and not being beneficial for patients, and a score of 5 representing excellent quality and very useful for patients.19<\/sup><\/span>\u00a0The modified 5-point DISCERN score is a questionnaire used to evaluate the quality of information with a maximum potential score of 5 points indicating high quality and a minimum of 0 points indicating poor quality (Table 2<\/span>). In summary, the JAMA score evaluates information reliability, while the GQS and DISCERN scores assess information quality. Combining the scores provides a broader portrait of the quality and reliability of the video, as a whole. Scores were generated by two internal medicine resident physicians who were fluent in English and Spanish (IL and DC) independently at different times, who also selected the videos from the original search. The corresponding Cohen\u2019s kappa coefficients for GQS and DISCERN scores were 0.923 and 0.960, respectively. A third physician (FD) resolved any disagreements on scores.<\/p>\n Table 2: <\/span>Evaluation tools for reliability and quality<\/p>\n JAMA score (1 point per question if present; maximum 4 points<\/b>)<\/p>\n<\/td>\n<\/tr>\n<\/thead>\n\n 1. Authorship<\/p>\n<\/td>\n<\/tr>\n 2. Attribution of references<\/p>\n<\/td>\n<\/tr>\n 3. Currency<\/p>\n<\/td>\n<\/tr>\n 4. Disclosure<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n Global Quality Score (choose one)<\/p>\n<\/td>\n<\/tr>\n<\/thead>\n 1. Poor quality, poor flow, most information missing, not helpful for patients<\/p>\n<\/td>\n<\/tr>\n 2. Generally poor, some information given but of limited use to patients<\/p>\n<\/td>\n<\/tr>\n 3. Moderate quality, some important information is adequately discussed<\/p>\n<\/td>\n<\/tr>\n 4. Good quality good flow, most relevant information is covered, useful for patients<\/p>\n<\/td>\n<\/tr>\n 5. Excellent quality and excellent flow, very useful for patients<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n DISCERN score (<\/b>1<\/b>\u00a0point per question if answered yes; maximum<\/b>\u00a05<\/b>\u00a0<\/b>points)<\/b><\/p>\n<\/td>\n<\/tr>\n<\/thead>\n\n 1. Are the explanations given in the video clear and understandable?<\/p>\n<\/td>\n<\/tr>\n 2. Are useful reference sources given? (publication cited, from valid studies)<\/p>\n<\/td>\n<\/tr>\n 3. Is the information in the video balanced and neutral?<\/p>\n<\/td>\n<\/tr>\n 4. Are additional sources of information given from which the viewer can benefit?<\/p>\n<\/td>\n<\/tr>\n 5. Does the video evaluate areas that are controversial or uncertain?<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n JAMA<\/span>\u00a0=\u00a0Journal of the American Medical Association<\/span>.<\/span><\/em><\/p>\n<\/div>\n<\/div>\n<\/div>\n The ordinal scales were used to measure the video quality and reliability scores. Since these measurements are in an ordinal scale, we summarize them using median and interquartile ranges (IQR). All numerical measures are summarized as median \u00b1 IQR and all qualitative variables were summarized as counts (percentages), as the best summary measures for categorical variables are percentages. The qualitative variables were recorded as percentages (year video uploaded, length of video, country of origin and typology). The differences in the quality and reliability measures were evaluated by typology using the Kruskal\u2013Wallis (KW) non-parametric test.20<\/sup><\/span>\u00a0This is mainly due to having ordinal type measures (quality and reliability scores) for small sample sizes within certain typology categories, and hence not being able to satisfy the normality assumption to use the one-way\u00a0analysis of variance<\/span>.21<\/sup><\/span>\u00a0It should be noted that, in the KW test, we deal with either the median (when the data distribution has the same shapes) or mean rank (when the data distribution do not have similar shapes). In our case, the shape of the data distribution for JAMA, GQS and DISCERN scores, within typologies are not the same and hence we report the mean ranks. Bonferroni adjusted pairwise comparisons with Dunn test were used to identify the significant differences in the three scores, between each pair of typology.22<\/sup><\/span>\u00a0To detect a significant association among qualitative variables within each typology group, either the Pearson\u2019s chi-square or Fisher\u2019s exact tests were utilized.<\/p>\n Linear regressions were used to evaluate the impact of variables (number of likes, dislikes, duration of videos and number of views) on the three quality and reliability scores after adjusting for the typology and the contents of the videos. If the assumptions of linear regression models were not satisfied, a corresponding generalized additive model (GAM) was used to evaluate the impact of each variable. GAM provide a general framework for extending a standard linear model by allowing non-linear functions of each of the variables. All tests were two-tailed, and a 0.05 significance level was used to assess the statistical significance. Data analysis was performed using R (V.4.1.2).<\/p>\n Approximately 4% of videos were uploaded before 2010, 31% uploaded 2010-2014, and 63.5% uploaded 2015-2019. The median length of the videos was approximately 5\u00a0<\/span>minutes, with an IQR of 9.30. Approximately 48% of videos lasted less than 5 minutes, 19% were between 5 and 10 minutes, 20% were between 10 and 20 minutes, and 12% lasted longer than 20\u00a0<\/span>minutes. The videos in our sample had a median number of views of 23,539. The median number of \u2018likes\u2019 per video was 159, with a range of 0\u201347,000 (IQR: 468). The median number of \u2018dislikes\u2019 was 10, with a range of 0\u2013721 (IQR: 38). Most videos were published in Spain (36.4%), followed by Mexico (17.9%) and the USA (10.4%). Of the remaining videos, 26.6% were uploaded from 12 other Latin American countries and, in 8.7%, the country of origin could not be identified (Table 3<\/span>)<\/p>\n Table 3: <\/span>Video characteristics<\/p>\n Year video uploaded<\/p>\n<\/td>\n Total N=173 N (%)<\/p>\n<\/td>\n<\/tr>\n<\/thead>\n <2010<\/p>\n<\/td>\n 7 (4%)<\/p>\n<\/td>\n<\/tr>\n 2010<\/p>\n<\/td>\n 2 (1.2%)<\/p>\n<\/td>\n<\/tr>\n 2011<\/p>\n<\/td>\n 17 (9.8%)<\/p>\n<\/td>\n<\/tr>\n 2012<\/p>\n<\/td>\n 8 (4.6%)<\/p>\n<\/td>\n<\/tr>\n 2013<\/p>\n<\/td>\n 10 (5.8%)<\/p>\n<\/td>\n<\/tr>\n 2014<\/p>\n<\/td>\n 17 (9.8%)<\/p>\n<\/td>\n<\/tr>\n 2015<\/p>\n<\/td>\n 16 (9.2%)<\/p>\n<\/td>\n<\/tr>\n 2016<\/p>\n<\/td>\n 22 (12.7%)<\/p>\n<\/td>\n<\/tr>\n 2017<\/p>\n<\/td>\n 26 (15%)<\/p>\n<\/td>\n<\/tr>\n 2018<\/p>\n<\/td>\n 28 (16.2%)<\/p>\n<\/td>\n<\/tr>\n 2019<\/p>\n<\/td>\n 18 (10.4%)<\/p>\n<\/td>\n<\/tr>\n 2020<\/p>\n<\/td>\n 2 (1.2%)<\/p>\n<\/td>\n<\/tr>\n Length of<\/b>\u00a0<\/span>v<\/b><\/span>ideo<\/b><\/span><\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median<\/p>\n<\/td>\n 5.28 mins<\/p>\n<\/td>\n<\/tr>\n Interquartile range<\/p>\n<\/td>\n 9.30<\/p>\n<\/td>\n<\/tr>\n 0\u20135 minutes<\/p>\n<\/td>\n 83 (48%)<\/p>\n<\/td>\n<\/tr>\n 5\u201310 minutes<\/p>\n<\/td>\n 33 (19%)<\/p>\n<\/td>\n<\/tr>\n 10\u201320 minutes<\/p>\n<\/td>\n 34 (20%)<\/p>\n<\/td>\n<\/tr>\n 20\u201330 minutes<\/p>\n<\/td>\n 15 (9%)<\/p>\n<\/td>\n<\/tr>\n >30\u00a0<\/span>min<\/p>\n<\/td>\n 6 (3%)<\/p>\n<\/td>\n<\/tr>\n Number of<\/b>\u00a0<\/span>v<\/b><\/span>iews<\/b><\/span><\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median<\/p>\n<\/td>\n 23,539<\/p>\n<\/td>\n<\/tr>\n Number of<\/b>\u00a0<\/span>l<\/b><\/span>ikes<\/b><\/span><\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median<\/p>\n<\/td>\n 159<\/p>\n<\/td>\n<\/tr>\n Range<\/p>\n<\/td>\n 0\u201347,000<\/p>\n<\/td>\n<\/tr>\n Interquartile range<\/p>\n<\/td>\n 468<\/p>\n<\/td>\n<\/tr>\n Number of<\/b>\u00a0<\/span>d<\/b><\/span>islikes<\/b><\/span><\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median<\/p>\n<\/td>\n 10<\/p>\n<\/td>\n<\/tr>\n Range<\/p>\n<\/td>\n 0\u2013721<\/p>\n<\/td>\n<\/tr>\n Interquartile range<\/p>\n<\/td>\n 38<\/p>\n<\/td>\n<\/tr>\n Country of<\/b>\u00a0<\/span>o<\/b><\/span>rigin<\/b><\/span><\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Argentina<\/p>\n<\/td>\n 10 (5.8%)<\/p>\n<\/td>\n<\/tr>\n Brazil<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n Chile<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n Colombia<\/p>\n<\/td>\n 8 (4.6%)<\/p>\n<\/td>\n<\/tr>\n Costa Rica<\/p>\n<\/td>\n 4 (2.3%)<\/p>\n<\/td>\n<\/tr>\n Cuba<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n Dominican Republic<\/p>\n<\/td>\n 2 (1.2%)<\/p>\n<\/td>\n<\/tr>\n Guatemala<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n Mexico<\/p>\n<\/td>\n 31 (17.9%)<\/p>\n<\/td>\n<\/tr>\n Panama<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n Paraguay<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n Peru<\/p>\n<\/td>\n 12 (6.9%)<\/p>\n<\/td>\n<\/tr>\n Spain<\/p>\n<\/td>\n 63 (36.4%)<\/p>\n<\/td>\n<\/tr>\n USA<\/p>\n<\/td>\n 18 (10.4%)<\/p>\n<\/td>\n<\/tr>\n Venezuela<\/p>\n<\/td>\n 4 (2.3%)<\/p>\n<\/td>\n<\/tr>\n Unknown<\/p>\n<\/td>\n 15 (8.7%)<\/p>\n<\/td>\n<\/tr>\n Typology<\/span><\/b><\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Commercial<\/p>\n<\/td>\n 13 (7.5%)<\/p>\n<\/td>\n<\/tr>\n Government\/ews agency<\/p>\n<\/td>\n 43 (24.9%)<\/p>\n<\/td>\n<\/tr>\n Health portal<\/p>\n<\/td>\n 14 (8.1%)<\/p>\n<\/td>\n<\/tr>\n Personal<\/p>\n<\/td>\n 63 (36.4%)<\/p>\n<\/td>\n<\/tr>\n Professional<\/p>\n<\/td>\n 40 (23.1%)<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n With regards to video typology, 63 videos (36.4%) were uploaded by patients or their family or friends (‘personal’), 43 videos (24.9%) by a government or news agency (‘government\/news agency’), 40 videos (23.1%) by medical professionals (‘professional’), 14 videos (8.1%) by a stand-alone health portal (‘health portal’), and 13 videos (7.5%) by commercial companies (‘commercial’) (Table 3<\/span>).<\/p>\n We next evaluated the distribution of video content based on their typology. Of the ‘professional’ videos, 50% focused on treatment modalities, while very few referenced breast reconstruction, survivorship and advocacy, or breast cancer in men. Videos that discussed signs and symptoms of breast cancer were mainly uploaded by ‘commercial’ typologies (54%), videos discussing screening and detection were uploaded primarily by ‘government\/news agency’ (44%), and videos discussing risk factors were uploaded mostly by standalone ‘health portals (21%) (Figure 1<\/span>).<\/p>\n Figure 1: <\/span>Content of videos organized by typology (%)<\/p>\n <\/p>\n<\/div>\n The details of video characteristics were stratified by the source of upload as shown in\u00a0Table 4<\/span>. ‘Personal’ videos had the longest duration on average (8\u00a0<\/span>minutes) while ‘health portal’ videos had the shortest average (2.8\u00a0<\/span>minutes). No significant differences were found in the median time since upload among the different typology types (p-value: 0.053).<\/p>\n Table 4: <\/span>Characteristics organized by typology*<\/p>\n \n<\/td>\n Commercial<\/b><\/p>\n<\/td>\n Government\/news agency<\/b><\/p>\n<\/td>\n Health portal<\/b><\/p>\n<\/td>\n Personal<\/b><\/p>\n<\/td>\n Professional<\/b><\/p>\n<\/td>\n p-value<\/p>\n<\/td>\n<\/tr>\n<\/thead>\n N (%)<\/p>\n<\/td>\n 13 (7.5)<\/p>\n<\/td>\n 43 (24.9)<\/p>\n<\/td>\n 14 (8.1)<\/p>\n<\/td>\n 63 (36.4)<\/p>\n<\/td>\n 40 (23.1)<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Video length<\/p>\n (mins)<\/p>\n<\/td>\n 3.17 \u00b1 1.0<\/p>\n<\/td>\n 7.21 \u00b1 10.8<\/p>\n<\/td>\n 2.83 \u00b1 4.2<\/p>\n<\/td>\n 8.00 \u00b1 12.1<\/p>\n<\/td>\n 4.93 \u00b1 8.1<\/p>\n<\/td>\n 0.003<\/p>\n<\/td>\n<\/tr>\n Time since upload (days)<\/p>\n<\/td>\n 1936.0 \u00b1 2087.0<\/p>\n<\/td>\n 1291.0 \u00b1 1110.0<\/p>\n<\/td>\n 2026.5 \u00b1 2399.0<\/p>\n<\/td>\n 986.0 \u00b1 1390.0<\/p>\n<\/td>\n 1299.5 \u00b1 2078.0<\/p>\n<\/td>\n 0.053<\/p>\n<\/td>\n<\/tr>\n Views<\/p>\n<\/td>\n 39947.0 \u00b1 173472.0<\/p>\n<\/td>\n 22808.0 \u00b1 111208.0<\/p>\n<\/td>\n 26943.0 \u00b1 86607.0<\/p>\n<\/td>\n 36489.0 \u00b1 165906.0<\/p>\n<\/td>\n 8975.5 \u00b1 25680.0<\/p>\n<\/td>\n 0.011<\/p>\n<\/td>\n<\/tr>\n Likes<\/p>\n<\/td>\n 272.0 \u00b1 536.0<\/p>\n<\/td>\n 100.5 \u00b1 339.0<\/p>\n<\/td>\n 56.5 \u00b1 187.0<\/p>\n<\/td>\n 383.5 \u00b1 1036.0<\/p>\n<\/td>\n 53.0 \u00b1 179.0<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n<\/tr>\n Dislikes<\/p>\n<\/td>\n 16.0 \u00b1 45.0<\/p>\n<\/td>\n 10.0 \u00b1 29.0<\/p>\n<\/td>\n 10.0 \u00b1 20.0<\/p>\n<\/td>\n 17.5 \u00b1 97.0<\/p>\n<\/td>\n 3.0 \u00b1 11.0<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n *Values based on Kruskal\u2013Wallis test and presented as median \u00b1 interquartile range.<\/em><\/p>\n<\/div>\n<\/div>\n<\/div>\n The overall median JAMA score of all videos was 2, with a range of 0 to 3 (IQR: 0.00), in which 82.7% scored between 2 and 4 possible points. Only 3.5% of videos achieved 3 points, and no videos reached the maximum score of 4 points. The overall median GQS score was 2.00, with a range of 1 to 4 (IQR: 1.00). Approximately 21% of videos scored 1 point, 37% scored 2 points, 38% scored 3 points, 4% achieved 4 points, and no videos obtained all 5 possible points. The overall median DISCERN score was 2 with a range of 0 to 5 points (IQR: 2.00). Approximately 8% scored 0 points, 15% scored 1 point, 39% scored 2 points, 14.5% scored 3 points, 2.9% scored 4 points and only one video (0.6%) scored all 5 points (Table 5<\/span>).<\/p>\n Table 5: <\/span>Summary characteristics for quality and reliability scores<\/p>\n \n<\/td>\n JAMA<\/b><\/p>\n<\/td>\n GQS<\/b><\/p>\n<\/td>\n DISCERN<\/b><\/p>\n<\/td>\n<\/tr>\n<\/thead>\n\n Median \u00b1 IQR<\/p>\n<\/td>\n 2.0 \u00b1 0.0<\/p>\n<\/td>\n 2.0 \u00b1 1.0<\/p>\n<\/td>\n 2.0 \u00b1 2.0<\/p>\n<\/td>\n<\/tr>\n Range<\/p>\n<\/td>\n 0\u20133<\/p>\n<\/td>\n 1\u20134<\/p>\n<\/td>\n 0\u20135<\/p>\n<\/td>\n<\/tr>\n Points<\/p>\n<\/td>\n Score N=173 (%<\/b>)<\/p>\n<\/td>\n \n<\/td>\n \n<\/td>\n<\/tr>\n 0<\/p>\n<\/td>\n 2 (1.2%)<\/p>\n<\/td>\n N\/A<\/p>\n<\/td>\n 49 (28.3%)<\/p>\n<\/td>\n<\/tr>\n 1<\/p>\n<\/td>\n 22 (12.7%)<\/p>\n<\/td>\n 36 (20.8%)<\/p>\n<\/td>\n 26 (15.0%)<\/p>\n<\/td>\n<\/tr>\n 2<\/p>\n<\/td>\n 143 (82.7%)<\/p>\n<\/td>\n 64 (37.0%)<\/p>\n<\/td>\n 67 (38.7%)<\/p>\n<\/td>\n<\/tr>\n 3<\/p>\n<\/td>\n 6 (3.5%)<\/p>\n<\/td>\n 66 (38.2%)<\/p>\n<\/td>\n 25 (14.5%)<\/p>\n<\/td>\n<\/tr>\n 4<\/p>\n<\/td>\n 0 (0.0%)<\/p>\n<\/td>\n 7 (4.0%)<\/p>\n<\/td>\n 5 (2.9%)<\/p>\n<\/td>\n<\/tr>\n 5<\/p>\n<\/td>\n N\/A<\/p>\n<\/td>\n 0 (0.0%)<\/p>\n<\/td>\n 1 (0.6%)<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n GQS<\/span>\u00a0=\u00a0Global Quality Score<\/span>;<\/span>JAMA<\/span>\u00a0=\u00a0Journal of the American Medical Association<\/span>.<\/span><\/em><\/p>\n<\/div>\n<\/div>\n<\/div>\n The correlation among the three reliability scores and the length of videos, likes, dislikes and views were calculated overall, and by typology (Figure 2<\/span>). Overall, the length of the videos had shown a significant positive correlation with the GQS (r<\/em>=0.28) and DISCERN (r<\/em>=0.23) scores. Similar positive correlations for GQS and DISCERN scores were observed for length of videos within all typology types except for commercial videos (r<\/em>=\u22120.56). Note that the JAMA score correlation was not calculated, as the scores were the same for all commercial videos.<\/p>\n Figure 2: <\/span><\/em><\/em><\/em>Correlation matrices by quality and reliability tools and video characteristics<\/span><\/p>\n <\/p>\n The correlation matrices among the variables of length of videos, likes, dislikes, views,\u00a0Global Quality Score (GQS) and Journal of the American Medical Association (JAMA) Benchmark Criteria, and the Modified DISCERN Questionnaire<\/span>\u00a0scores for: (a) full set of videos; (b) commercial; (c) government\/news agency; (d) health portal; (e) personal videos; and (f) = professional. Overall, length of the videos had shown a significant positive correlation with the GQS (r=0.28) and DISCERN (r=0.23) scores. Similar positive correlations for GQS and DISCERN scores were observed for length of videos within all typology types except for commercial videos (r=\u22120.56). Note that the JAMA score correlation was not calculated, as the scores were the same for all commercial videos.<\/em><\/p>\n<\/div>\n The mean rank and median scores by the source of upload (typology) were analysed and are shown in\u00a0Table 6<\/span>. Notably, for the JAMA score, the mean rank for ‘professional’ videos was highest among typologies at 99.5 (standard deviation [SD]: 24.3) compared with 73.6 (SD: 37.3) for ‘personal’ and 71.0 (SD: 50.3), for ‘health portal’ the lowest. Concerning the GQS score, the mean rank for ‘professional’ was at 102.9 (SD: 40.7), 98.5 (SD: 44.9) for ‘health portal’ (second highest), and 72.3 (SD: 50.8) for ‘personal’, the lowest. Concerning DISCERN score, ‘health portal’ had the highest mean rank at 110.1 (SD: 48.9) followed by 101.1 (SD: 46.5) for ‘professional’ while ‘personal’ was lowest at 68.9 (SD: 48.2).\u00a0Table 6<\/span>\u00a0depicts the significant mean rank differences for JAMA, GQS, and DISCERN scores as identified by pairwise comparisons. We observe that the mean ranks of three quality and reliability scores between Professional and Personal to be significantly different with p-values: JAMA:0.001; GQS:0.013; and DISCERN: 0.009, respectively. Additionally, we found that the mean rank for JAMA between ‘government\/news agency’ and ‘personal’ (p-value: 0.002) and the mean rank for DISCERN between ‘health portal’ and ‘personal’ (p-value: 0.002) was significantly different.<\/p>\n Table 6: <\/span>Summary characteristics for quality and reliability scores by typology*<\/p>\n \n<\/td>\n Commercial<\/b><\/p>\n<\/td>\n Government\/news agency<\/b><\/p>\n<\/td>\n Health portal<\/b><\/p>\n<\/td>\n Personal<\/b><\/p>\n<\/td>\n Professional<\/b><\/p>\n<\/td>\n Kruskall\u2013Wallis<\/b><\/p>\n p-value<\/b><\/p>\n<\/td>\n<\/tr>\n<\/thead>\n\n JAMA<\/b><\/p>\n (0\u20134 points<\/b>)<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median \u00b1 IQR<\/p>\n<\/td>\n 2.0 \u00b1 0.0<\/p>\n<\/td>\n 2.00 \u00b1 0.00<\/p>\n<\/td>\n 2.00 \u00b1 1.00<\/p>\n<\/td>\n 2.00 \u00b1 1.00<\/p>\n<\/td>\n 2.00 \u00b1 0.00<\/p>\n<\/td>\n –<\/p>\n<\/td>\n<\/tr>\n Mean rank \u00b1 SD<\/p>\n<\/td>\n 96.0 \u00b1 0.0<\/p>\n<\/td>\n 97.6 \u00b1 20.6<\/p>\n<\/td>\n 71.0 \u00b1 50.4<\/p>\n<\/td>\n 73.6 \u00b1 37.3<\/p>\n<\/td>\n 99.5 \u00b1 24.3<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n<\/tr>\n GQS<\/b><\/p>\n (1\u20135 points<\/b>)<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median \u00b1 IQR<\/p>\n<\/td>\n 2.0 \u00b1 1.0<\/p>\n<\/td>\n 2.0 \u00b1 1.0<\/p>\n<\/td>\n 3.0 \u00b1 1.0<\/p>\n<\/td>\n 2.0 \u00b1 2.0<\/p>\n<\/td>\n 3.0 \u00b1 1.0<\/p>\n<\/td>\n –<\/p>\n<\/td>\n<\/tr>\n Mean rank<\/p>\n<\/td>\n 89.6 \u00b1 38.5<\/p>\n<\/td>\n 89.3 \u00b1 45.6<\/p>\n<\/td>\n 98.5 \u00b1 44.9<\/p>\n<\/td>\n 72.3 \u00b1 50.8<\/p>\n<\/td>\n 102.9 \u00b1 40.7<\/p>\n<\/td>\n 0.020<\/p>\n<\/td>\n<\/tr>\n DISCERN<\/b><\/p>\n (0\u20135 points<\/b>)<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Median \u00b1 IQR<\/p>\n<\/td>\n 2.0 \u00b1 2.0<\/p>\n<\/td>\n 2.0 \u00b1 1.0<\/p>\n<\/td>\n 2.0 \u00b1 2.0<\/p>\n<\/td>\n 1.0 \u00b1 2.0<\/p>\n<\/td>\n 2.0 \u00b1 2.0<\/p>\n<\/td>\n –<\/p>\n<\/td>\n<\/tr>\n Mean rank<\/p>\n<\/td>\n 79.5 \u00b1 44.1<\/p>\n<\/td>\n 95.2 \u00b1 41.2<\/p>\n<\/td>\n 110.1 \u00b1 48.9<\/p>\n<\/td>\n 68.9 \u00b1 48.2<\/p>\n<\/td>\n 101.1 \u00b1 46.5<\/p>\n<\/td>\n 0.0002<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n *The assumption for one-way analysis of variance was not satisfied, hence the Kruskall\u2013Wallis (KW) test was used. The mean ranks were used in the KW test, as the distribution of the data within each typology was not similar within each quality and reliability score measurement.<\/em><\/p>\n<\/div>\n GQS<\/span>\u00a0=\u00a0Global Quality Score<\/span>;<\/span>IQR<\/span>\u00a0=\u00a0interquartile range<\/span>;<\/span>JAMA<\/span>\u00a0=\u00a0Journal of the American Medical Association<\/span>;<\/span>SD<\/span>\u00a0=\u00a0standard deviation<\/span>.<\/span><\/em><\/p>\n<\/div>\n<\/div>\n<\/div>\n As per GAM analyses, video length was the only variable that had shown a significant impact (p-value: 0.0002) on the DISCERN score, after adjusting for typology and the contents of the videos. None of the variables were associated with either the JAMA or GQS scores (Tables 7 and 8<\/span>).<\/p>\n Table 7: <\/span>Generalized additive models summaries for JAMA and DISCERN scores<\/p>\n GAM model for JAMA score<\/p>\n<\/td>\n<\/tr>\n<\/thead>\n ANOVA for parameter effects<\/b><\/p>\n<\/td>\n \n<\/td>\n DF<\/b><\/p>\n<\/td>\n Sum Sq<\/b><\/p>\n<\/td>\n Mean Sq<\/b><\/p>\n<\/td>\n F value<\/b><\/p>\n<\/td>\n Pr(>F<\/b>)<\/p>\n<\/td>\n Significance<\/b><\/p>\n<\/td>\n<\/tr>\n Likes<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 0.028<\/p>\n<\/td>\n 0.028<\/p>\n<\/td>\n 0.173<\/p>\n<\/td>\n 0.6780<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Dislikes<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n 0.9880<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Video length<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 0.342<\/p>\n<\/td>\n 0.342<\/p>\n<\/td>\n 2.147<\/p>\n<\/td>\n 0.1449<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Views<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 0.073<\/p>\n<\/td>\n 0.073<\/p>\n<\/td>\n 0.458<\/p>\n<\/td>\n 0.4996<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Typology<\/p>\n<\/td>\n \n<\/td>\n 4<\/p>\n<\/td>\n 5.019<\/p>\n<\/td>\n 1.255<\/p>\n<\/td>\n 7.887<\/p>\n<\/td>\n 0.0000<\/p>\n<\/td>\n ***<\/p>\n<\/td>\n<\/tr>\n Content type<\/p>\n<\/td>\n D1<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.712<\/p>\n<\/td>\n 0.712<\/p>\n<\/td>\n 4.475<\/p>\n<\/td>\n 0.0360<\/p>\n<\/td>\n *<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D2<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 1.267<\/p>\n<\/td>\n 1.267<\/p>\n<\/td>\n 7.965<\/p>\n<\/td>\n 0.0054<\/p>\n<\/td>\n **<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D3<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.088<\/p>\n<\/td>\n 0.088<\/p>\n<\/td>\n 0.555<\/p>\n<\/td>\n 0.4574<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D4<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.826<\/p>\n<\/td>\n 0.826<\/p>\n<\/td>\n 5.194<\/p>\n<\/td>\n 0.0241<\/p>\n<\/td>\n *<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D5<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n 0.000<\/p>\n<\/td>\n 0.9964<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D6<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.265<\/p>\n<\/td>\n 0.265<\/p>\n<\/td>\n 1.667<\/p>\n<\/td>\n 0.1986<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D7<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.133<\/p>\n<\/td>\n 0.133<\/p>\n<\/td>\n 0.836<\/p>\n<\/td>\n 0.3620<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D8<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.088<\/p>\n<\/td>\n 0.088<\/p>\n<\/td>\n 0.554<\/p>\n<\/td>\n 0.4579<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D9<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.755<\/p>\n<\/td>\n 0.755<\/p>\n<\/td>\n 4.744<\/p>\n<\/td>\n 0.0310<\/p>\n<\/td>\n *<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D10<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.025<\/p>\n<\/td>\n 0.025<\/p>\n<\/td>\n 0.155<\/p>\n<\/td>\n 0.6941<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D11<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.021<\/p>\n<\/td>\n 0.021<\/p>\n<\/td>\n 0.133<\/p>\n<\/td>\n 0.7160<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Residuals<\/p>\n<\/td>\n \n<\/td>\n 151<\/p>\n<\/td>\n 24.020<\/p>\n<\/td>\n 0.159<\/p>\n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n GAM for DISCERN score<\/p>\n<\/td>\n<\/tr>\n<\/thead>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n<\/tr>\n ANOVA for parameter effects<\/b><\/p>\n<\/td>\n \n<\/td>\n DF<\/b><\/p>\n<\/td>\n Sum Sq<\/b><\/p>\n<\/td>\n Mean Sq<\/b><\/p>\n<\/td>\n F value<\/b><\/p>\n<\/td>\n Pr(>F<\/b>)<\/p>\n<\/td>\n Signficance<\/b><\/p>\n<\/td>\n<\/tr>\n Likes<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 0.339<\/p>\n<\/td>\n 0.339<\/p>\n<\/td>\n 0.332<\/p>\n<\/td>\n 0.5651<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Dislikes<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 3.175<\/p>\n<\/td>\n 3.175<\/p>\n<\/td>\n 3.112<\/p>\n<\/td>\n 0.0798<\/p>\n<\/td>\n Video.length<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 14.520<\/p>\n<\/td>\n 14.520<\/p>\n<\/td>\n 14.233<\/p>\n<\/td>\n 0.0002<\/p>\n<\/td>\n ***<\/p>\n<\/td>\n<\/tr>\n Views<\/p>\n<\/td>\n \n<\/td>\n 1<\/p>\n<\/td>\n 1.388<\/p>\n<\/td>\n 1.388<\/p>\n<\/td>\n 1.361<\/p>\n<\/td>\n 0.2453<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Typology<\/p>\n<\/td>\n \n<\/td>\n 4<\/p>\n<\/td>\n 24.418<\/p>\n<\/td>\n 6.105<\/p>\n<\/td>\n 5.984<\/p>\n<\/td>\n 0.0002<\/p>\n<\/td>\n ***<\/p>\n<\/td>\n<\/tr>\n Content type<\/p>\n<\/td>\n D1<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 8.104<\/p>\n<\/td>\n 8.105<\/p>\n<\/td>\n 7.944<\/p>\n<\/td>\n 0.0055<\/p>\n<\/td>\n **<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D2<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 8.693<\/p>\n<\/td>\n 8.693<\/p>\n<\/td>\n 8.521<\/p>\n<\/td>\n 0.0040<\/p>\n<\/td>\n **<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D3<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 1.706<\/p>\n<\/td>\n 1.706<\/p>\n<\/td>\n 1.672<\/p>\n<\/td>\n 0.1979<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D4<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 8.194<\/p>\n<\/td>\n 8.194<\/p>\n<\/td>\n 8.032<\/p>\n<\/td>\n 0.0052<\/p>\n<\/td>\n **<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D5<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 2.682<\/p>\n<\/td>\n 2.682<\/p>\n<\/td>\n 2.629<\/p>\n<\/td>\n 0.1070<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D6<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.356<\/p>\n<\/td>\n 0.356<\/p>\n<\/td>\n 0.349<\/p>\n<\/td>\n 0.5555<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D7<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.086<\/p>\n<\/td>\n 0.086<\/p>\n<\/td>\n 0.084<\/p>\n<\/td>\n 0.7724<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D8<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.030<\/p>\n<\/td>\n 0.030<\/p>\n<\/td>\n 0.030<\/p>\n<\/td>\n 0.8638<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D9<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 4.795<\/p>\n<\/td>\n 4.795<\/p>\n<\/td>\n 4.700<\/p>\n<\/td>\n 0.0317<\/p>\n<\/td>\n *<\/p>\n<\/td>\n<\/tr>\n \n<\/td>\n D10<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.210<\/p>\n<\/td>\n 0.210<\/p>\n<\/td>\n 0.206<\/p>\n<\/td>\n 0.6507<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n \n<\/td>\n D11<\/p>\n<\/td>\n 1<\/p>\n<\/td>\n 0.006<\/p>\n<\/td>\n 0.006<\/p>\n<\/td>\n 0.006<\/p>\n<\/td>\n 0.9385<\/p>\n<\/td>\n \n<\/td>\n<\/tr>\n Residuals<\/p>\n<\/td>\n \n<\/td>\n 151<\/p>\n<\/td>\n 154.045<\/p>\n<\/td>\n 1.020<\/p>\n<\/td>\n \n<\/td>\n \n<\/td>\n \n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n Significance codes: *** <0.001; ** <0.01; *<0.05<\/em><\/p>\n<\/div>\n ANOVA<\/span>\u00a0=\u00a0analysis of variance<\/span>;<\/span>GAM<\/span>\u00a0=\u00a0generalized additive model<\/span>;<\/span>JAMA<\/span>\u00a0=\u00a0Journal of the American Medical Association<\/span>.<\/span><\/em><\/p>\n<\/div>\n<\/div>\n<\/div>\nObjectives<\/span><\/h1>\n
Methods<\/span><\/h1>\n
\n\n
\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n \n \n \n \n \n \n \n \n \n\n
\n \n\n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n \n \n \n \n \n \n \n \n \n \n Results<\/span><\/h1>\n
\n\n
\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n
\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n <\/td>\n<\/tr>\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n