the MedIEQ AQUA User Manual
Contents
1. Scientific or professional organizations Patient organizations self support groups Private individual Other 2841 J The user should know who is behind the resource in order to judge by himself the credibility of the provided information Therefore information like the name s of the organization s providing the Definition information and the type of this these organization s should be available At the same time the name s title s e g MD PhD Dr etc and contact details of website responsible s to contact in case 3 1 Purpose mission of the resource provided 3 2 Purpose mission of the owner s provided Attributes 3 3 Target intended audience s 3 4 Statement declaring limitation of the provided information It has to be clear for the user which is the goal and motivation of the provided information and for what kind of users it was created e g adults children people with diabetes etc Regarding 3 4 Examples Should be something like the health information S provided to support and not to replace the relationship that exists between visitors and their health professionals 4 Topics Keywords Attributes 4 1 Topics Keywords UMLS Definition Mapping of the resource s contents to concepts from the UMLS Metathesaurus Definition siblings C_oproporfiria Hereditaria Porfiria Intermitente Porfiria Veteada C0162532 category Disease or Syndrome Description A2. Add New Topic Add New SubTopic Concept Delete Figure 23 Review before saving the current Linguistic Resource Step 7 Before saving the Lexicon Resource you can manually add concepts and or sub hierarchies of concepts to the selected Lexicon Resource Step 8 Press the Update Lexicon button in order to save the Lexicon Resource fr _ 2 9 Semi automatic Label Creation 2 9 1 Create a Review Monitor Task Step 1 From the submenu My Web Resources click on Review Monitor You then see the web form of Figure 24 Step2 Select the Create a new review task option Step 2 Review Task Creation Editing se search options from a previous review task Step 4 C Proceed Figure 24 Creating a Review Monitor Task Step 3 Define a Task Name and OPTIONAL provide a description for this new Task Step 4 Click the Proceed button 2 9 2 Configuring a Review Monitor Task Step 1 After creating a new Review Monitor Task AQUA redirects you to another form see Figure 25 where you can setup the options of your review monitor task Step 2 Define the desired URL under review in the corresponding text field Step 3 Press the Add Update URL button The defined URL now appears in the area above the button Step 4 Check the box next to the URL indicating which web resources AQUA will Spider onm J Configure Spidering Options 1 List of Websites to review Select
3. www a z0 9 _ a z0 9_ amp a z0 9 1 gt lt In the second format L1 type user provides the crawler with a regular expression that will match the URLs he wants to extract This could help if the user knows that a specific web directory uses a standard pattern to include external URLs in his HTML zm _ _____________ code The lt group gt field indicates which group of regular expression the user wants to keep This group Is supposed to be the part of the regular expression that matches the URL The third and the forth formats S and S1 types are similar to the first and the second with the difference that they represent subtrees rather than leaf web pages This means that if an extracted URL is sub URL lower in hierarchy of the initial given URL then the crawler will follow this URL in order to go deeper and extract more URLs 34 41 R B2 Configuring Black amp White Lists In the tab Black amp white lists of the AQUA Crawler you can put either URLs that you want to be filtered out from Crawler s results black list or URLs that you would absolutely like to see between the results white list 3541 _ ____________ B3 Get better results by training the Classification Model By using the AQUA Crawler a user is able to make searches for health related Web Sites based on a user defined set of keywords These
4. x 2 6 Webmaster name s x 27 Webmasterisi contact details Froposed values Email x Tet x Figure 28 Semi automatic Creation of a Label Step 3 For a desired Label attribute you have the option to directly define it via the corresponding interface Alternatively for the attributes that AQUA has found relevant values from the corresponding review monitor task you can use these values by pressing the corresponding proposed values button and selecting the desired value for the attribute under review Each proposed by AQUA value is supported by relevant hyperlinks By pressing a link the corresponding web page opens as a separate window in your default browser 2541 J 3 1 Furpose mission of the resource 3 2 Purpose I mission ofthe CC i ox owner s 3 3 Target intended audience s mH 2 l patient child 3 4 Statement declaring limitation of i TER the provided information More than one links mean 4 Topics I Kevworde E RE that the corresponding value is supported by more than one web pages 4 1 Topics Keywords MLS Proposed values Add New Topic Add New SubTopic Concept Delete BrowsemesH 5 1 C service available x 5 2 VC responsible names x 5 3 YC responsiblets contact details Proposed Values rt Figure 29 Semi automatic Creation of a Label cont Cramil ff n J 6 Funding Advertising definition
5. Action 1 5 eHealth Health EU Figure 4 Defining a Web Resource in AQUA Step 2 Fill the fields of the form with relevant information Step 3 Click the Register Web Resource button a gt M ed i E oe Quality Labelling of Medical Web Content using X va Multilingual Information Extraction Logged in as v English United States vi Change Language About AQUA Q My Registered Web Resources The AQUA System Neas Ne Date URI Latest Revisionby Label Actions Resource Actions Contact us MyVWebResource 2008 02 08 _htty health Jn gr lias Zavitsanos docs amp oi MySecondResource 2008 02 08 http iww podiatry curtin edu aul My Web netdoctor 2008 08 25 nt Awww netdoctor co ukwhoisnd htm a aoier Aeh Resource testSotos pr ht ihaw otinanai com Ee Konstantinidis CETA e x Figure 5 Viewing the list of My Web Resources Step 4 Then AQUA redirects you to a page displaying the list of web resources added by you or any other member of your organization see Figure 5 8 41 2 4 Manual Label Creation Step 1 From the submenu My Web Resources on your left click on View Registered Resources You then see the web form of Figure 6 M ed Oo Quality Labelling of Medical Web Content using v Multilingual Information Extraction English United States Change Language My Registered Web Resources Resource Actions 2008 02
6. 1287 92 2 Eysenbach G Consumer health informatics BMJ 320 4 2000 1713 16 3 Diaz JA Griffith RA Ng JJ Reinert SE Friedmann PD Moulton AW Patients use of the Internet for medical Information J Gen Intern Med 17 3 2002 180 5 4 Soualmia LF Darmoni SJ Douy re M Thirion B Modelisation of Consumer Health Information in a Quality Controled gateway In Baud R et al ed The New Navigators from Professionals to Patients Proc of MIE2003 2003 701 706 5 Analysis of 9th HON Survey of Health and Medical Internet Users Winter 2004 2005 2005 Available Online at http www hon ch Survey Survey2005 res html 6 Kohler C Darmoni SD Mayer MA Roth Berghofer T Fiene M Eysenbach G MedCIRCLE The Collaboration for Internet Rating Certification Labeling and Evaluation of Health Information Technology and Health Care Special Issue Quality e Health Technol Health Care 10 6 2002 515 7 Curro V Buonuomo PS Onesimo R de RP Vituzzi A di Tanna GL D Atri A A quality evaluation methodology of health web pages for non professionals Med Inform Internet Med 29 2 2004 95 107 8 http www w3 org TR rdf schema 9 http www ws org 2004 12 q doc content labels schema htm 41 41 k
7. AQUA s welcome page see Figure 2 AQUA P p gt M I ed E Quality Labelling of Medical Web Content using W J Multilingual Information Extraction me E Logged in as v English United States w Change Language About AQUA TI The AQUA System Welcome to MedIEQ AQUA RA Contact us My Account very variable and difficult to assess we can find web sites published by government institutions consumer and scientific organisations R Edit My Account The number of health information web sites and online services is increasing day by day lt is known that the quality of these web sites is patients associations personal sites health provider institutions commercial sites etc On the other hand patients continue to find new ways of reaching health information and their physicians and more than four out of ten health information seekers say the material they find affect their decisions about their health itself Thus the choice of appropriate evaluation criteria as well as the development of tools to support the labelling process retrieval of unlabelled web sites monitoring of labelled web sites are both crucial and challenging My Web Resources W Register Web Resource View Registered Resources Organisations around the world are working on establishing standards of quality in the accreditation of health related web content However the establishment of codes of conduct or ethics is not enough i
8. ae ewcestsa ea eeeceeceea 41 2 41 List of Figures Figure 1 AQUA Login Page Larvenes EAEAN EANN 6 Figure 2 AQUA S Welcome Page rrrnrrnnnrnnnnnnnvrnnnrnnrnnnrnnnnnnennnnnennnnnnennnnnsnnnnsnennnnssen 6 Figure 3 Updating you account information rrnrrvnnrrnnnrvrnvrnrnvrnnnrernvrennrrnnnrernernnnrennn 7 Figure 4 Defining a Web Resource in AQUA rnnnrnnnnnnnnnnnrnennnnrnnnrnnnnnnrnnnnenennnnrnnnsnee 8 Figure 5 Viewing the list of My Web Resources rrrnnnnnnnnnnnnnnnnnrnvnennnnnnnnvnennnnennnveenne 8 Figure 6 Selecting a Web Resource in order to create a Label rrrnnnnnnnnnnvnnnrnnnnnn 9 Figure 7 Manual Creation Of a Label r ranrnnnnrnnnnnnnnnnnnnnnnnnnnrnnennnnnnnnrnvnnennnnnnnnennnnennn 9 Figure 8 Manual Creation of a Label cont rarrrnnnnnnnnnnnnennnnnnnnrnnnnennnnnnnnrnnnnennnnne 10 Figure 9 Manual Creation of a Label cont ranrrnnnnnnnnnnnnevnnnnnanrnnnnennnnnnnnrrnnnennnnnn 11 Figure 10 Selecting a Web Resource in order to modify update a Label 12 Figure 11 Selecting an RDF CL or POWDER Label to be Downloaded 13 Figure 12 Saving an ADF CL LADE sassseedsececutosnevsuedasueautesneeintienaulacasenticeeerieceeiees 13 Figure 13 Creating a new Search TaSK rrnrrnnnnnnnnnnnnrnnnnnnnnennnnnnnnnnennnnnnnnnnennnnennnnne 14 Figure 14 Configuring a Search TasSk rrrnnnrnnnnnnnnnnnnrnnnnnnnnenrnnrnnnnnenrnnrnnnnnennnnen
9. arrnnnrnnarennnrrvnnrnnnnennnnn 19 2 9 Semi automatic Label Creation rrrnrennnrrnanennnnoranernanennnnnvanennnnennnennanennn 21 2 9 1 Create a Review Monitor Task cccccccccseceseeeeeeeeceeeseeeseeeeseeeeaes 22 2 9 2 Configuring a Review Monitor Task c cccccsseeesseeeeeeeeeseeeeseeeeees 22 2 9 3 Scheduling a Review Monitor Task ccccccccseeeesseeesaeeeeseeeeseeeeees 23 2 9 4 Using the AQUA proposed values for creating a Label 0 24 Appendix A The MedlEQ Labelling Criteria rrnnnnonnnnnnnnnnnnnnnnnnnnnnnnnennnnnnennnnne 28 Appendix B The AQUA Crawler Configuration annxennnnnnnnnnnnnnnnnnnennnnnennnnnnennnnne 33 Bi Configuring Web Directories rarrrrnnnrnnnnrrrnnnrnnnnrnrnnnennnnenranrennnnennnsrennnne 33 B2 Configuring Black amp White ListS rrrrrrnnnrrrrnnnrnnnrerranrrnnnnenrnnrnrnnnenrnnnnnnnne 35 B3 Get better results by training the Classification Model c ccsceeeeees 36 Appendix C Sample Data for Testing AQUA ansernnnnvnnnnnunennnnunnnnnnnennnnnnnnnnnvennnnnr 38 C1 Search Task Samples cccccccccccsecccsseeeceeeeseeeeeseeeesseeeeseeeesseeeeseeeesseeeeas 38 C2 Review Monitor Samples ccccccccssececsecesseeeeseeeeseeeeeseesesseeeeseeesseeeeas 38 Appendix D Brief Technical Details of AQUA rnrnnnnnnnnnnnnnnnnnnennnnnnennnnnennnnnnennnnnr 39 Helenes oro sce sees eave race sce sets ce nee se
10. com http www curezone com http www ncemi org http healthlink mcw edu http www nim nih gov 3341 _ ____________ Appendix D Brief Technical Details of AQUA The main characteristics of AQUA implementation include a open architecture b accepted standards adopted in its design and deployment c character of large scale enterprise level web application and d internationalization support or AQUA Web Interfaces Level WCC P IET LAM MUA Application RO inion Afulilingul Irfornikar Liabei Monitor Utdale IESOUFOES Level Collection Extractior Atonement est Liert Management EEE EE EEE lt EE ll et ie EEE EE ae MM Corel dl Aetaraia o Toeri dl Metta i iponisiie EEN i Meroe Sforage L epel tny Sceeeeenecescecesostiecooseccesnesecect er Liik LUrirg Afutules LMLS ModEQ Database Dalabase Figure 33 Architecture of the AQUA system AQUA incorporates several subsystems see the application level in Figure 33 and functionalities for the labeling expert The Web Content Collection WCC component identifies classifies and collects online content relative to the criteria proposed by the labeling agencies participating in the project The Information Extraction Toolkit IET analyses the web content collected by WCC and extracts attributes for MedIEQ compatible content labels The Label Management LAM component
11. from ACQUA generated lists vi Step 4 0H load Avaritia Upload Oy the selected resources will be spidered Http My diabetes org d Remove selected Inverse selection 2 Langflaqges sa ep en Add Update URL EE speci the languages that are probable to be encountered in the selected resources To select more than one languages hold Ctrl button pressed while clicking to the languages menu inni 3 Schedule Task Runs Sepo EE A Step 7 ONCE ka C Figure 25 Configuring a Review Monitor Task Step 5 Select the language to which the defined Web Site URL provides content Step 6 Select the desired frequency the task should ran Step 6 Press the Proceed button 2 9 3 Scheduling a Review Monitor Task Step 1 After configuring the Review Monitor Task AQUA redirects you to the Review Monitoring Task Scheduling interface see Figure 26 From here you can a Ask AQUA to run the review monitor task immediately by checking the Run task now checkbox and b Ask AQUA to send you an alerting e mail once the task is completed by checking the Send me an e mail when task finishes checkbox Step 2 Click the Finish button 23341 J Step 1b MESELA CC ae cT LI Send me an e mail when task finishe Finish Figure 26 Scheduling a Review Monitor Task Why Review Monitor Tasks Reviewing a web resource may take some time this time being proporti
12. generates validates modifies and compares the content labels based on the schema proposed by MedlEQ The Multilingual Resources Management MRM subsystem gives access to health related multilingual resources input from such resources is needed in specific parts of the WCC IET and LAM toolkits Finally the Monitor Update Alert MUA tool handles auxiliary but important jobs like the configuration of monitoring tasks the MedIEQ database updates 3941 _ _______________ or the alerts to labeling experts when important differences occur during the monitoring of existing content labels Figure 33 shows all the possible data flows in AQUA dashed arrows a From WCC to IET pages collected by WCC once undergone a first level extraction by WCC extraction of metadata 1 are then forwarded to IET for further processing extraction of metadata 2 b From IET to MUA MUA takes all metadata collected by both WCC and IET and updates the MedlEQ database c From MRM to WCC IET LAM custom vocabularies generated by the MedlEQ users through MRM interface can be accessed from other toolkits WCC IET LAM where the user may need them 40 41 References 1 Mayer MA Leis A Sarrias R Ruiz P Web Medica Acreditada Guidelines realiability and quality of health information on Spanish Language websites In Engelbrecht R et al ed Connecting Medical Informatics and Bioinformatics Proc of MIE2005 2005
13. putting Web directory URLs There are four different possible syntax formats e L lt start URL gt lt strings to exclude gt e L1 lt start URL gt lt URL regular expression gt lt group gt lt strings to exclude gt e S lt start URL gt lt strings to exclude gt e S1 lt start URL gt lt URL regular expression gt lt group gt lt strings to exclude gt All fields are separated by a single space character e g e L http search centrum cz s 1303000 hubnuti search centrum e S http search centrum cz s 5629004 zdravotnicka zarizeni search centrum e S1 http katalog quick cz k aspx id 661 amp url http https www a Z0 9V _ a z0 9_ 8 amp a z0 9 1 amp katID 661 1 katalog quick In the first format L means that the start URL given represents a leaf page which means that the crawler should not search deeper in this page lt start URL gt is the URL provided by the user where the crawler will start searching from In lt strings to exclude gt field we specify strings that should not be contained in the final list of URL that will be returned For example if we search in dmoz directory we know that URL containing the string dmoz org should not be contained in the list as they are not really URLs to external pages that we need They actually are links to other pages in dmoz domain The crawler uses the following regular expression to extract URLs for HTML source href http https
14. title s 2 5 Responsible contact details Email Tel Address Postal Code City Country 2 6 Webmaster name s 2 7 Webmaster s contact details Email Tel 3 1 Purpose mission of the resource 3 2 Purpose mission of the owner s 3 3 Target intended audience s 3 4 Statement declaring limitation of the provided In the case that you have already defined a custom list of Keywords see paragraph 2 8 you can 4 1 Topics Keywords UMLS directly use that list by selecting the My Voc option 5 1 VC service available a x 5 2 YC responsible name s at 5 3 VC responsible s contact details Tel 18 5 4 Statement declaring limitation of the YC service xX 6 1 Statement declaring sources of funding w 6 2 Name s of funding sponsoring organization s x 6 3 Statement declaring limitation of influence of sponsors on content 6 4 Advertisment present x 6 5 Are advertisements clearly separated from sd sg editorial content 6 6 Policy with regard to advertisement Figure 8 Manual Creation of a Label cont Af ion J 7 Other Seal or Recommendation definition 7 1 Other seal s present x Proposed Values Proposed Values 7 2 Which other seal s x re icra iqua 8 Information Supporting Scientific Content definition Proposed Values 3 1 References bibliography x true false 6 2 Publication c
15. 08 http health in qr lias Zavitsanos MySecondResource 2008 02 08 http Aww podiatry curtin edu au netdoctor 2008 08 25 http Awww netdoctor co ukAwhoisnd btm testSotos 2008 07 02 http yy otinanai com Sotiris Konstantinidis testSotos2 2008 07 02 htt Awww namaste com Sotiris Konstantinidis deca amp PEN oe Wx Step 2 For the desired Web Resource press the Create Label link Then AQUA will redirect you to a web form for defining the Label attributes for the selected Web Resource see Figure 7 to Figure 9 Create new Label Resource Host Restrictions definition Sans evas yahoo corm Host Restrictions Add URI x 1 Resource Defining Information definition Step 3 Step 3 1 1 Resource URI http Jawa yahoo com 1 2 Resource title 1 3 Resource last update 1 4 Resource language s 35 Figure 7 Manual Creation of a Label Moposed Values Greek English Spanish Czech Finnish German Catalan Step 3 For a desired Label attribute you have the option to directly define it via the corresponding interface Alternatively for the attributes that use a pre defined vocabulary you can use the corresponding vocabulary values by pressing the corresponding proposed values button and selecting the desired value for the attribute under review 9 41 2 1 Organization names s owner 2 2 Organization types s owner 2 3 Responsible name s 2 4 Responsible
16. 6 1 Statement declaring sources of funding p 6 2 Names of funding sponsoring F organization s 6 3 Statement declaring limitation of o o x influence of sponsors on content 6 4 Advertisment present x Proposed Values 6 5 Are advertisements clearly E gt i F d Val separated from editorial content Bd malaken 6 6 Policy with regard to Proposed Values advertisement x T Other Seal or Recommendation definition 7 1 Other sealfst present x Proposed Values 7 2 Which other seal s x Proposed Values 8 Information Supporting Scientific Content definition o 1 References bibliography x Proposed Values 9 2 Publication creation date sd x Proposed Values 6 3 Last revision modification date x Proposed Values 5 4 Author names x Proposed Values 0 5 Author s contact details x Proposed Values 6 6 Editorial policy x Proposed Values 9 Confidentiality privacy policy definition 9 1 Explanation on how personal P I Val nn i x 10 Accessibility defi Step 4 10 1 Accessibility level amp Proposed Values C Create Label _ ______ Figure 30 Semi automatic Creation of a Label cont Step 4 Press the Create Label button in order for the label to be saved AQUA proposes automatically values for the following MedlEQ criteria 1 2 Resource title 2 5 Responsible Contact Details 1 3 Resource Last update 3 3 Target Intende
17. Merel 0 Quality Labelling of Medical Web Content using Multilingual Information Extraction The MedlEQ AQUA system User Manual August 2008 Table of Contents EST OF QUT CS casieccceassecsnescecsenstesenencsienssenssnssqenssienssesssnresenssieessecssnreeenssiacesecssncssenssensear 3 noden 4 2 AQUA User Manual dei 6 2M LOON 000 O ET EEA 6 2 2 Changing Login Account Information cccccccseeeeceeeeeeeeeeeeeeeeeeeeeseeeesaaees 7 2 3 Define a Web NENNE 8 2 4 Manual Label Creation raronanonanonanenanenanenanennnenanennnenanennnennnennnennnennnennnen 9 2 5 Modify Update an existing Label rrrrrnnnnnnanennnnnnnnrnnnnennnrnnanennnrennnennnnennn 12 2 6 Download a Label in RDF CL or POWDER Format rorrnnrnnnrnnnrnnnrnnnnnnn 13 2 7 Search for Unlabelled Web Resources rrrrrrrnrnrrnnnrevennnvrnenanernnnnverennnnnen 14 2 7 1 Greate a Search Tre 14 2 7 2 Define the Search Options rrranrrnnnnrnranrernnnenranrnnnnnennanrnnnnnennnssnnnn 14 2 7 3 Scheduling a Search Task ccccccccsecccssseeceeeeseeeeeeeesesseeeeseeeesseeeees 15 2 7 4 View Search ResultS rrrnnnnrnnnnrnnnnnnnnnnrnnannnnnnnennnnrnnnnnnnnnnrnnnnnnnnnnene 16 2 8 Create a Custom Search Vocabulary arrrranennnnnnnnrnnnnennnnnnnnennnnennnrnnnnennn 18 2 8 1 Create a Linguistic Resource rrrrnnnrnnanennnrnnnnrnnnnennnrnnnnennnnennnennnsennn 18 2 8 2 Adding Concepts in a Linguistic Resource
18. NN p 4 Ell at We p CRE rear Cnt imini 2 igure 10 Selecting a Web Resource in order to modify update a Label Step 2 For the desired Web Resource press the Edit Label link Then AQUA will redirect you to a web form for updating the Label attributes for the selected Web Resource see paragraph 2 4 f om _ 2 6 Download a Label in RDF CL or POWDER Format Step 1 From the submenu My web resources on your left click on View Registered Resources You then see the web form of Figure 11 presenting the list of web resources defined in AQUA for your organization AQUA A M ed i i Oo Quality Labelling of Medical Web Content using 4 Multilingual Information Extraction GE Logged in as v English United States Change Language About AQUA My Registered Web Resources POWDER Resource Hame Date URI Latest Revision by Label Actions a S tep 1 2008 02 08 http health in gr lias Zavitsanos dad Fa T TE 7 2008 02 08 http dwy podiatry curtin edu au netdoctor 2008 08 25 http Awww netdoctor co ukiwhoisnd him A Step 2 testSotos 2008 07 02 http www otinanai com Sotiris Konstantinidis EAS testSotos2 2008 07 02 http iww w namaste com Sotiris Konstantinidis kS E IAF C actaaT a m Anne NAT NT bha nai vafl mnm Cetivin anctartinicia ke a ab We igure 11 Selecting an RDF CL or POWDER Label to be Downloaded Step 2 For the desired resource press the down
19. Q tools monitor already labelled medical sites alerting labelling experts in case the sites content is updated against the quality criteria thus facilitating the work of medical quality labelling agencies Linguistic Resources Browser Documentation MediEG Vocabulary amp Es 2 y e User Manual XHTML The MedlEQ project has received funding from the EC DG SANCO Programme Public Health WSC 1 0 WSC Priority area 1 Health information Action 1 5 eHealth Health EU z J Figure 2 AQUA s Welcome Page 6 41 2 2 Changing Login Account Information Step 1 At any time you can modify your account information by following the link Edit my account from the My account submenu Step 2 In your account information form update whatever you want Step 3 Press the Save Preferences button M ed i Quality Labelling of Medical Web Content using re Multilingual Information Extraction Logged in as v English United States Change Language The AGUA System D Contact us My Web Resources First name John ta Register Web Resource Last name Giotis Organization fame other Mi View Registered Resources a i E mail jgiotis iit demokritos gr im hov Search Web Resources Username Yy Ed Review Monitor Password My Lexicons Confirm Password My Custom Lexicons DG Linguistic Resources Browser Save Preferences Documentation MediEQ Yocabulary
20. T Confirmed by the user FRI Recent pages retrieved in last search Figure 17 Viewing the Results of a Search Task tt _ 2 8 Create a Custom Search Vocabulary 2 8 1 Create a Linguistic Resource Step 1 Go to My Lexicons on your left and click on My Custom Lexicons You then see the form of Figure 18 a a Step 2 My Custom Lexicony Greate New Lexicon My Web Resources Figure 18 Create a Custom Search Vocabulary Step 2 Click the Create New Lexicon link Then AQUA presents the form of Figure 19 where you can define a new Linguistic Resource set of keywo rds Lreate New Lexicon Description Content Add New Topic Add New SubTopic Concept Delete nl Step 5 Step 4 Figure 19 Defining a new Linguistic Resource Step 3 Define a Name and OPTIONAL provide a description for this new Lexicon Step 4 Add manually concepts and or sub hierarchies of concepts to the selected Lexicon gu J Step 5 Click the Create New Lexicon button Then AQUA will redirect you to a new web form presenting the list of resources that you have created Figure 20 2 8 2 Adding Concepts in a Linguistic Resource My Web Resources My Custom Lexicons Delete Lexicon LexiconTest P x Lexicon Hame Description Edit Lexicon Create New Lexicon Figure 20 Viewing the List of Linguistic Resources Step 1 Go to My Lexicon on your
21. ants or the information provided to us voluntarily by our visitors in their Examples communications with us is securely stored and not shared with any third party or clearly explain With whom the information may be shared or to state the kind of security procedures that are in place to protect the loss misuse or alteration of information or What choices are available to users regarding collection use and distribution of the information or use personally identifiable information for internal purposes or explain how they are using cookies or if they back up the information collected or maintain a very strict privacy policy etc Descriptor 10 Accessibility Attributes 10 1 Accessibility level The resource is examined upon various accessibility criteria and Definition information on its accessibility level whether the resource is of level A AA or AAA is deduced 3241 _ ____________ Appendix B The AQUA Crawler Configuration B1 Configuring Web Directories In the tab Web directories of the AQUA Crawler you put the Web directory URLs of your choice The Crawler will parse their listings and collect all contained URLs For example if you want to search for diabetes organizations you put http dmoz org Health Conditions and Diseases Endocrine Disorders Pancreas Di abetes Organizations in the relevant area Note however that there is a specific syntax to follow when
22. art infarction hearth attack coronary syndrome Note that by putting these keywords in different lines we indicate the system to send separate queries to the search engines each line corresponds to another query 14 41 k Search Task Options Search Engines Web directories Black and white lists Step 2 Yes I want to use search engines Queries F Use set of Keywords Add your queries into this textarea Backing Constitutes a different query reag USE symbols commonly used in search engines to build your query e g AND OR and quotes My search engines preferences Google Yahoo HON Intute Search Engine Number of results per query and per search engine TH Language EM Part of the page Everywhere vi Last updated Antime Allowed file format All formats b Search only in domain eg org Dont search in domain lea Com Av T Figure 14 Configuring a Search Task Step 3 Then define the settings for the Search Engines to be used such as the desired engines the number of results per query etc Step 4 Press the Proceed button TIP For refined searches using Web Directories and or Black amp White Lists please refer to Appendixes B1 and B2 respectively 2 7 3 Scheduling a Search Task Step 1 After defining the Search Options AQUA redirects you to the Search Task Scheduling interface see Figure 15 From here you can a Ask AQUA to run
23. ber of your organization has created Now in this list a new web resource has been added with the same name as the corresponding review monitor task See Figure 27 24 41 Step 3 For this Web Resource press the Create Label link Then AQUA will redirect you to a web form for defining the Label attributes of the selected Web Resource see Figure 28 to Figure 30 Create new Label e wii diabetes com x 1 Resource Defining Information definition 1 1 Resource URI http ie diabetes com Resource Host Restrictions definition Host Restrictions Proposed values Treatment OF Diabetes and diabetes type 2 medicati Blood Sugar Level maintenance and diabetes on the Diabetes Medication canbe used to treat your diab lin Blood Sugar Control can reduce pour risk of seriou lin 1 2 Resource title a ATEC test information for controlling blood sugar Diabetes Treatment tips for better blood sugar con Diabetic Diet facts for eating out at diabetes com diabetes Site Help Type 2 Diabetes information and special features a 1 3 Resource last update 1 4 Resource language s 2 Ownership Creatorship definition 2 1 Organization namests owner 2 2 Organization type sis owner Select 2 3 Responsible names x 2 4 Responsible title sj x 2 5 Responsible contact details Email OoOo x Proposed values Tel x Address x Postal Code x City x Country
24. cts of the daily work of labeling experts by making them computer assisted More specifically AQUA supports labeling experts in e Creating machine readable labels by adopting the use of the RDF model 8 for producing machine readable content labels at the current stage the RDF CL model 9 is used e Automating the accreditation process by helping in the identification of unlabeled resources extracting from these resources information relative to specific accreditation criteria generating content labels from the extracted information and facilitating the monitoring of already labeled resources This document provides a step by step how to manual for the basic functionalities supported by the first version of the AQUA system 5 41 2 AQUA User Manual 2 1 Login to AQUA Step 1 From a browser go to http www medieq org aqua welcome seam This web link directs you to the AQUA login page see Figure 1 M ed i Quality Labelling of Medical Web Content using Nd v Multilingual Information Step 2 EN G The MedlEG project has received funding from the EC DG SANCO Programme Public Health Priority area 1 Health information Action 1 5 eHealth Health EU Figure 1 AQUA Login Page Step2 Fill your username and password Step 3 Press the Login button Provided that you have used a correct username and password you will be directed to
25. d Audience s 1 4 Resource Language s 4 1 Topics Keywords UMLS 2 1 Organization Name s Owner 5 1 VC Service Available 2 3 Responsible Name s 6 4 Advertisement present 2 4 Responsible Title s 7 2 Which other seal s 2741 J Appendix A The MedlEQ Labelling Criteria at DSOUrCe Le rormation 1 Resource defining information 1 1 Resource URI 1 2R rce title Attributes ren 1 3 Resource last update 1 4 Resource language s Includes information identifying describing the resource Concerning the resource URI a whether the resource s URI is valid or not and b Definition in case it redirects to external domains are these domains between those specified when the resource was added The rest is information like the resource s last update its title and the language s in which content is provided Descriptor 2 Ownership Creatorship 2 1 Organization name s owner 2 2 Organization type s owner 2 3 Responsible name s Attributes 2 4 Responsible title s 2 5 Responsible s contact details 2 6 Webmaster name s 2 Webmaster s contact details of questions on health related issues as well as the name s and contact details of the webmaster s should be available Organization type s may be one or more of the following Government Organization Healthcare service provider Media and publishers Pharmaceutical company retailer Examples a be eee ae Universities research institutions
26. doption by Internet users 5 different organizations around the world are working on establishing standards of quality in the accreditation of health related web content 6 7 By analyzing the main approaches of medical quality labeling we have identified the following key tasks followed entirely or partially by most labeling agencies Identification of new web resources this could happen either by active web searching or by voluntary application from the information provider i e the web site responsible asks actively for a review usually in order to get an accreditation seal Labeling of the web resources this could be done with the purpose of awarding an accreditation seal or in order to classify and index the web resources in a filtering portal Re reviewing or monitoring the labeled web resources this step is necessary to identify changes or updates in the resources as well as broken links and to verify if a resource still deserves to be awarded an accreditation seal As a result the AQUA system was designed to support the main tasks of the web content accreditation process that is e Identification of unlabeled resources having health related content e Visit and review of the identified resources e Generation of content labels for the reviewed resources e Monitoring the labeled resources 4 41 R _ AQUA aims to provide the infrastructure and the means to organize and support various aspe
27. e sponsorship will not be accepted in situations where ples the fact of the sponsorship would raise an inference of influence on editorial content or decision making or of xx endorsement of the sponsor or its products and services Regarding 6 6 Something like guidelines have been established by our site to govern various aspects of Advertising including banner button and contextual Advertising Sponsorship Messages and Promotions om _ ____________ 7 Other seal or Recommendation Attributes Attributes 7 1 Other seal s present 7 2 Which other seal s Are there other seals identified in the resource Indicates that the resource already conforms to other known quality criteria Identifiers for other seals a Real seals WMA HONcode pWMC URAC eHealth TRUST E AFGIS b Filtering health portals a resource is recommended by AQUMED Intute WHO Vaccine Safety Net 8 Information Supporting Scientific Content 8 1 References bibliography with links to literature 8 2 Publication creation date 8 3 Last revision modification date 8 4 Author name s 8 5 Author s contact details 8 6 Editorial policy Regarding the provided specialized health information scientific parts of the resource it is relevant to know if it is based on scientific books medical journal articles etc For this scientific articles or documents should include a references or bibliography section Add
28. e User Manual XHTML WIC css 4 css The MedlE project has received funding from the EC DG SANCO Programme Public Health p WS Priority area 1 Health information Action 1 5 eHealth Health EU Figure 3 Updating you account information 7 41 2 3 Define a Web Resource Step 1 From the submenu My Web Resources on your left click on Register Web Resource You then see the web form of Figure 4 AQUA Ly T M ed Quality Labelling of Medical Web Content using W Multilingual Information Extraction Logged in as v English United States i Change Language Language About AQUA Q Step 2 The AQUA System Ste 1 Register Zen Resource Contact us Resource Name Resource URI e g http Ann website com Category of the Website hosting the resource Resource Type D W Search Web Resources Ed Review Monitor Adding redirecting domains The above domain is considered as the principal domain by the AQUA system If you want to add another domain that redirects to the one above please put it in the following field e g http Awww website com and press Add domain Redirect Add Domain Step 3 MediE Vocabulary Register Web Resource e User Manual XHTML css The MedlEG project has received funding from the EC DG SANCO Programme Public Health gt 10 WSC Priority area 1 Health information
29. ee Figure 16 Step 3 Select the Manage existing tasks option Step 4 By pressing the Results link next to the desired Search Task name you see the results as in Figure 17 1641 _ ___________ Manage Search Tasks Contact us Step 2 My Account Create a New Search Task 182 Manage Existing Search Tasks kKccount My Web tesources a Register WAb Resource View Registered Resources 2 A tot Search Wieb Resources Task Name Scheduling Task Actions Never bacr NO Never testtask NO Never yyy NO Never test o 7 x Never Search Procedure NO Review Monitor My Lexicons O My Custom Lexicons DG Linguistic Resources Browser 2008 08 25 test2 Figure 16 Viewing the list of Search Tasks INSPECT EDIT SEARCH RESULTS Pp 1 Z hitg Ven wikipedia org Avikiidiabetes http Ven wikipedia org syvikiidiabetes mellitus ol http www diabetes orguk http Shwe diabetes org e http ivv diabetes org sbout diabetes jap j EE S A fefe 3 Tollolloliclollc ollollollollo ellejlejelele VININISNIAN O O eo pttp ie hindu comsthehinduholnus 009200808242 O ol OJ bitte Shwe youtube combesuts7num S hl en amp as epy view Classification Summary Train new model taking Into account the above classification Download the lists of positive and negative examples to your PC FO
30. ic Creation of a Label CONT arrrrnnnrnnnnnnnnnnernnnrnnnnnnnnnnen 26 Figure 30 Semi automatic Creation of a Label CONT arrrrnnnrnnnnrnnnnnrnnnnrnnnnnnnnnnen 27 Figure 31 Viewing the Search Result S rrrrrnrrnrnnnnnnnnerrnnrnrnnnennnnrnnnnnennanennnnnennnnene 36 Figure 32 Saving classified URLs in my local disk rnnrvnnnnvnnnnvrnnnrnnnnrvrnnnrnnnrrennnnen 37 Figure 33 Architecture of the AQUA system rrrrurrrrnnnnrnrnnnrerrnnnrnrnnnrenrnnnrenrnnnennnnnee 39 3 41 1 Introduction The number of health information web sites and online services is increasing day by day It is known that the quality of these websites is very variable and difficult to assess we can find web sites published by government institutions consumer and scientific organizations patients associations personal sites health provider institutions commercial sites etc 1 On the other hand patients continue to find new ways of reaching health information and more than four out of ten health information seekers say the material they find affects their decisions about their health 2 3 However it is difficult for health information consumers such as the patients and the general public to assess by themselves the quality of the information because they are not always familiar with the medical domains and vocabularies 4 Although there are divergent opinions about the need for accreditation of health web sites and a
31. itionally it is important to know if such information is up to date publication and last modification dates are required and who is the author of such content author s name s and contact details are required for pages documents providing scientific information Regarding 8 6 This must be something like Information provided by this resource or hosted in this site is selected upon the following procedure which includes health professionals specialists etc or is controlled reviewed by medical doctors or is given only by medically trained and qualified professionals unless a clear statement is made that a piece of advice offered is from a non medically qualified individual or organisation 9 Confidentiality privacy policy Attributes 9 1 Explanation on how personal data visitor coordinates e mail messages etc is handled Internet users are much concerned about protection of their privacy and personal data For this reason the resource should provide a confidentiality privacy policy ensuring that personal data visitor these data are handled Regarding 9 1 To declare e g that any personal data used by xx including any information collected through this website will be treated as strictly confidential or the use of this data is strictly for statistical purposes etc or organization xx pledges always to respect the privacy and anonymity of its users including survey particip
32. left and click on Linguistic Resources Browser You then see the form of Figure 21 Linguistic Resources Browser Results per page 10 Language CZE v Vocabulary MSHCZE v Lexicon to work wit CC Search JD arch Figure 21 The S Resources B ED Step2 Configure the Terms Search properties of the Linguistic Resources Browser by defining a term to be found the desired search results per page the language of the desired terms as well as the vocabulary to be used for searching terms Step 3 Select the desired Resource to work with Step 4 Press the Search button The term search results are presented in the lower part of the Linguistic Resources Browser as shown in Figure 22 om J Linguistic Resources Browser View Results 1 AUI CUI Concept vo Stepd or 1 Show concept 412081355 C0342257 DIABETES COMPL M G Show concept 0032961 C0018995 Bronze Diabetes MSH ENG Show concept 47755899 C0002152 Alloxan Diabetes MSH ENG 412072618 C0032969 PREGN IN DIABETES MSH ENG A0047877 C0011849 Diabetes Melltus MSH ENG Show concept 410900803 C0282201 Phosphate Diabetes MSH ENG Show concept 412073275 C0085207 DIABETES PREGN IND MSH ENG Show concept 40047874 C0011848 Diabetes Insipidus MSH ENG Show concept 22783303 C0205734 Autoimmune Diabetes MSH ENG Show concept 40289739 C0038433 Streptozocin Diabetes MSH ENG Show concept Concept information Name Cui Vocabulary Language oie sos definition Condi
33. load link Then AQUA will prompt you a dialog for defining a local path for the RDF CL label to be saved see Figure 12 The same procedure is being followed to download a Label in POWDER format Opening 7300_3050 rdf You have chosen to open 7300 3050 rdf which is Resource Description Framework from http www medieq org What should Firefox do with this file open wit Figure 12 Saving an RDF CL Label 31 _ 2 7 Search for Unlabelled Web Resources 2 7 1 Create a Search Task Step 1 From the submenu My Web Resources on your left click on Search Web Resources You then see the web form presented in Figure 13 from where you can create a new search task Manage Search Tasks Create a New Search Task Manage Existing Search Tasks Step 2 Figure 13 Creating a new Search Task Step 2 Give a task name and a description e g Task name My First Task Step 3 Click the Proceed button 2 7 2 Define the Search Options Step 1 After creating a new Search Task AQUA redirects you to another form see Figure 14 where you can setup the options of your search task Step 2 Here you see 3 tabs Search engines Web directories and Black amp white lists In the Search engines tab at the area Queries add some keywords about a topic of your interest You can put for example the keywords shown in Figure 14 myocardial infarction he
34. n autosomal dominant porphyria that is due to a deficiency of protoporphyrinogen oxidase EC 1 3 3 4 in the LIVER the seventh enzyme in the 8 enzyme biosynthetic pathway of HEME Clinical features include both neurological symptoms and cutaneous Examples lesions Patients excrete increased levels of porphyrin precursors COPROPORPHYRINS and protoporphyrinogen has parent Porfirias Hepaticas _ Can be qualified by blood _ cerebrospinal fluid chemically induced_ Aguda_ 5 Virtual consultation 5 1 VC service available 5 2 VC responsible name s 5 3 VC responsible s contact details 5 4 Statement declaring limitation of the VC service Attributes Is there an online virtual consultation VC service available A VC service is an online service allowing the user to ask questions and or om J Definition means that cannot replace a personal consultation with a physician should be provided Regarding 5 4 Should be something like the VC service can not replace a personal Examples consultation with a physician or internet based advice whether personalised or not cannot replace a face to face consultation with a healthcare practitioner send upload information on health related issues asking for advice A VC service may have one of the following forms a discussion forum b chat c VC e mail d VC request form The name s and details of the person s responsible s for this service sh
35. n the medical domain where the quality of information delivered from medical web sites may affect the health of the citizens Selfadherence to such codes is nothing more than a claim or pledge with little enforceability It is necessary to establish rating mechanisms either by third party accreditation or by creating portals where medical web sites are organised and characterised against certain labelling criteria Search Web Resources In order for these mechanisms to be successful they must be equipped with technologies that enable the automation of the rating process such as information extraction techniques that allow the continuous monitoring of labelled web sites alerting the labelling agency in case some changes occur against the labelling criteria or web crawling and spidering techniques that allow the retrieval of new unlabelled web sites their characterisation and addition in a medical thematic portal Review Monitor My Lexicons Based upon state of the art technology in the areas of web crawling and spidering multilingual information extraction semantic resources and quality labelling MedIEQ paves the way towards the automation of quality labelling process in medical web sites MedlEQ delivers tools that crawl the Web to locate medical web sites in seven different European languages Spanish Catalan German English Greek Czech and Finnish in order to verify their content using a set of machine readable quality criteria MedlE
36. nnnee 15 Figure 15 Scheduling a Search TASK rrannnnnnnnnrnnnnnnnnrvrnnnnnnnnrnrnnnnnnnnenranennnnnennnnennnnee 16 Figure 16 Viewing the list of Search TaSksS rrannnnnnnnnnnnnnnnnnenrnnnnnnnnrnrnnnnnnnnennnnnnnnnne 17 Figure 17 Viewing the Results of a Search TaSK rnnnnnnnnnnnnnnnnnvnnnnrnnnnnennnnennnenennner 17 Figure 18 Create a Custom Search Vocabulary rrrrnnnrnnnnvnvnrnnnvernnvnvnrnnerenrnnnrennnvn 18 Figure 19 Defining a new Linguistic Resource rrnrrnnrnnnnnnnnnnnnvnnnnnnnnnnvnennnnennnvnennnee 18 Figure 20 Viewing the List of Linguistic Resources rrrnrnnnrnnnrnnnnnnnrnnnnnnnrnnnrnnnnnnnnnnn 19 Figure 21 The Linguistic Resources Browser rrrnrrnnnrnnnnnnnnnnnnnnnrnnnrnnnrnnrnnnrnnnnnnnnnnn 19 Figure 22 Retrieving Search Terms results from the Linguistic Resources Browser20 Figure 23 Review before saving the current Linguistic Resource rrrnnrnnnvrnnnnennnnn 21 Figure 24 Creating a Review Monitor Task rrrnnnnnnnnnnnnnnnnrnnnnnnnnrnnnnennnnnnnnrnnnnennnnnn 22 Figure 25 Configuring a Review Monitor Task rrrnnnrnnnnnnnnnnnnnnnnnnnnnennnnnnnnnnennnnen 23 Figure 26 Scheduling a Review Monitor TASK arrrnnnnnnnnnnnnnnnenrnnnnnnnnennnnennnnnennnnen 24 Figure 27 Selecting a Web Resource in order to create a Label rrrrnnnrnnnnnvnnnnnr 24 Figure 28 Semi automatic Creation Of a Label rrrnnrrnnnnnnrnnnrnnnnnnnnnnennnnrnnnnnennnnen 25 Figure 29 Semi automat
37. onal to the number of web pages documents a resource may offer Also a user may desire to initialize several review monitor tasks running simultaneously and in parallel In this context reviewing web resources is performed in review monitor tasks 2 9 4 Using the AQUA proposed values for creating a Label Step 1 OPTIONAL In the case that you have enabled the email notification option of the Review Monitor Task Scheduler after executing a Review Monitor Task you should check your mailbox once your search task is completed AQUA sends an alert message with subject Review Monitor task completed About AQUA My Registered Web Resources Resource Name Date URI Latest Revision by Label Actions pre 2008 02 08 http health ingr lias Zavitsanos ce 2008 02 08 http iww podiatry curtin edu aul netdoctor 2008 08 25 http www netdoctor co ukAvhoisnd Atm testSotos 2008 07 02 http Aww otinanai com Sotiris Konstantinidis testSotos2 2008 07 02 http iww namaste com Sotiris Konstantinidis sotosTest 2008 07 07 http Awww rafl com Sotiris Konstantinidis testChanges 2008 07 07 http www testsotos com Soti gianadoume 2008 07 07 http Awww gnd2 com Soti Diabetes 2008 08 25 http Awww diabetes com Figure 27 Selecting a Web Resource in order to create a Label Step 2 Go to the submenu My Web Resources gt View Registered Resources You then see the list of all the web resources that you or any other mem
38. or Neg a good part of the first results e g at least 20 URLs returned by this search task the user can train a new m _ ___________ classification module by clicking on the button Train model This model will then be used for the automatic classification of the results returned in next search iterations of this same task note that search tasks can run as many times as required At the end of a search iteration and if a trained classification model is available the new results automatically get a classification score pos neg or uncl decided by the model The user can continue by manually verifying the automatically classified URLs as well as by checking the unclassified ones and then re train the classification model by pressing again the Train model button Thus the model becomes better and better after every new search iteration and every subsequent re training In that way searching is expected to become more and more focused Finally the user at any point can download the list of URLs being classified by pressing the Download button To do so the user has to specify See Figure 32 the path in his her local disk where the URL lists will be saved Opening My First Task zip You have chosen to open My First Task zip which is Compressed zipped Folder from http www medieq org What should Firefox do with this file Open with CompressedFolder default ha C Do this automatically fo
39. ould also be clearly mentioned Moreover a declaration that VC is only a supporting 6 Funding Advertising 6 Funding Advertising 6 1 Statement declaring sources of funding Sponsors grants advertisers etc 6 2 Name s of funding Sponsoring organization s Attributes 6 3 Statement declaring limitation of influence of soonsors on content 6 4 Advertising present 6 5 Are advertisements clearly separated from editorial content 6 6 Policy with regard to advertisement Health web resources should disclose possible conflicts of interest For this reason it is important to know how and by whom a web resource is funded If there are any sponsors it has to be clear who they are Furthermore it should be stated that sponsors do not have Definition any influence on the content Additionally it has to be known whether the web resource hosts or not advertising material in whatever format In case that happens such material should be clearly distinguished from informative material Furthermore information on resource s policy with regard to advertising must be easily accessible and clear Regarding 6 1 This must be something like site sponsors are XX yy ZZ or About our site sponsor or this site is kindly sponsored by or we are a non profit organization supported by individuals foundations and corporations or this web site is soonsored by donations etc Regarding 6 3 Exampl Something lik
40. r files like this from now on Figure 32 Saving classified URLs in my local disk 3741 J Appendix C Sample Data for Testing AQUA C1 Search Task Samples The following table presents a set of keywords to be used for Search Tasks Ischaemic Ischemic Heart Disease Myocardial infarction OR heart infarction OR hearth attack Acute Coronary syndrome OR coronary artery disease Keywords Chest pain Coronary bypass Breast cancer OR cancer of breast Breast tumor Keywords Treatment AND breast cancer Mastectomy AND breast cancer Mastectomy C2 Review Monitor Samples The following table presents a set of URLs to be used for Review Monitor Tasks http www bacr org uk http www wrongdiagnosis com http www jcmh com http www drgreene org http www alexandermd com http pathweb uchc edu http www skinovations org http www aacap org http mcdhospital org http www aafp org http www spine health com http www helpquide org http www medicinenet com http www rcpsych ac uk http www ncemi org http www xps org http www podiatry curtin edu au http www cdc gov http www patient co uk http www eatright org http www vasculitisfoundation org http gamma wustl edu http www clevelandclinic org http www niams nih gov http www uhrad com http www quideline gov http www britishlivertrust org uk http www who int http www allayurveda com http www urologychannel
41. reation date x Proposed Values 8 3 Last revision modification date x Proposed Values 3 4 Author name s x Proposed Values 6 5 Author s contact details x Proposed Values 3 6 Editorial policy x Proposed Values 9 Confidentiality privacy policy definition 9 1 Explanation on how personal data is handled x 10 Accessibility definition Proposed Values i we Sn A 10 1 Accessibility level Accessibility leve Step 4 e AA AAA Create Label Figure 9 Manual Creation of a Label cont Step 4 Press the Create Label button in order for the label to be saved f om _ 2 5 Modify Update an existing Label Step 1 From the submenu My Web Resources on your left click on View Registered Resources You then see the web form of Figure 10 M ed i i Oo Quality Labelling of Medical Web Content using A Multilingual Information Extraction English United States Change Language My Registered Web Resources R n Date URI Resource re 2 Tt Reyi on Di Actions e 2008 02 08 http iheatth in or ig Step 2 MySecondResource 2008 02 08 http davw podiatry curtin edu au netdoctor 2008 08 25 _hitte Awwwnetdoctor co ukAwhoisnd htm BE testSotos 2008 07 02 http Awww otinanai com Sotiris Konstantinidis d E testSotos2 2008 07 02 htty Awww namaste com Sotiris Konstantinidis deca amp View Registered Resources am md me Tm m ann ivin Li am
42. results are presented in the form depicted in Figure 31 By clicking on a URL from the received URLs list the corresponding web page opens in a new browser window INSPECT EDIT SEARCH RESULTS g E f Z http Jen vikipedia orgivikidiabete JE bitte ven wikipedia orgsvikiidiabetes mellitus e elelee ee http iewe diabetes org uk SEE hit wwe diabetes org hitp www diabetes orqfabout diahetes jsp O hitp uee hindu comthehinduholnus 009200808242 m m o 00o m E m OJo ONl D hitg Shwe youtube combesuts7num S hlsen amp as epy View Classification summary Train a new model taking Into account the above classification Download the lists of positive and negative examples to your PC FOT Confirmed by the user FRI Recent pages retrieved in last search Figure 31 Viewing the Search Results At this point the user has the ability to decide whether this specific URL is relevant for his her search or not The user interface is designed to help in such classification the user can use the radio buttons next to every URL selecting the Pos Positive value means that the corresponding URL is relevant while by selecting the Neg Negative value signifies that it is not Leaving the Uncl Unclassified value selected means that the user is not certain about a URL s relevance or that the URL has not been checked yet Once the user has manually classified as Pos
43. tions or pathological processes associated with the disease of diabetes DIABETES Pathologic mellitus Due to the impaired control of BLOOD GLUCOSE level in diabetic COMPL C0342257 MSH ENG Funoliof patients pathological processes develop in numerous tissues and organs including the EYE the KIDNEY the BLOOD VESSELS and the NERVE TISSUE Synonyms Diabetes Complications Related concepts Diabetes Mellitus MSH Show hierarchy in English Spanish Select context Diabetes Mellitus v Gi MeSH Descriptors Index Medicus Descriptor Diseases MeSH Category SY Endocrine System Diseases GY Diabetes Mellitus lt 3 DIABETES COMPL Diabetic Angiopathies Diabetic Coma Diabetic Ketoacidosis Diabetic Nephropathies O Diabetic Neuropathies Fetal Macrosomia Diabetes Mellitus Experimental Diabetes Mellitus Type 1 Diabetes Mellitus Type 2 Diabetes Gestational Diabetic Ketoacidosis Prediabetic State Step 5 Step 6 DODO DD Add Concept Add Subhierarchy Proceed to Save Lexicon Figure 22 Retrieving Search Terms results amp Linguistic Resources Browser Step 4 Select the desired Concept from the list of found ones Step 5 Add concepts and or sub hierarchies of concepts to the selected Lexicon Resource Step 6 Press the Proceed to Save Lexicon button You can see the form of Figure 23 201 View Edit Lexicon Lexicon Content Diabetic ketoacidosis Step 7
44. your search task immediately by checking the Run task now checkbox and b Ask AQUA to send you an alerting e mail once the task is completed by checking the Send me an e mail when task finishes checkbox f sir _ _________ Step2 Click the Finish button Step la Schedule Task Search Procedure GI I Send me an e mail when task finishe Figure 15 Scheduling a Search Task Why Search Tasks Searching for new web resources may take some time if for example the input keywords are numerous Also a user may desire to initialize several search tasks running simultaneously and in parallel In this context search for new web resources is performed in search tasks The user creates and configures search tasks each task corresponding to a different search e g one task searching for resources containing information related to diabetes mellitus a second task discovering content referring to Alzheimer s disease etc 2 7 4 View Search Results Step 1 OPTIONAL In the case that you have enabled the email notification option of the Search Task Scheduler after executing a Search Task you should check your mailbox once your search task is completed AQUA sends an alert message with subject Search task completed Step 2 Go to the submenu My Web Resources gt Search Web Resources You then see the list of all the search tasks that you or any other member of your organization has created s
Download Pdf Manuals
Related Search