Home

GATE Teamware 1.3 User Guide

image

Contents

1. ANNIC Search offers ANNIC based JAPE rule authoring for customisation and adaptation tasks Overview ANNIC ANNotations In Context is a full featured annotation indexing and retrieval system It is provided as part of an extension of the Serial Data stores called Searchable Serial Data store SSD Displaying the ANNIC Search Screen Click the ANNIC Search icon to use the tool Teamware downloads the AnnicGUI Java Web Start Downloading application Name AnnicGUI Publisher GATE team NLP Group University of Sheffield From http teamwq01 matrixware com 8080 Estimated time remaining 53 seconds ES SUS p Cancel y 32 The download could take several minutes depending on your Internet connection speed 2010 Fairview Research LLC Documents Granting Unrestricted Access When you start the ANNIC Search GUI your browser may also ask you to allow access Follow the instructions to grant this access ANNIC Search GUI The ANNIC Search GUI appears ANNIC GUI Connected for Corpus 1___ 1265884599342 4425 Annie GUI Corpus Entire datastore Annotation set Alises sels Results mw zzz Contest size e Search gt 4 Clear Next page of 50 results Have a look at the statistics table at the bottom right for the most frequent annotations Enter a query in the text area at the top and press Enter For example Person to retrieve Person annotations Results Export
2. etc Creating WF Templates Work Flow WF Templates are reusable settings for configuring Projects When you create a new Project that must specify a WF Template The sole purpose WF Templates is to provide configuration parameters for creating new Projects Sharing and Modifying WF Templates When creating new Projects Managers and Administrators can use WF Templates that were created either by themselves or by other Users Once a WF Template is complete it can not be modified You can only delete and re create the Template The WF Template Wizard Teamware includes a WF Template Wizard to help you quickly build custom templates There are two methods to start the Wizard e From the Home screen select Projects gt WF Templates gt My WF Templates and then click the Create Workflow Template button to display the Workflow Template screen e From the Home screen select Projects gt New Project to display the Create New Project screen Select the Blank Template to display the Workflow Template screen 2010 Fairview Research LLC 21 Projects G GATE Teamware Home Resources Projects Workflow Template Please enter the Workflow Template name and its description in the folowing fields Name Please enter some meaningful text that describes your workflow template best Description After entering a name and description you can configure Modes Configuring Pre Processing Mode You can specify one or m
3. 0 0 0 00 Export to HTML Statistics Adjudication Document U S 20080005800 A1 xml__1255884599981__ 5752 The Key Set is the base Annotation Set The Response Set is the Annotation Set for comparison You can choose Sets to compare however the Key Document and Response Document are selected for you IAA Calculation IAA Calculation helps to determine how multiple Annotators handle the same information customisation and adaptation tasks Click the IAA Calculation icon to use the IAA Calculation tool 2010 Fairview Research LLC 31 Documents IAA Caculation on the document US 20080005800 A1 xml Please note you can NOT do caculation if there is no common annotation type on the two selected annotation sets or more Available Annotation Sets annotator2 annotator3 safe preprocessing annotator1 consensus annotator2 original annotator1 original Annotation Type Feature gt Annotation Sets to Compare Algorithm pairwise f measure 2 A v List Project Processes In the Corpora screen see page 30 click a Project to display the Processes in that Project e The Process List section see page 42 has more information about this list New Project If the New Project icon appears next to the Corpus Name you can click this icon to create a new Project using this Corpus e The Create New Project section see page 24 has more information about new Projects ANNIC Search
4. 7 Quick Start Guide Quick Start Guide This section provides a brief overview of accessing and getting started with an existing GATE Teamware system For information on installing a new system please see the GATE Teamware Installation Guide available here Prerequisites Teamware management consoles the annotation interface and resources documents projects annotation service packages and reports all are accessed through a web browser The following browsers are supported and have been tested for use with GATE Teamware e Internet Explorer e Opera e Chrome e Safari You can not use Firefox as an Annotator You can use it as a Manager e The User Roles section see page 9 has more information about Annotators and Managers Login When you first access Teamware from your web browser you need to login with a User name and password If you forget your password you can use the password hint option to have a password reminder sent to the email address associated with your Account Signup Button You can also click the Signup button to create a new Annotator Account Logout Button Click the Logout button on the bottom the page to log out Edit Profile From the Main Menu click Edit Profile to change your password and update other User Account information This page also shows your current level of access to Teamware features These features are associated with predefined User Roles A Teamware administrator
5. Get Task button to load a Document Annotate the Document using the tools described below Save the Document to work on at a later date a IN Exit the Annotation Editor to return to the Document list 12 2010 Fairview Research LLC Using the Annotation Editor Layout of Annotation Editor The figure below shows an example Annotation Editor layout 600 Annotator GUI Connected to POOL mode annot3 i Toobar 5 GHK EAS Document Editor 27 a Annotation e0s __ 607 511 0 9 10 New Annotation i 8271831 List Area pos aene Set rea Annotations 0 selected Select US 20080005801 A1 20080103 US 42823806 A 20060630 US 42823806 A 20060630 HO4L 9 32 20060101CF120080103BHUS HO4L 9 32 20060101AFI20080103BHUS 707E17 9 GO6F Document 17 30E HO4L 29 06C5 HO4L 29 06M4S6 HO4L 29 06M4S REMOTE SESSION MEDIA PLAYBACK MICROSOFT CORP US MICROSOFT CORPORATION ABDO NADIM Y US STOYANOV VLADIMIR K US Area ABDO NADIM Y STOYANOV VLADIMIR K Abdo Nadim Y Bellevue WA US Stoyanov Vladimir K Redmond AUS WORKMAN NYDEGGER MICROSOFT 1000 EAGLE GATE TOWER 60 EAST SOUTH TEMPLE Salt Task 394 Document US 20080005801 A1 xml 1265884600388 6559 A This example shows a typical layout in Pool Mode Your layout may be different depending on Project Annotation Rules see page 46 The Toolbar buttons are on the top row The Toolbar buttons that you see on the Annotation Editor depend on the Mode you are using as explained below Po
6. O cc cee a TB cc 21 Creating New Projects cc E cnc 24 Starting Projects ooocoocococcococcccnccnoconancncno A o 24 Export Project Options CSV and PDF cc Ml ccoo 26 SAM MA Y SIA 27 Schema Driven EC ccoo O ecc enc eeeeceeseceecesseceeseceeceseecesssoes 27 Creating a New Amig lanon COME ooo E aaa 2 TP MAA AA A 27 Uploading IMEMLA MM occ aaa 27 Secu EMM AA MAA 28 Example Schema for a Date Annotation A kaaa 28 Export Schema Options CS occ akn 29 ME o cece cceseeescecescessecesssoesesaesasereeseeoerees 30 Add Cor O A o PBB Ga 30 ESR evn GG aaa 30 List Project Proc a nA rre amenas 32 e A AA AA AA AA AA AA AA 32 ANING YA o 32 Do CO o GG aaa 33 Upload Bagiients AA GA a 33 Export DocWiigemmOptions CSVEANPDF u aaa 34 Blg eel MAMMA AA 35 Rea gt Er o En OO IS a 35 Create Account AA tuned a caia 35 BUI HU AA SR g oe so sane ence aeeaedien once nce eno tome one asewaee te 36 MESITA AA 3 Mea Ra 3 ANECA AA 3 Nr A A nn ee ene ee eee ee 38 cc woe ccc eee c cee ce cence cee eecnceaeesececenseceaeeseceaenseaeaeesececenseceacaseceaeaceeeaseseceseneecsseeseceseeseaears 38 SE o lt P o e E EE AA AP AA PANA A PAR 40 E E PP 40 O 2010 Fairview Research LLC iil GATE Teamware 1 3 User Guide Std ARNO Talon SEIVICES cpio al eco A te hala 40 Edit Annotation SACA e al led ass 40 Export GATE
7. Senmices Options CSV and PDF aaa Gece ee ae eed Ged eal 41 LOCOS O Sail at 42 PIOCECSSOS MH ot 42 JO 42 Process Monitoring Sd A ee ea nnnae nnana ina aaa ee 43 AA i 44 Canceling Tasks and Processes O o 45 AA O APA 46 ANNOIN OGIS ns A it 46 Anonymous Annotation AA ORR aaan naaa 46 Number of Annotators per Project ccecccceceseeceecece nr A cnc 46 Random Document Assignment u eee eeece essence sence O cnn 46 Allowing Annotators to Cancel Tasks g bakbakan 46 Project Completion Based on Annotation Completion cccccceceececeeceeeeceeeeeeeeeaeeeeaeeetaeeaegeeaeeneanes 47 Acknowledgements Uu aaa econo caco A 48 iv 2010 Fairview Research LLC Preface Preface Welcome to the User Guide for Version 1 3 of GATE Teamware Preview This Document is a preview of Version 1 3 but it also applies to Version 1 2 Release Date April 2010 www fairviewresearch com 2010 Fairview Research LLC V Introduction Introduction GATE Teamware is an online management system for manual and semi automatic annotation of text collections GATE Teamware is part of the GATE General Architecture for Text Engineering family of products developed by the GATE Team at the University of Sheffield s Natural Language Processing Center Teamware is compatible with the popular GATE Developer text engineering framework GATE Teamware is designed to simplify the manual effort ne
8. a pool of Documents e Direct Mode is designed for Managers and Administrators who need to access a particular Document directly Starting the Editor Multiple Methods You can start the Editor using one of these methods 1 Clicking a link delivered in email 2 If you are an Annotator you can click the Annotator Editor link on your Home screen to open the Editor in Pool Mode 3 If you are a Manager or an Administrator you can open the Editor in Direct Mode when you list individual Documents Downloading the Start Document When you start the Annotation Editor in both Pool Mode and Direct Mode see page 12 your browser will download the viewDocument html j nlo Document Most browsers will open the file automatically however you may need to open it yourself if the browser does not Granting Unrestricted Access When you start the Annotation Editor your browser may also ask you to allow access to the Teamware Annotation Editor Follow the instructions to grant this access Overview of the Process A general overview of the Annotation procedures is as follows Pool Mode 1 Click the Get Task button to load a Document Click the Reject button if you do not wish to annotate this Document Annotate the Document using the tools described below Save the Document to work on at a later date Finish the Document to complete annotation Pt a O Click the Get Task button again to load the next Document Direct Mode 1 Click the
9. annotation services URL ml service services application ml service services application http safekeeper1 dcs shef ac uk lighthouse copy service services GATEService ml service services application http safekeeper1 dcs shef ac uk lighthouse merging service services GATEService ml service services application ml service services application ml service services application ml service services application preprocessing service services GATEService bay ly ly kj WY E E Eu Edit Annotation Service To edit an Annotation Service from the Annotation Services screen click the Edit icon El or click the Annotation Service Name on the left column 40 O 2010 Fairview Research LLC Services Annotation Service Data URL Type ml service services application Name Description CN CN Sentence Annotation Set Key Annotation Set Value Output Annotation Set Extra Mappings preprocessing Original Markup Parameter Key Parameter Value Export GATE Services Options CSV and PDF Click the CSV Export Option to download a comma separated value file This option produces a file that can be imported to spreadsheet programs like Excel Click the PDF Export Option to create an Adobe Portable Document Format file O 2010 Fairview Research LLC 41 Processes Processes Processes How Processes are Created Each Mode in a Project see page 21 becomes a Teamware Proc
10. have the ability to reject Documents The Project Rules section see page 46 has more information about cancelling Tasks Anonymous Annotation This option creates generic Annotation Set names instead of using the User Account name Generic names are assigned as annotator1 annotator2 etc e The Project Rules section see page 46 has more information about Anonymous Annotation Annotation Schemas You must select at least one Schema per Project e The Schemata section see page 27 has more information about creating and using Schemata Add Schema amp popup true This option is currently disabled Pre Manual Services Certain GASes are designed to specifically to prepare Documents for Manual Annotation mi You must select at least one GAS for Manual Annotation Any more are optional Configuring Post Processing Mode This Mode also runs multiple Automatic Annotation Pipelines You do not need to select a GAS if you do not require one for Post Processing 2010 Fairview Research LLC 23 Projects Configuration select post processing service gas copy gas gas merge gas Save And Add Another gas pre manual gas gas Pre Curation GAS gas pre processing gas e The Services section see page 40 has more information Curation Mode Curation Mode uses a specialized GAS to enable the review and correction of Annotated Documents Creating New Projects On the Create New Project screen select a WF Template and then click
11. want to Annotate a particular Document If you do not see the Reject Task button then the Project Rules do not allow this option e The Project Rules section see page 46 has more information about rejecting Tasks mi Once an Annotator rejects a Document only Users with more privilege than the Annotator can access the Document e The Edit Profile section see page 8 has more information about Roles Search 4 Annotate Tool Teamware includes a tool to locate annotation information quickly To open it click Open Search 4 Annotate tool on the bottom of the Annotation Popup b Open Search amp Annotate tool 18 2010 Fairview Research LLC Using the Annotation Editor The top row of the tool shows search options The bottom buttons execute search and annotation commands w Case Whole ae Hover you mouse over a search expression on the top row to see more information about the expression Expression Desorption Use the buttons on the bottom as follows e Click the First button to find the first match e Click the Next button to find for the next match e Click the Prev button to locate the previous match e Click the Annotate button to create an Annotation of the selected text You can also click the Ann all next button to automatically select and annotate all matches Search Expression Builder Click the Question Mark button on the Annotation Popup to display the GATE Search Expression Build
12. Administrators can view and edit existing GASes GATE Services as explained below Creating a GAS Teamware includes a number of Pre Packaged GASes to perform common functions for example Pre Manual Pre Curation Copy Merge OntoText Specific Alexandria Specific etc You can also create your own customized GASes instructions are found in the Super Administrator Guide Listing Annotation Services To view the GASes that currently exist on your system select Resources gt Services from the Home screen to display the Annotation Services screen Annotation Services Add Back 10 annotation services found displaying all annotation services Name Description AUR Curation Aureus Corpus curation CN Sentence copy Section Reference Measurement annotations from annotator1 2 annotation sets to consensus annotation set Medline GAS for preparing Medline abstracts copy annotator1 2 to annotator1 2 0riginal as a backup merge annotator1 2 annotations into consensus delete annotator1 2 annotations that have been merged See E Pre manual gas that copies annotations Correction of Pharma Parameters of Pharma Parameters exoPharma corpus Enables annotators to see all annotations Pre Curation GAS in the Processed annotation set GAS for preparing manual annotation task pre manual gas Pre processing GAS for automatic j Pro Processing ges annotation task 10 annotation services found displaying all
13. CSV and PDF Click the CSV Export Option to download a comma separated value file This option produces a file that can be imported to spreadsheet programs like Excel Click the PDF Export Option to create an Adobe Portable Document Format file 2010 Fairview Research LLC 29 Documents Documents Teamware includes a number of features for loading and tracking large Document sets which are called Corpora Add Corpora From the Home screen select Resources gt Documents to display the Corpora screen Corpora Download Datastore 3 corpora found displaying all corpora Corpus Name projects O SomeProject Corpus 1 Projectdm 4 Project 01 test2 Cal Example Corpus Example Project gt 8 O NewCorpus test66 ee E The screen lists all of the Corpora and the Project that use each Corpora List Documents Click the Corpus name to display a list of the Documents in the Corpus Documents in Corpus Corpus 1 Upload Documents Back to Corpus List 3 documents found displaying all documents Document Name Delete US 20080005800 A1 xml US 20080005813 A1 xml US 20080005814 A1 xml View Document Click the View Document icon to use the Annotation Editor e The Using the Annotation Editor section see page 12 has more information Annotation Differ Annotation Differ helps to determine how multiple Annotators handle the same information customisation and ada
14. Finish Back Help Na Annotation Schemas PosSchema xml lt lt Start States start Cancel Task Allowed on Document ID example_patent xml 126740083 8722 Retry lt lt gt gt 4 lt lt Task Node gt gt Error Finish Ba S Naa Error select corpus Retry example patent ww lt lt Task Node gt gt handle error Error Finish Ignore o pi lt lt Join gt gt lt lt End State gt gt cy end Cancel Tasks are Suspended when Projects are Suspended e The Suspend Project section see page 25 has more information Reject Task Click the Reject Task icon o to Reject a Task The Group Tasks screen appears You have rejected task example patentxml 1262916740083 8722 It should appear in Group tasks list If nobody from your group accepts it you will be able to do that later Group Tasks No Tasks found Name Project Start End Status Actor Nothing found to display Group Task To display the Group Tasks screen select Projects gt Group Tasks from the Home screen Group Tasks No Tasks found Name Project Status Nothing found to display No Tasks found Process Monitoring El Click the Process Monitor icon to display the Document Status Summary screen e The Project Tracking section see page 44 has more information about the Document Status Summary O 2010 Fairview Research LLC 43 Processes Reports Teamware includes a number of report
15. GATE Teamware 1 3 User Guide GATE Teamware 1 3 User Guide GATE Teamware 1 3 User Guide Table of Contents EEE E A e PP O PEO E EI seein csi V o o PA PABABA oo 7 IN this Guide ooocococoncnccnccnncancnarancnaranrnnrorinnrorrorancanrnnranannrananarananaranannranasararascanaanraas a a A 7 Additional Resources coococoococcococcncnncnccocanoncnncnnonnnnconanononocanconanancnnnn cana nan nazca coa A A 7 Quick Start Guide oconccnononconaconiconccaronicoronaronronacnaronionar aaa A MS 8 A Ein GM 8 Ki 8 EAE POIO a ee ae 8 User ate ca ll 9 POLA AA EE SRA 9 IE aang Abbas 9 A IEEE RR 10 Super Administrator ocoococcoccococcococcncnccnocananonononn corran bhang 11 Using the Annotation Editor coococcocoococcoccnnonconononon gf eee A eee 12 Starting the Editor a Al eee O cece 12 Overview of the Process cccccsccscsecescesceecressenressceecenceeseeesecs ss II css Na 12 Layout of Annotation Editor ccccccccccc a 13 Creating an Annotation ococoococconoccncnncnnconaneccnonanonnnnoncnncnnonnn Aa occ 16 Search amp Annotate Tool ooococcococcnconocnoconaccncnncnccnnanoncnncnocananna cananea 18 Editing and Deleting Annotations ia nono II cc 20 Other Features u O aaa cc 20 AA A AM AAA 21 Project Modes occcoocoocococcncnocanconancncno E e eee eee AP 21 Creating WF Templates
16. Leff context Match Right context Features Query Document Annolation se Measurement Reference e II JE ANNIC Connection Download Corpus ih Click the Download Corpus icon to download all of the Documents in this Corpus as a zip file The downloading and saving of the zip file to your system is processed through your browser Upload Documents To upload Documents to Teamware from the Home screen select Resources gt Documents to display the Corpora screen see page 30 Then click the Add button to display the Upload screen Upload a Zip File that contains Documents Note that File To Upload below should be a ZIP file that contains a collection of documents that are supported by GATE xml html txt sgml rtf pdf doc The maximum allowed size of an uploaded file is limited to 100 MB Corpus Name Encoding UTF 8 File to Upload Choose File no file selected Unpack Document Markup mM When the upload is complete Teamware displays the results O 2010 Fairview Research LLC 33 Documents Corpus has been populated with new documents successfully Corpus Upload Result Information Corpus Name Archive Corpus Size 6 View Corpus Click the View Corpus button to List Documents see page 30 Export Document Options CSV and PDF Click the CSV Export Option to download a comma separated value file This option produces a file that can be imported to spreadsheet programs like Exc
17. Project Rules do not allow you to create Annotation Sets see Annotation Type Colours Colours are randomly assigned to each Annotation Type see page 14 e Annotation Sets are groups of Annotations e Annotation Types are categories of Annotations such as Name or Date Changing Colours Right click a Annotation Type to change the colour Change colour You can change the current colour using a variety of selection options O 2010 Fairview Research LLC 17 Using the Annotation Editor 800 Select colour for pos Swatches H O El E Sample Text Sample Text fl O Sample Text Sample Text Saving Documents You can save the current Document by clicking the Save button so that you can continue work at a later time The current Document will re open the next time that you start the Annotation Editor Finishing Documents When you have finished annotating a Document click the Finish button This indicates that the Document is ready for the next processing step You can then Annotate another Document Annotations m When you finish a Document you can not annotate it again unless you have a role with more privilege than the Annotator role e The Edit Profile section see page 8 has more information about Roles p If you have not saved your Document the Editor will ask you to save the Document to avoid losing Rejecting Documents If your Administrator allows its you can click the Reject Task button if you do not
18. Select Create New Project Choose the templete for this project Available Templates Blank Template ES My Workflow Templates The Project Data screen appears Project Data Project Name Managers Curators TWsupport o Corpus No Selection Add Corpus Corpus After entering a Project Name select a Corpus e The Documents section see page 30 has more information about Corpora Roles Next assign the Roles to the Project The User Roles Descriptions see page 9 has detailed descriptions of the standard Roles Starting Projects Click the Save amp Start button to begin Project execution Teamware displays a list of the Projects that use the same WF Template 24 O 2010 Fairview Research LLC Projects Projects based on template test2 2 Projects found displaying all Projects Name Template Corpus Manager Start Status O test2 test2 Example Corpus dmartin An started Y b Y m O 2010 04 09 test66 _ ittest2 NewCorpus dmartin 55 49 c4 9 started 9 8 m O Project List Icons List Processes e Click the Processes icon to display the Process List e The Process List section see page 42 for more information Suspend Project Click the Suspend Project icon to suspend the Project Resume Project Click the Resume Project icon to resume a suspended Project Change Project Actors Click the Actors Icon icon to display the Change Project Actors screen Change Project Ac
19. an Excel worksheet e The User Accounts section see page 35 has more information about Accounts 10 2010 Fairview Research LLC User Roles Services Administrators can create automated annotation procedures with GATE Developer These procedures can be wrapped into Services which are treated as Modes in Teamware e The Services section see page 40 has more information Processes Administrators can monitor Processes and Tasks that are created by Teamware when Projects are run e The Processes section see page 42 has more information Super Administrator This section provides an overview of the Super Administrator Role e See the Super Administrator Guide for more information Assigning Privileges to Roles The Super Administrator can configure for each standard Role the Teamware functions that can be performed For example the Super Administrator can specify that Managers can access the IAA Calculations see page 31 Creating Custom Roles Unique Teamware Roles can also be created by the Super Administrator For example the Super Administrator can create a new Role called NewAnnotator and delete the standard Role called Annotator O 2010 Fairview Research LLC 11 Using the Annotation Editor Using the Annotation Editor This chapter explains how to use the GATE Teamware Annotation Editor Editor Modes The Editor can be used in two Modes e Pool Mode is designed for Annotators who get Documents from
20. can assign Roles 8 2010 Fairview Research LLC User Roles User Roles There are several types of Users of Teamware each with different Roles and objectives This chapter presents a quick description of the most common Roles and functions e The User Accounts section see page 35 has more information about assigning Roles to Users Predefined Roles The following Roles are predefined in Teamware e Annotator e Manager e Administrator e Super Administrator Teamware predefined Roles can be assigned by the Administrator see page 10 The Super Administrator see page 11 can create new types of Roles that are unique from the predefined Roles For Annotators The Annotator Main Menu shows links to the Edit Profile see page 8 and Annotation Editor screens Starting the Annotation Editor The Annotation Editor is the primary tool for the manual annotation process The Annotation Editor section see page 12 has detailed information about using the Editor The information below explains how to start the Editor Downloading the Start Document Starting the Annotation Editor will download the viewDocument html jnip file which is a Java webstart application file Most browsers will open the file automatically however Annotators may need to open it if the browser does not Granting Unrestricted Access The browser may also request permission to access the Teamware Annotation Editor Follow the instructions to grant this acces
21. cific Annotation select an item in the Annotation List area to display the Annotation in the Document area The Annotation will be both highlighted and blinking Sorting Columns Click any of the headings in the Annotation List area to sort the cells in the column below Click the heading again to reverse the sort order Searching for Annotations Enter a query in the Select field on the bottom of the Annotation List area and then type ENTER to search the list The annotation with the closest match is highlighted in both the Annotation List area and the Document a You can also search using the Search amp Annotate Tool see page 18 Title Bars The title bar at the bottom of the Annotation Editor shows the name of the current Document The bar on the top of the Editor shows status messages for example 2010 Fairview Research LLC 15 Using the Annotation Editor Connected in Direct Mode Creating an Annotation The Annotation Popup To create a new annotation using the Annotation Popup e Select an Annotation Type see page 14 in the Annotation Set column e Select text in the Document e Then hover the mouse over the highlighted area until a Annotation Popup appears as shown below b Open Search amp Annotate tool In the example above the selected Annotation Type pos includes several Subtypes that you need to enter The R in the left column indicates that these Subtypes are required a You cannot com
22. e Using Documents section see page 30 has more information Project Tracking Screens and Reports Teamware includes a number of screens to monitor Processes Projects Tasks etc so that Managers can quickly determine current status of the factory e The Processes section see page 42 has more information Document Status Summary This screen shows the progress of annotation processes including the number of Documents annotated and the number remaining Document Status Details This screen shows annotation progress on a Document by document basis Annotator Record View This screen shows individual Annotator performance Record Summary for All Annotators This screen shows how workload is shared among the Annotators For Administrators Administrators have almost total control of all Teamware operations with the exception of a few operations reserved for the Super Administrator see page 11 Administrators handle User Accounts create and configure Services and monitor Workflow processes Administrators also see the same screens as Managers and can perform the same functions User Accounts Teamware controls access to data using Accounts with Roles Everyone logs in with a name and password Every Account includes Roles that control what a User can do and what information a User can see Administrators can create delete and suspend Accounts and can also use the Teamware Bulk Upload feature to quickly add Accounts from
23. e martin twresearch com admin Ka O jababente Jde Ann Benente jabenabente iousesoftware com ph curator annotator M O Jbaroft Jes Bayift jbaycroft fairesearch com curator manager annotator admin vi O Create Account From the Current Users screen click the Add button to create a new Account O 2010 Fairview Research LLC 35 User Accounts User Profile Back to User Accounts You can update this user s information using the form below Username Password Confirm Password Password Hint First Name Last Name E Mail Phone Number Website Address Address City State Zip Country lt gt Account Settings C Enabled Assign Roles O admin FJ manager FJ curator FJ annotator Save Cancel Bulk Upload The Bulk Upload features allows you to create multiple Accounts quickly using an Excel worksheet From the Current Users screen click the Bulk Upload button to display the screen Bulk User Upload Upload excel file containing list of users you would like to be created File to Upload Choose File no file selected Send e mail to the new users m Receive copy of the e mail wi Excel Template Click the end of the sentence The template can be downloaded here to obtain a copy of the blank Excel worksheet 36 2010 Fairview Research LLC User Accounts Password First Name Last Name Roles comma separated names Fill in the works
24. eded to develop high quality accurate annotations of text Teamware annotation processes can be used as an input to the development of annotation algorithms or as a manual editing step for previously annotated Documents Teamware is also integral to life cycle systems in which continuous improvement of annotation or changing annotation needs are required GATE Teamware s internal workflows are designed to streamline complex annotation tasks into easily manageable projects Projects are based on reusable workflow templates eliminating redundant set up tasks The various Roles necessary for creating high quality annotations are segregated in the Teamware system in order to minimize the need for content experts and annotators to set up and manage projects Finally as a self contained online platform GATE Teamware supports wide distribution of project tasks to anyone with Internet access making it possible to conduct annotation projects with participants around the globe GATE Teamware s real time project tracking systems allow for instant adjustments in projects and support commercial annotation teams with detailed annotator by annotator tracking and progress reports In this Guide This guide supports Teamware users managers and administrators Teamware s workflow is centered around projects and user Roles This guide will discuss the Teamware project management workflow how to set up and manage projects how to work with the various
25. el Click the PDF Export Option to create an Adobe Portable Document Format file 34 O 2010 Fairview Research LLC User Accounts User Accounts Teamware controls access to data using Accounts with Roles Everyone logs in with a name and password Every Account includes Roles that control what a User can do and what information a User can see e The User Roles Descriptions section see page 9 has more information Administrators can create delete and suspend Accounts and can also use the Teamware Bulk Upload feature to quickly add Accounts from an Excel worksheet Implementation Notes An Account that does not have an Annotator Role can not perform Annotator functions even if other Roles with more privileges are assigned to the Account mi An Account with the Administrator Role can perform all Manager functions List Current Users To view the Current User Account from the Home screen select Admin gt Manage Users to display the Current Users screen Current Users 35 users found displaying all users Username First Name Last Name E Mail Current Roles Enabled Delete adm Amin Adrr agaton dcs st uk manager admin Kal O agan Man Aganovic agaton dcs st uk curator manager annotator vi O anG Agus Robs a roberts dcsac uk curator manager annotator admin vi borav Brislav Popi borislav sirm curator manager annotator mM O Chra Crista Deim cdeinum lighleipg com curator manager annotator admin vi dmtin Dve Mar dav
26. er A GATE search expression builder Current search expression SOUT Number Person Replace search expression Any character The beginning of a line The end ofa line All letters Letter uppercase Letter lowercase Letter tillecase Letter modifier Letter other All Numbers Insert at the caret position Either the selection or X Once or not at all Zero or more times One or more times Capturing group Non capturing group Modify the selection Lale The GATE Search Expression Builder is a GATE specific regular expression tool O 2010 Fairview Research LLC 19 Using the Annotation Editor e For more information see the JAPE section of the Gate User Guide Editing and Deleting Annotations Annotations often need to be reviewed and modified for accuracy Annotations and Sets Make sure you are working on the correct Set when you change Annotations e ts easy to inadvertently create a new Annotation Set e lts also easy to create Annotations in the wrong Set Other Features The three buttons on the right side of the Annotation Editor provide additional features They are from left to right Show Application Log Help and Edit Settings Show Application Log The Annotator GUI Application Log is a list of the activity that occurs behind the scenes You only need to click the Show Application Log button if you experience problems Help Click the Help butto
27. ess when the Project starts see page 24 Each Process executes sequentially in the order in which the Mode is listed in the Project Each Process must complete before the next Process begins When Projects start the currently executing Mode is the current Process You can see this by selecting Projects gt All Projects gt View Processes to create a Process List Process List Processes in Project test One Project found Name 7 Template Corpus Manager Start End Status manual 2010 03 10 pa L annfakan test Example Corpus dmartin 71 18 41 0 started Tasks How Tasks are Created When a Project is running all documents in the Corpora are treated as separate Tasks Task List To display the Task List select the Projects gt All Projects gt Processes screen from the Home Fe screen and then click the List Task button al Tasks Refresh Back 3 Tasks found displaying all Tasks Name gt Project Start End Status Actor 2010 03 15 2010 03 15 example news xml 1262916739981 5426 test2 51 14 43 0 22 09 24 0 Completed drmtwr 2010 03 15 example patent xml 1262916740083 8722 test2 22 09 37 0 Pending drmtwr PG 2010 03 10 welcome html 1262916740199 1898 test2 21 18 41 0 Pending Execute Task Click the Execute Task icon to run a Suspended Task and to display the Task Detail screen 42 O 2010 Fairview Research LLC Processes Task example_patent xml_1262916740083___8722 Error
28. heet and then click the Choose file button to select the File to Upload Email Notification You can send an email notification to the new Users and yourself after the Accounts have been created After selecting email options click the Upload button to begin the bulk upload process Disable Users You can Disable Accounts if you wish to prevent a User from logging in to the system Disabling retains the User information in Teamware Clear the Enabled box in the Current Users screen and then click the Update button List Active Users To view the Active Users from the Home screen select Admin gt Active Users to display the Active Users screen Active Users The following is a list of users that have logged in and their sessions have not expired Back to Admin Menu One user found rg ETI Clickstreams A Clickstream is the recording of what a User clicks when using Teamware When a User clicks anywhere in the application the action is logged Clickstream analysis is useful for a number of reasons For more information see Wikipedia To view the Clickstreams from the Home screen select Admin gt Clickstreams to display the All Clickstreams screen 2010 Fairview Research LLC 37 User Accounts All Clickstreams No Bots All Bots Both 1 dmin 24 128 19 42 22 reqs Bots Bots are automated or semi automated tools that run automated procedures on the Internet Bots have the potential t
29. ind more information here W3C Schema W3C provides a tutorial to help you to get started XML Schema Primer Listing Schemata To view the Schemata that currently exist from the Home screen select Resources gt Schema to display the Annotation Services screen Annotation Schemas Back to Main Page 22 schemas found displaying all schemas Schema Name Projects O CNSentence xml CN Schema Agent xml CN Schema Applicant xml CN Schema Province xml CN Schema _inventor xml You can click the Schema Name to view the XML Schema code a You may need to use an option in your browser to view the XML code for example a command like View Source Uploading Schemata To upload a Schema click the Upload Schema button to display the Upload an Annotation Schema File screen 2010 Fairview Research LLC 27 Schemata Upload an Annotation Schema File Note that File To Upload below should be an XML schema file The maximum allowed size of an uploaded file is limited to 100 MB File to Upload Choose File no file selected File to Upload Choose File Choose File no file selected File to Upload Choose File no file selected File to Upload Choose File no file selected File to Upload Choose File no file selected Upload Cancel You can choose up to five Schema files to upload at a time by clicking the Choose File button Click the Upload button to perform the upload proce
30. n to display online help Edit Settings Click the Edit Settings button to change the appearance of the Annotation Editor using the options below Look and Feel The Look and Feel option will change the skin of the Editor The available options are e Metal e CDE Motif e Mac OS X Font Options You can change the type of fonts displayed by the Editor e The Text components font option controls the appearance of the Annotation List Area e The Menu components font option controls the appearance of the Annotation Popup e The Other components font option controls that appearace of the Editor labels like the Document Editor tab 20 O 2010 Fairview Research LLC Projects Projects Projects allow you to create customized Work Flows designate Corpora to Annotate and assign work to Annotators Project Modes Modes are the phases of a Project There are three types e Pre Processing e Manual Annotation e Post Processing These are explained in more detail below Using Pre Packaged GASes in Modes All Project Modes utilize Annotation Pipelines installed in Teamware as a GAS GATE Service A GAS is a particular type of GATE Annotation Pipeline the same Pipelines that you can create in the GATE Developer e The Services section see page 40 has more information You can select from a number of Pre Packaged GASes to perform functions for example Pre Manual Pre Curation Copy Merge OntoText Specific Alexandria Specific
31. notated completely A Project is not considered complete until the pre determined number of Annotators have processed a Document This number is defined in the WF Template 2010 Fairview Research LLC 47 Acknowledgements Acknowledgements 48 GATE Teamware Lead Developer Milan Agatonovic Fairview Research LLC Matthew Petrillo Jacques Schoofs Jessica Baycroft Dave Martin 2010 Fairview Research LLC
32. nt SimpleMeasure lype scalarValuej 1 ID amp salepatilight dimension speed rule measurementSimpleMeasure lypesunil rulesmeasurement SimpleMeasure type scalarValue D amp salepatlight dimension speed rulesmeasurement SimpleMeasure lype unif 8 frule measurementSimpleMeasure lype scalarValue a la 0094 58979 ID safepatibi dimension information rulesmeasurement SimpleMeasure typesunil 20 Annoiaions Oseleded Select id i REESE SERED AAA Displaying Annotations in the Annotation List When you select an Annotation Type from the Annotation Set column by checking the box detailed information about all the current Annotations of that type are displayed in the Annotation List area Document Area The Document Area on the bottom of the Document Editor displays the current Document Displaying Annotations in the Document Area Clicking an Annotation Type see page 14 from the Annotation Set column will display all of the current Annotations of that type in the Document area In the example below the Measurement Annotation Type is selected Document Editor sib to any naki of the medi file and aboga EGG at that pointi in ane on the media file In one oe the server mputing system 120 may attach a timestamp to an audio portion of a media file The timestamp may be attached at the ask 163 Document US 20080005801 41 xml___1265884600388__ 6559 A Identifying Individual Annotations To pinpoint a spe
33. o disrupt Internet applications like Teamware For more information see Wikipedia You can choose whether to view No Bots All Bots or Both Super Administrator The Super Administrator determines what User Roles can view Teamware screens For example the Super Administrator can specify that Managers can access the IAA Calculations see page 31 See the nstallation Guide for more information about SuperAdmin Roles Table Documents annotator manager super admin delete corpus Services GAS annotator manager super admin Tesis UI a rato on sees hk hk patama UI hh ews Th hk Schemas annotator manager super admin wwa O hk kh ei serena ff hh hk 38 2010 Fairview Research LLC User Accounts WF Templates annotator manager super a list all list all templates AOS RE ht Sel ny WE Tempe Projects annotator manager super E list all projects all list all projects create new projects delete any projects change project actors poo Rx kx Users annotator manager super admin create users users bulk a users update users ist active users ll LO Y view clickstreams a EA O 2010 Fairview Research LLC 39 Services Services Projects utilize Annotation Pipelines which are installed Teamware as a GAS GATE Service A GAS is a particular type of GATE Annotation Pipeline the same Pipelines that you can create in the GATE Developer Managers and
34. ol Mode Buttons Loading a Document In Pool Mode the Get Task button appears on the left to load Documents Annotating a Document With a Document loaded the Finish Save and Reject buttons appear for Annotation The three buttons on the right are always visible no matter what Mode you use They are explained in the Other Features section see page 20 Direct Mode Buttons Direct Mode see page 12 allows you to open a single Document without clicking the Get Task button The first button on the left is the Connect to Document Service button The Connect to Document Service feature is currently disabled The next button is the Save button Make sure you save all your changes before exiting the Annotation Editor 2010 Fairview Research LLC 13 Using the Annotation Editor lf you have not saved your Document the Editor will ask you to save the Document to avoid losing Annotations mi In Direct Mode see page 12 you need to exit the Annotation Editor to open another Document F Document Editor The Document Editor appears below the Toolbar buttons Document Editor a timestamp b an audio portion of the media information 121 act 316 A timestamp is a means of tracking the elapsed ti time of a media file For example ifa media file has a length of tf 3 00 a timestamp would allow a user or application to hree minutes jump to any portion of the media file and begin playback at that
35. ore Annotation Pipelines in Pre Processing mode These Pipelines in the form of GASes will run as soon as you start a Project You do not need to select a GAS if you do not require one for Manual Annotation e The Services section see page 40 has more information about GASes The Project does not become available for Manual Annotation until all Pre Processing Pipelines are complete Configuration select pre processing service gas copy gas gas merge gas Save And Add Another 9S pre manual gas gas Pre Curation GAS gas pre processing gas Configuring Manual Annotation Mode Manual Annotation Mode allows one or more Annotators to create edit or remove Annotations This Mode configures the Project Rules 22 2010 Fairview Research LLC Projects Configuration select annotation rules Annotators per Document Cancel Task Allowed Anonymous Annotation Annotation Schemas Add Schemakpopup true Add Schemak amp kpopup true Pre Manual Service one Annotators per Document Select the number of Annotators who must Finish this Document before the Document is complete e The Project Rules section see page 46 has more information about the number of Annotators Cancel Task Allowed The Cancel Task Allowed option controls whether annotators can reject Documents e If you select this option the Annotation Editor displays the Reject Task button e If you clear this option Annotators will not
36. plete an Annotation until all required fields are entered The highlighted area in the Document blinks to indicate that you are currently annotating this text The buttons on the top of the Popup are explained below Pin Button Click the Pin button to keep the Annotation Popup from disappearing The popup will remain until you click the X in the upper right or you click the Pin button again Selection Arrows It can be difficult to precisely select characters in a Document and also to exclude characters like whitespace The arrow buttons on the top of the Annotation Popup can help The arrows on the left will add or subtract one character from the left of your current selection The arrows on the right will do the same for the right side of your selection Deselect Button Click the button with the red X to erase the current selection in the Document Add New Annotation If your Project Manager allows it you can enter a new Annotation Type see page 14 using the Annotation Popup Select the New option as shown below 16 2010 Fairview Research LLC Using the Annotation Editor New ir b Open Search amp Annotate tool Enter a name for your Annotation Type and any Subtypes In Direct Mode see page 12 you can also enter an Annotation Set on the bottom of the Annotation Set column see page 14 and click the New button as shown below bic w annotator3 page 14 p If the New button appears dimmed your
37. point in time on the media file In one embodiment the server E computing system 120 may attach a timestamp to an audio portion of a media file The timestamp may be attached at the e Task 163 Document S 20080005801 A1 xm 1265664600388 6559 A There are three areas within the Document Editor which are described below e Annotation Set Column e Annotation List Area e Document Area Annotation Set Column The Annotation Set Column on the right side of the Editor appears in Direct Mode see page 12 In Pool Mode the Project Rules may allow this column to appear or it may be blank in your display F annotator3 Ean mala hee sa Ta ST The example Annotation Set Column above shows two Annotator Sets delineated by arrows The top set which is blank is always the default Annotation Set In this example the second set is called annotator3 It contains four Annotation Types each displayed with different background colours Annotation Sets and Types e Annotation Sets are groups of Annotations e Annotation Types are categories of Annotations such as Name or Date Clicking the arrows on the left will expand and contract the branches of the tree structure Annotation List Area The top of the Document Editor is the Annotation List area which shows detailed information about all the Annotations currently in the Document 14 2010 Fairview Research LLC Using the Annotation Editor Leste Ez rule measureme
38. ptation tasks lt compares the differences between Annotations from one Annotator compared to the Annotations from another Annotator e All the Annotations in one Set are compared to another Set e Comparisons are made on a document by document basis p You can perform full Corpus Annotation Differ in GATE Developer 30 2010 Fairview Research LLC Documents 2 Click the Annotation Differ icon to use the Annotation Differ tool Teamware downloads the AnnotationDiffGUI Java Web Start Downloading application gt Name AnnotationDiffGUl Publisher GATE team NLP Group University of Sheffield From http teamwq01 matrixware com 8080 Estimated time remaining 53 seconds Cancel The download could take several minutes depending on your Internet connection speed Granting Unrestricted Access When you start the Annotation Differ GUI your browser may also ask you to allow access Follow the instructions to grant this access Annotation Differ GUI The Annotation Differ GUI appears AE Annotation Diff GUI Connected in DIRECT mode US 20080005800 A1 xml__1265864599981__ 4752 Annotation DF GU Key doc US 20080005800 A w Key set Type DEFAULT T Weighi Resp doc US 20080005800 A Resp sel annotator3 Features all some none 1 0 7 documents loaded Correct O Recall Precision F measure PAEO set ooo ooo oo Missing O Lenient 0 00 0 00 0 00 False positives 0 Average 0 00
39. r testuser Annotator Record Chart Status Annotated Canceled Failed In Progress Not Started Total time annotator for all tasks 00 35 49 Average time annotator per task 00 35 49 Record Summary for All Annotators This screen shows how workload is shared among Annotators To view the report from the Annotator Record View screen click the Annotator View buiton Record Summary for All Annotators All Annotator Record Chart Role annotator Name Total Time Average Time testuser 1 00 35 49 00 35 49 Canceling Tasks and Processes Managers and Administrators can cancel Projects that are hung using the End Project icon see page 25 All Tasks and Processes in the Project are treated as if they were completed successfully 2010 Fairview Research LLC 45 Project Rules Project Rules This chapter explains how Teamware controls the process of annotating Documents Teamware Projects includes Rules to ensure that proper protocol is followed This section explains the Rules The Projects section see page 21 describes how to configure these Rules Annotator Sets Set Creation Teamware creates Sets for each User The Annotation Editor controls how Sets are used as explained below Pool Mode In Pool Mode the Annotation Editor only displays the Set created for the User The Annotator can not change or add to this set Direct Mode In Direct Mode the Annotation Editor displays the Set created for the U
40. s Document Assignment Annotators can not choose which Document to annotate Instead Teamware assigns Documents to Annotators from a pool of Documents This assignment is based on predefined Project Rules e The Project Rules section see page 46 has more information about the parameters that control Document assignment For Managers Managers create and monitor Projects and Workflow Templates They upload download and review Document sets called Corpora They also access Project tracking screens and reports Projects Projects allow Managers to create customized work flows designate Corpora to process and assign work to Annotators Projects are created from Workflow WF Templates Managers can browse create and delete Projects 2010 Fairview Research LLC 9 User Roles e The Using Projects section see page 21 has more information WF Templates Work Flow WF Templates are reusable settings for configuring Projects Managers can browse create and delete WF Templates Schemata Schemata provide a powerful and flexible method for defining and controlling Annotation procedures by pre defining the Annotation Types that can be assigned to a range of text Schemata are selected within WF Templates e The Using Schemata section see page 27 has more information Documents Managers can browse create and delete Corpora They can also use these GATE tools ANNIC Search Annotation Differ and IAA Calculation e Th
41. s to monitor Processes Projects Tasks etc so that you can quickly determine current status of the factory Project Tracking Screens and Reports Document Status Summary This screen shows the progress of Annotation Processes To view the report from the Home screen select Projects gt All Projects gt Processes gt Process Monitoring Document Status Summary formara PN Gara Document Status Chart Manager testuser Annotation Schemas IdentifierSchema xml PosSchema xml OrganizationSchema xml Status Annotated Canceled Failed In Progress Not Started Completion Percentage 33 Total time to annotate documents 00 35 49 g Average time to annotate document 00 35 49 Document Status Details This screen shows annotation progress on a document by document basis To view the report from the Document Status Summary report click the Details button Document Status Details 3 documents found displaying all documents Document Taken By Annotated By Rejected By Status Start Time 2010 02 11 example news xml testuser Canceled 22 00 51 N A example patent xml testuser Canceled 22 01 29 2010 02 11 2010 02 11 ak 4 welcome html testuser Annotated 5 gt 02 29 52 38 18 00 35 49 Annotator Record View This screen shows Annotator performance To view the report from the Document Status Details report click the Annotator name 44 2010 Fairview Research LLC Processes Record Summary fo
42. screens and interfaces how to manage users and Roles and other aspects of routine Teamware usage This guide does not cover in detail the installation and maintenance of Teamware on Internet servers Please refer to the separate Teamware Installation guide for this information This guide also does not cover the theory practice and art of annotation itself A separate Introduction to Manual Annotation is available as a primer on basic annotation practices common types of annotation projects and the various goals for manual annotation efforts In most annotation projects the work of annotators is governed by strict rules in the form of project guidelines These rules proscribe exactly what annotations should be created and under what circumstances often with examples and procedures for handling exceptions and unanticipated problems which are common in annotation projects An example guideline and a blank guideline template form are provided as an appendix to this guide The GATE website at the University of Sheffield also has vast resources covering many aspects of annotation text engineering and the GATE Developer framework Users of this guide may find the answers to many questions at that site http gate ac uk Requesting GATE Teamware GATE Teamware is available as a distribution package directly from the GATE Team at the University of Sheffield It is free for non commercial academic use 2010 Fairview Research LLC
43. ser however the User can create their own Sets and change existing Sets Set Names If you select Anonymous Annotation see page 46 each Annotation Set is assigned a generic name Annotator1 Annotator2 etc If you do not use Anonymous Annotation each Annotation Set is assigned the name of the User Account Anonymous Annotation Anonymous Annotation makes post processing easier by simplifying the Annotator names Instead of the User Account name Teamware assigns generic names like annotator1 annotator2 etc Number of Annotators per Project Specifying the number of Annotators ensures that each Document is reviewed by a minimum amount of people Random Document Assignment If you have more than one Annotator assigned to a Project Teamware will use the Random Document Assignment feature in Pool Mode see page 12 The Annotation Editor in Pool Mode will randomly select Documents from the Pool of Documents when the Annotator clicks the Get Next Task button Allowing Annotators to Cancel Tasks The Cancel Task Allowed see page 23 option controls whether the Annotation Editor displays the Reject Task button If you do not allow Annotators to cancel Tasks then the Reject Task button appears dimmed in the Annotation Editor 46 2010 Fairview Research LLC Project Rules Project Completion Based on Annotation Completion Teamware ensures that each Document is Annotated correctly and that all Documents in a Project are An
44. ss Example Schemata There are a number of example Teamware Schemata available to use as templates They are stored in the GATE directories plugins ANNIE resources creole schema and listed below AddressSchema xml CorefSchema xml DateSchema xml EmailSchema xml EntityHeadSchema xml EntityMentionSchema xml EntitySchema xml FacilitySchema xml GpeSchema xml IdentifierSchema xml InternetSchema xml LocationSchema xml MoneySchema xml OrganizationSchema xml PercentSchema xml PersonSchema xml PhoneSchema xml PosSchema xml SentenceSchema xml StreetSchema xml Syntax TreeNodeSchema xml TokenSchema xml UtteranceSchema xml Example Schema for a Date Annotation The example below shows the format of a simple Date Annotation 28 2010 Fairview Research LLC Schemata lt xml version 1 0 gt lt schema 1 da www 3 2000 10 XMLSch gt l FTNA Si E al org ee Create a new Annotation Type called lt element name Date gt Date Define a Subtype called kind Specify that it is optional attribute name kind use optional gt Ete Ts ee Defi th tabl f lt enumeration value time gt te BG See Pee area HUB lt enumeration value dateTime gt Subtype kind eriline pas lt attribute gt lt complexType gt lt element gt lt schema gt The Add a New Annotation section see page 16 shows how the Annotation Popup displays Annotation Types and Subtypes Export Schema Options
45. tors Managers Curators Annotators TWsupport annotatorl annotator2 7 2 drmtwr testuser TWsupport e The User Roles Descriptions see page 9 has more information about the Actors End Projects Ci Click the End Project icon to end the Project A Project is not considered complete until a certain protocol is followed for instance that a pre defined number of Annotators have processed a Document e The Project Rules section see page 46 has more information 2010 Fairview Research LLC 25 Projects Export Project Options CSV and PDF Click the CSV Export Option to download a comma separated value file This option produces a file that can be imported to spreadsheet programs like Excel Click the PDF Export Option to create an Adobe Portable Document Format file 26 2010 Fairview Research LLC Schemata Schemata Schema Driven Editing GATE Teamware uses an XML Schema definition language to configure the operation of the Annotation Editor Schemata provide a powerful and flexible method for defining and controlling annotation procedures The Schema defines the Annotation Type see page 14 as well as optional or required features Creating a New Annotation Schema You need to create customized Schemata to identify Annotation Types Each Type requires a corresponding Schema file Teamware Schemata conform to the World Wide Web Consortium W3C standard for XML Schemata You can f

Download Pdf Manuals

image

Related Search

Related Contents

Saffire LE User Guide 1.0  Samsung 2263UW Užívateľská príručka  Dynamisme 205 xp - Union Wallonne des Entreprises  Keyspan USA-49WG Computer Drive User Manual  iSimple DUALINK PGHFD1 User's Manual  LC-40/46LE/LU/LX814/824E/RU Operation-Manual FR  Feuchtemessgerät XM 120  

Copyright © All rights reserved.
Failed to retrieve file