Home

QualiPSo MOSST Operating Manual

1. string starts with gt Filter All b H M MACXIM PROS STATCVS STATSVM PRCS KalibroExtractionProc ess 54 y ES JabutiExtractionProc ess v O u v q E amp E page 1 of 1 Medi b WA MACXIM EXTRACTOR PRCS StatCVS StatSVN STATCVS STATSVN EXTRACTOR PRCS KalibroExtractionProcess JaBUTi JaBUTiExtractionProcess 14 4 Extraction Process Detail screen appears Click on Save and Execute button TH Example For evaluation using Macxim un B Dashboard Resources Analytical model Webome s4qadmin BE Behavioural Took User menu Y Kpi Model Extractors T Extraction Process Detail 152 5 Name EXTRACTOR PRCS T Description Dashboard Risorse Modelo analitica Modelo comportamentale Strumenti Menu utente Gestione KPI Extractors Extraction Process Detail Name MACKIM_EXTRACTOR_PRCS 5 Description 2 The extraction execution could take several time Do you want to proceed Coordinator class iteng spagodq extractors DefaultCoordinatar Periodicity 15 6 Progress meter appears on the screen In some cases internal processing may not be finished when progress meter completes N Spoqe 4 Dashboard HBorse T Modelo analitico Modell comportamentale 7 strumenti Menu utente Gestione KPI T Extractors E
2. Tools on the right put a check on evaluation tool Selected tool will be subject to execution of evaluation Select Macxim JaBUTi StatSVN CVS or Kalibro Some tools may not be available for selection depending on selection made in lt 3 gt and lt 4 gt URL of OSS project repository When evaluation is executed source code at this URL is checked out Repository user password Enter as required Revision eligible for checkout Enter existing revision 510 2 Repository type is cvs Insert Project Quality Report 1 c2 Insert Project Project Information Models Project Name Version Language Checkstyle lt 3 gt OMM The programming language MOSST OP2A License GNU General Public License GPL 2 From www opensource org Spago4Q Macxim Repository Information Type of repository Login svn lt 4 gt Logged in as s4gadmin Model Information Tools Information Model Tools 1 Mmosst O cvsanaly gt 5 L1 oMM lstatsvN cvs Bicho O junit C Kalibro 1 ET URL Ihttps checkstyle svn sourceforge net svnroot checkstyle trunk checkstyle src cl 6 apg E cS VU page E ae irr p gt lt 7 gt Revision number Start End dd mm yyyy dd mmiyyyy Other Informations Minor Release Pat
3. Gontents oftis utile st to 1 1 2 Intended audience of this document 1 1 3 ADOUEMOSS 1 1 4 About use oFMOSST Mu battu lestis 2 1 5 Re T Ro 2 CEN TERES 3 2 1 Measurement indicators supported for evaluation using MOSST 3 2 2 Operation OV EIMMICW ettet DT 4 2 2 1 Common operations for each 0000 000000 4 2 2 2 RN IU eR P snd 4 2 3 About OSS available for evaluation using MOSST 6 2 3 1 Registered information and evaluation 01 6 Oe Access toca h MOSOT 100 etie titii aio itia e HEEHHAE HEEL IE INIRE TERM Cade RIS 7 A Basicoperatons of MOSS xc e andas 8 4 1 RE 8 4 2 EXECUTING iiie e 14 4 2 1 Extracting project uode es i st rupe tesi demus 14 4 2 2 Preparing automated test for JaBUTi 17 4 2 3 Automated test for JaBU TI only ico aa inten Ooh eene e
4. QualiPSo MOSST Installation Manual 1 5 MOSST architecture Among several tools which MOSST involves Quality Platform and Spaga4Q are major operation interface used in basic steps up to evaluation result display Quality Platform Quality Platform displays the result obtained from each measurement tool in a comprehensive manner It has project registration feature intended for use by system administrator Spago4Q Spaga4Q is a BI tool mainly intended for system administrator It is used to extract analyze project information and performs other tasks actual processing is performed by each measurement tool and results are stored to database Measurement tools Measurement is performed based on registered project information and configured values Database Database stores project information and measurement results produced by each tool 4 Quality Platform Spago4Q j Macxim Displays evaluation result report for system administrator Kalibro Extracts project information for system administrator Analyze project information StatC VS StatS VN Project registration JaBUTI Database Measurement tools N 2 MOSST Overview 2 1 Measurement indicators supported for evaluation using MOSST Measurement indicators available for evaluation using MOSST are as follows code metrics Kalibro Repository statistics StatC VS StatSVN code metrics Macxim Test covera
5. 05 17 42 37 0 Kpi Value End Date Kpi 35 3302 Kpi Weight Kpi Weighted value Kpi Value Description Kpi Value Target Threshold Name commentlinesPerClass Threshold RANGE Problem im 0 0 20 0 Threshold RAMGE Warning m 200 5010 Threshold RANGE Good mi 50 0 90 0 30 6 Time line view ri opens time line view window in which temporal changes of KPI values can also be verified AX Kpi Comment Lines Per Class values trend for resource Checkstyle 5 3R2587 End Date 04 08 2011 35 pss 30 25 3 20 15 10 5 a a Wr m 5 5 e qe de S S QS lt 7 gt Save as PDF generates PDF file of evaluation result 31 6 Changing project This section involves operations performed by system administrator In general MOSST tool does not allow to change delete project once it is registered However if project name and version and revision are the same other project information can be overwritten using the same procedure described in section 4 1 Registering project 1 About changeable items If project name version and revision are the same other project information such as repository URL can be overwritten Example To change resource Checkstyle 5 0R2505 which has project name Checkstyle version 5 0 revision 2505 and repository type svn to the following registration Project name Checkstyle Version 5 0 Revision 25
6. E 2 028 Threshold RANGE Warning 38 8 Frequently asked questions about troubles FAQ 8 1 When executing Extractor on Spaga4Q 1 Irun Extractor for StatCVS on Spago4Q STATCVS STATSVN EXTRACTOR PRCS but evaluation report is not shown IllegalDataException is logged in catalina out byte string 0x1B may be included in commit log which OSS repository returns after execution of Extractor for StatC VS IllegalDataException occurs because 0x1B is not supported by jdom library which is bundled with StatC VS An example of 0x1B included in commit log is OSS project which uses JIS code set Japanese for commit log JIS code set uses a byte string which includes 0x1B as a code to switch between 1 byte characters and 2 byte characters As of August 2011 StatCVS used in MOSST does not support this case Information When this case is applicable the following exception is logged in catalina out Example After Extractor was run for StatCVS commit log was successfully retrieved from namazu s CVS repository cvs Q log but Java exception occurred while returned commit log was being analyzed 20 29 28 168 DEBUG ProcessWrapper 42 Starting process cvs Q log 20 30 00 039 DEBUG PSNCStatGenerator 55 Temp dir for statTool usr local tomcat temp statDir381914070418216938 20 30 00 039 INFO AbstractLog Tool 36 Executing stat task log usr local tomcat temp log4002628011430765802 projectDir tmp StatToolsServ
7. Spago4Q but evaluation report is not shown No log is generated in catalina out for checkout operation If your network environment requires Internet access via proxy server source code checkout may have failed Please verify if there is any error in proxy server settings 1 If repository type is svn please confirm that proxy server setting is correctly made for svn command with the following procedure a Set proxy server to root subversion servers file for svn command http proxy host Proxy server host name http proxy port Proxy server port number b Restart Tomcat 2 Ifthe problem still exists please confirm that proxy server setting is made correctly for JavaVM with the following procedure a Set proxy server to tomcat root bin setenv sh file for Tomcat JavaVM To CATALINA OPTS add DproxySet true DproxyHost Proxy server host name DproxyPort Proxy server port number Dhttp nonProxyHosts localhost b Restart Tomcat 3 Ifthe problem still exists please confirm that proxy server setting is made correctly with the following procedure a Set proxy server to etc profile file http proxy Proxy server URL Proxy server port number https Proxy server URL Proxy server port number b Restart Tomcat 4 Ifthe problem still exists please manually run svn or cvs command directly to see if source code can be checked out downloaded Example of svn svn co http svn ruby lang org r
8. Type of repository Login svn sim lt 4 gt Logged in as gamn ni fum ES 1 Logout Model Tools i 1 1 551 O osc cvsAnal gt 5 L1 OMM L statsvN Cvs O Bicho O junit C Kalibro 1 i gt m m Repository URL https checkstyle svn sourceforge net svnroot checkstyle trunk checkstyle src ct 6 p n e m mamn amn mammam mal mii ma ma m ami am m Gm mas a m mad E gt lt gt e s ea me a m aml mlml 40 Revision number 2587 Start End Minor Release Pattern Major Release Pattern CVS Connection Protocol pserver 2 Build Type 2 Insert Entry details 1 c2 lt 3 gt lt 4 gt lt 5 gt 6 lt gt lt 8 gt OSS project name OSS project version Programming language Select java or c c Repository type Select svn Tool selection Models on the left put a check on MOSST
9. eo STATCVS STATSVN EXTRACTOR PRCS v 4 Lj E KalibroExtractionProcess 2 L E JabutiExtractionProcess v Q Jj E v Q page 1 af 1 4 1 b Vil StatCVS StatSVN STATCVS STATSVN EXTRACTOR JaBUTi JaBUTiExtractionProcess 93 4 Extraction Process Detail screen appears Click on Save and Execute button Qu Example For evaluation using Macxim 8 Dashboard Resources Analytical model Webome s4qadmin BS Behavioural mocel Took User menu Model Extractors T Extraction Process Detail o B Hame EXTRACTOR PRGCS ll bashed Risorse Modelo analitiko Modello comportamentale Strumenti Menu utente Gestione KPI Extractors Extraction Process Detail Name MACXIM EXTRACTOR PRCS x Description x 2 The extraction execution could take several time Do you want to proceed Coordinator class it eng spagodq extractors DetaultCoordinator periodicity 24 6 Progress meter appears on the screen In some cases internal processing may not be finished when progress meter completes W Spogo 4 Qualips 2 Dashboard HBorse T Modelo analitico Modell comportamentae 7 strumenti Menu utente Gestione KPI T Extractors Extraction Process Detail Name MACXIM EXTRACTOR PRCS 3 De scription Extracting data please wait Coordinator class iteng spagodg extractors DefaultCoordinator Pe
10. the section of Spaga4Q of QualiPSo MOSST Installation Manual Example If the following project is registered resource name is Checkstyle 5 0R2505 Project name Checkstyle Version 5 0 Revision 2505 of Dashboard Resources 7 Analytical model Welcome s4qadmin Exit Behavioural model Y Toos 7 User menu 7 Kpi Model 7 Extractors 7 Axis 2 0R 961362 S Axis 2 0R961362RHEAD _ 5 2 Checkstyle 5 0R2505___ commons pool gt CppUnit 1 12 18582 DDD 3 3 12R 7209 DDD 3 3 12R7209RHEAD eclipse 3 5R 21051 eclipse 3 5R 21062 eclipse 3 5R 21075 62 42 42 02 2 02 02 02 42 0000000000 13 4 2 Executing evaluation Select evaluation tool and extract analyze project information Extract analyze operations are performed by Extractor processing of Spaga4Q tool In addition only JaBUTi requires automated test operation to take place between extraction and analysis 4 2 1 Extracting project information 1 Log on to Spago4Q as administrator 2 Select Spago4Q gt Extractors gt Extraction Processes and show list of evaluation tools 3 Click on Select button 9 of tool you wish to use for evaluation Example For evaluation using Macxim o 4C 48 Dashboard Resources Analytical model Welcome sdqadmin ES 0 Qui Behavioural model Y Took menu Medel Extractors Extraction Processes List 4 The value of the column Name gt
11. 05 Repository type cvs Changed Resource name Checkstyle 5 0R2505 remains the same and repository type cvs is overwritten 2 About unchangeable items Once registered project name version and revision cannot be changed any more Please register a new project Example To change resource Checkstyle 5 0R2505 which has project name Checkstyle version 5 0 revision 2505 and repository type svn to the following registration Project name Checkstyle Version 5 0 Revision 2600 Changed Repository type svn Resource name Checkstyle 5 0R2600 is registered as new resource 89 Registered information of project is available to verify by referencing database directly Database spago4q Table QPS PROJECT DETAIL 239 7 Changing KPI definition 7 1 Changing KPI threshold value MOSST allows to show graphical chart of OSS evaluation result by using KPI values in color coding of red yellow green etc multiple level evaluation By default sample threshold values provided by QualiPSo are set for evaluation Please change each threshold values in accordance with each evaluator s judgment criteria As an example this section describes procedure to change range of Warning in evaluation result 5 level evaluation Very good Good Regular Warning Bad from 3 1 4 7 to 2 8 4 7 as well as to change display color of Warning from orange to violet 1 Verifying current settin
12. 1 Extract project Refer to 4 2 2 2 Analyze Refer to 4 2 Verify evaluation result user Refer to 4 3 1 and 2 are operations performed by system administrator Part of the operations require login as system administrator For only viewing OSS evaluation result please refer to 3 2 2 2 Operation for JaBUTi Only for JaBUTi additional step is required between 2 1 and 2 2 described in the previous section 1 Register project system administrator 2 Execute evaluation system administrator 2 1 Extract project 2 1 1 Prepare for automated test Execute JaBUTi only Refer to section 4 2 2 1 2 Execute automated test 2 2 Analyze project 3 Verify evaluation result user Scheme m User Evaluator gt mSystem administrator tool 1 Quality lt 3 gt Quality Platform Platform 2 1 lt Extract analyze tasks gt lt 2 gt 2 Spago4Q are performed by Spago4Q measurement tool 21 1 2 1 2 5 egre GUI operation JaBUTi only This page is blank 2 3 About OSS available for evaluation using MOSST tool 2 3 1 Registered information and evaluation tool As described in the previous section MOSST tool requires registration of OSS project to be evaluated Evaluation tool can be selected at registration while different tools are available depending on OSS programming language repository type Please confirm t
13. QualiPSo MOSST Operating Manual March 2012 Information technology Promotion Agency Japan About this document This document describes MOSST one of the tools for evaluating reliability trustworthiness of OSS as well as the basic operation procedure up to showing the evaluation result of OSS Intended audience of this document This document is intended for IT system professionals who are involved in use of OSS The description in this document assumes that the reader has a basic knowledge of software development and installation About trademarks and registered trademarks The names of trades and products used in this document may be the trademarks or registered trademarks of respective owners Furthermore TM and R are not mentioned in each case in this document Change History 2011 8 24 Initial version 2012 3 30 English translation Limitations 1 About StatC VS As of August 2011 StatCVS does not support project which uses Japanese JIS code set for commit log StatC VS accesses commit log of OSS project to acquire statistical values which does not support 0x1B included An example of character code set which is subject to restrictions of this byte string 0x1B is JIS code set 2 About confirmed operating environment Operation has been confirmed only under local environment within the server Table of Contents le T m 1 1 1
14. commended memory size but it is possible to change it in accordance with user environment Please increase memory allocation size and verify if the problem can be avoided 1 tomcat root bin setenv sh At setting in CATALINA_OPTS Xms1024m Xmx1024m XX MaxPermSize 256m please increase memory allocation size Size of heap memory area can be set by Xms and Xmx Size of permanent memory area can be set by XX MaxPermSize Information Please also refer to QualiPSo MOSST Installation Manual 44 9 References e 55 http www qualipso org mosst champion e Spago4Q http www qualipso org spago4Q tool http www spago4q org http wiki spago4q org xwiki e Quality Platform http www qualipso org node 538 Kalibro http www qualipso org kalibro tool http ccsl ime usp br kalibro e StatCVS StatSVN http www qualipso org stat tools http www statsvn org http statcvs sourceforge net Macxim http www qualipso org macxim too http qualipso dscpi uninsubria it macxim http macxim qualipso org e http www qualipso org JaBU Ti tool 45
15. ee 17 4 2 4 Analyzing project 23 4 3 Veriiying evaluation Tes oti pole teca citas 26 5 Details of evaluation Tesull 29 SED decr 32 fae r 34 Tal G anding KP FtNreshold ia ides ut terea 34 8 Frequently asked questions about troubles 39 8 1 When executing Extractor on Spaga4 uoa ieee ee ele 39 8 2 When showing report of evaluation 43 8 3 ABIT r E UU T 44 9 References ECRIRE 45 1 Introduction 1 1 X Contents of this document OSS Open Source Software has gained wide application as fundamentals of IT systems and its trustworthiness and sustainability gains significant importance Furthermore evaluation from various perspectives should be required not only for quality of software itself but also for maintainability potential legal issues and support scheme of development community IPA participates in QualiPSo Quality Platform for Open Source Software network initiated by European Commission EC and facilitates tools for evaluating OSS trustworthiness under its interna
16. epos ruby trunk ruby Example of cvs cvs d pserver cvs Q2 pserver samba org cvsroot r SAMBA 2 2 samba If Unknown host pserver samba org or other error code such as the following 405 etc is returned the problem may reside in the network environment or repository you are connected to Please contact network or repository administrator for more information svn server sent unexpected return value 405 invalid method in response to PROPFIND request for repos ruby trunk 44 Information Please also refer to QualiPSo MOSST Installation Manual 42 8 2 When showing report of evaluation result 1 Report of evaluation result from the tool does not appear on Quality Platform or report is not updated to the latest data When evaluation result is possibly different from the previous occasion where result was shown recalculation of evaluation report is required Please verify if the problem can be avoided by the following procedure 1 Select Quality Platform Actions Quality Report Click on report you wish to show 2 Select Force Recalculation In Behaviour pull down select Force Recalculation and click on Execute Document on upper right Information Please also refer to 4 3 Verifying evaluation result in this document 43 8 3 Others 1 OutOfMemoryError is logged in catalina out Memory allocated to Tomcat JavaVM may be insufficient Installation Manual uses re
17. g with log display JaBUTiService GUI v1 1 BEGINNING SCRIPT EXECUTION WAIT UNTIL THE FIMISHED MESSAGE xxx EAM Processing and progress logs are shown 21 7 Once the message FINISHED appears all processes are completed Some projects may require several hours for this execution JaBUTiService GUI v1 1 Processing and progress logs are shown 8 Select Results tab and click on Send button which sends result to JaBUTi Web Service lt JaBUTiService GUI v1 1 mmm Endpoint http localhost 8080 jabuti service 1 0 services aBUTiServicel 0 wsdl Project 1044 128791506 ProjectList Configuration Execution Results Results Available Metric All Nodes ei 22 4 2 4 Analyzing project information For analysis run Extractor in the same manner as described in section 4 2 1 Extracting project information 1 Log on to Spago4Q as administrator 2 Select Spago4Q Extractors Extraction Processes and show list of evaluation tools 3 Click on Select button d of tool you wish to use for evaluation Example For evaluation using Macxim o 4 Qualips Dashboard Resources 7 Analytical model Wekome s4qadmin D Behavioural model Too amp User menu Medel Extractors Y Extraction Processes List M 4 The value of the column Name 2 string starts with Filter b b
18. ge JaBUTi lt Java code metrics Macxim evaluation example gt u q DS im Trust and Quality in Open Quality Platform for Open Source Softwares SOUrce Systems Home Qualipso Community Download Tools Actions 4 lt Quality Report Macxim Macxim Model Models OMM MODELLO KPI KPI CHART a MOST MXM Macxim OP2A 4 4 Actual Exploit in dev Maintainability 1 Q41 Analyzability For Maintenance Detailed Results 4 Q41 1 Code Documentation 4111 CommentlinesPereLOC 1 24 gt sisi M411 2 CommentLinesPerClass 35 34 Tes M41 1 3 Comment Lines Per Interface 15 56 EN Login 5i M4 1 1 4 Inline Comment Lines per 051 EN Class Username 4 1 1 5 Inline Comment Lines Per 9 Interface E M4 1 1 6 Missing Javadoc Comments 99 EE M 1 2 04 3 Code Quality 0 4 3 1 Classes Respecting Max eLOC 100 0 Login Login t 4 3 2 Methods Respecting Max eLOC 9996 NENNEN Al 2 2 Operation overview This section provides an overview of operations In addition to common operations only JaBUTi requires its particular step 2 2 1 operations for each tool OSS evaluation is performed in the following basic workflow 1 Register project system administrator Refer to 4 1 2 Execute evaluation system administrator 2
19. ge measurement will become inaccurate In order to avoid this problem at every measurement of test coverage Execute processing please clean the build environment by removing all assets which were generated by the previous build and rebuild the class files 4 2 3 Automated test for JaBUTi only It may take several hours to complete this process 1 Start JaBUTi Service GUI sh run sh or java jar jabuti service gui scripts 1 0 jar 2 Select Project List tab and click on Update button JaBUTiService GUI v1 1 Endpoint htt J localhost 8080 jabuti service 1 0 services aBUTiServicel 0 wsdl Project Project List Configuration Execution Results Project List This page is blank 18 3 The list of registered projects appears Select the project you wish to evaluate and select Configuration tab E JaBUTiService GUI v1 1 2 5 Endpoint ttp localhost 8080 jabuti service 1 0 services JaBUTiServicel O wsdl Project Project List Configuration Execution Results Saas Project List Name ate D 27768102090973 Log4J 1 2R791506 9539749860403 FreeChart 1 2 0RHEAD 4 Once required entries are made click on Create Update F button D JaBUTiService GUI v1 1 Endpoint http localhost 8080 jabuti service 1 0 services JaBUTiServicel O wsdl Project Log4 1 2R791506 ProjectList Configuration Execut
20. gs 1 On 5 Details of evaluation result screen click on Q9 of KPI threshold value O S 24 Trust and Quality in Open Quality Platform for Open Source Softwares OUrce Systems Home Qualipso Community Download Tools Kalibro Actions Quality Report C total nom Total Number of Methods 1593 0 1 gt Metrics Module Metrics Models acc Afferent Connections per Class 38718662 1 0 OMM ET O accm Average Cyclomatic Complexity 29980636 1 0 MOSST per Method E DOSE E amloc Average Method LOC 21623445 10 gt E anpm Average Number of Parameters 14197135 1 0 EE TON per Method cbo Coupling Between Objects 38718662 L0 E 7 SpagotQ dit Depth of Inheritance Tree 0 0 1 0 r 7 E M 27 34 2 On pop up screen verify current KPI value and KPI threshold display settings Technical Data Kpi value Begin Date 2011 08 17 17 33 36 0 Kpi Value End Date Kpi Weight T Kpi Weighted value 2 680636 Kpi Value Description Epi Value Target gt Threshold Name kalibro ACOM Threshold Threshold RANGE very good 0011 Threshold RANGE Good aM 11 20 Threshold RANGE Regular E 2 03 1 Threshold RANGE Warning M3147 3 In this example KPI value 2 99806350668687 Regular range 2 0 3 1 yellow colored Warning range 3 1 4 7
21. ice RepoHolder namazu stable 2 0 namazu out usr local tomcat temp statDir381914070418216938 2011 07 29 20 30 00 net sf statcvs Main generateDefaultHT MLSuite u8b66 u544a Log and working copy are out of sync Reports will be inaccurate 20 30 00 590 ERROR Stats ToolsExtractor 138 Generate statistics error psnc se extraction err ExtractionException org jdom lllegalDataException The data Add 5 9 82 2 namazu dev 1088 is not legal for a CDATA section Ox1b is not a legal XML character at psnc se extraction PSNCStatGenerator generateStatistics PSNCStatGenerator java 62 at psnc se extraction Stats ToolsExtractor analyzeOne Stats ToolsExtractor java 131 at psnc se extraction Stats ToolsExtractor extractOne Stats ToolsExtractor java 103 at psnc se extraction ws ExtractionManager analysisRun ExtractionManager java 155 at psnc se extraction ws ExtractionManager AnalysisTask call ExtractionManager java 189 at psnc se extraction ws ExtractionManager AnalysisTask call ExtractionManager java 1 76 at java util concurrent Future Task Sync innerRun Future Task java 303 at java util concurrent FutureTask run FutureTask java 138 at java util concurrent ThreadPoolExecutor Worker runTask ThreadPoolExecutor java 886 at java util concurrent ThreadPoolExecutor Worker run ThreadPoolExecutor java 908 at java lang Thread run Thread java 662 40 2 Irun Extractor of evaluation tool on
22. ion Results Mandatory JaBUTi Release webapps jabuti service 1 0 jabuti service gui scripts jabuti release Jabuti bin jar Directory with original classes Directory of test script Directory of test output Command to execute the tests 4 Project ID in Spago4Q Log4J 1 2R791506 Optional ORIG_JAR Browse INSTRUM_JAR Browse Create Update F Entry details Required entries only 1 Directory with original class Path for directory under which test target classes are located 2 Directory of test script Directory under which command specified in 4 is executed 3 Directory of test output Output path for trace file trc 4 Command to execute the tests Execution command of test scripts 19 5 Select Execution tab and click on Execute button Furthermore if execution involves a project to which this automated test has once been performed the project has to be rebuilt as described in section 4 2 2 Preparing automated test for JaBUTi only EJ JaBUTiService GUI v1 1 Er Endpoint http localhost 8080 jabuti service 1 0 services aBUTiServicel 0 wsdl Project Log4 1 2R791506 Project List Configuration Results 20 lt 6 Measurement by JaBUTi starts Replacement to Class files to which coverage measurement processes are embedded execution of automated test and collection of coverage data are performed alon
23. lower left of the top page enter Username Password and click on Login Please refer to the section of Quality Platform in QualiPSo MOSST Installation Manual Login 2 When login is successful Insert Project appears on Actions menu Click on Insert Project Q U 5 Sa Trust and Quality in Open Quality Platform for Open Source Softwares Source Systems Home Qualipso Community Download Tools Actions Welcome on the QualiPSo Integrated Tools Platform Quality Report Perform Actions Models Show Quality Reports amp OMM Insert a New Project MOSST OP2A 3 On Insert Project screen enter required data such as repository URL Once required entries are made and Insert is clicked project information is stored to database The following part describes major items for repository types of svn and cvs respectively 1 Repository type is svn n a S ds Trustand Quality in Open Quality Platform for Open Source Sotware SOurce Systems Home Qualipso Community Download Tools Aon Insert Project Quality Report lt 1 gt lt 2 gt Insert Project Project intormat Models Project Name Language Checkstyle 5 3 java gt c3 OMM The programming languag MOSST OP2A License GNU General Public License GPL E From www opensource ordg Detailed Results Spago4Q Macxim Repository Information
24. nt Lines per Class Username M4 1 1 5 Inline Comment Lines Per Interface El M4 1 1 6 Missing Javadoc Comments 4 7 04 3 Code Quality B M4 3 1 Classes Respecting Max eLOC Login perc E M4 3 2 Methods Respecting Max eLOC COEZENSM CS If evaluation result is not shown Macxim Macxim Model CHART 1 24 g 7 EN ERN ol 00 ERN 7 00 35 34 15 56 0 51 1000 99 96 eee o Processing described in section 4 2 Executing evaluation may not be completed Please retry after some time To show result again please select Force Recalculation at Behaviour 28 5 Details of evaluation result This section describes details of evaluation result Example Details of report of Checkstyle 5 0R2505 which has been evaluated using Macxim Q u q OS n Trust and Quality in Open Quality Platform for Open Source Software Source Systems Home Qualipso Community Download Tools Actions Quality Report Macxim Macxim Model Models RISORSA Checkst OMM MODELLO KPI KPI CHART T MXM Macxim OP2A 4 QF4 Actual Exploit in dev Maintainability 1 04 1 Analyzability For Maintenance Detailed Results 1 Q4 1 1 Code Documentation Spago4Q M4 1 1 1 Comment Lines Per eLOC 124 tiran M411 2 Comment Lines Per Cla
25. odel Behavioural model Y Toob Extractors 7 Threshold Values Detail Position 3 Label Regular Min Value 20 Closed Set Max VAlue 31 Closed Set p Value 36 This page is blank 587 6 Show evaluation result again in accordance with steps described in 7 1 Verifying current settings of this section and verify changes u q O S r Trust and Quality in Open Quality Platform for Open Source Sofware X Source Systems Home Qualipso Community Download Tools Actions total nom Total Number of Methods 15930 4 J Module Metrics Module Metrics Quality Report Models acc Afferent Connections per Class 3 8718662 1 0 OMM accm Average Cyclomatic Complexity 29980636 10 o pm MOSST per Method OP2A amioc Average Method LOC 21623446 10 F Detailed Results anpm Average Number of Parameters 14197135 10 Method vt 0 cbo Coupling Between Objects 938718662 L0 F Spago4Q dit Depth of Inheritance Tree 0 0 1 0 Technical Data Kpi Value Begin Date 2011 08 17 17 33 36 0 Kpi Value End Date Kpi 2 99006350668687 Kpi Weight 1 0 Kpi Weighted value 2 9980636 Kpi Value Description Kpi Value Target Threshold Name Kalibro ACCM Threshold Threshold RANGE Very good Woo Threshold RANGE Good 1 120 Threshold RANGE Regular
26. ools available for evaluation with the following table SVN StatSVN CVS Kalibro StatSVN CVS JaBUTi CVS StatSVN CVS StatSVN CVS JaBUTi Example 1 For OSS using programming language C C and repository type CVS Tool available for evaluation is StatSVN CVS Example 2 For OSS using programming language Java and repository type SVN Tools available for evaluation are StatSVN CVS JaBUTi and Macxim 3 Access to each MOSST tool Examples of startup URL startup command are shown below These examples are access information applicable to installation made in accordance with QualiPSo MOSST Installation Manual Example startup URL Spago4Q http Host name Port number SpagoBl Quality Platform http Host name Port number quality platform StatCVS StatSVN http Host name Port number StatToolsService cacheManager Macxim http Host name Port number macxim Example startup command Kalibro java jar KalibroDesktop jar java jar JaBUTi service gui scripts 1 0 jar JaBUTi or sh run sh 4 Basic operations of MOSST Sections 4 1 Registering project and 4 2 Executing evaluation involve operations performed by system administrator For operation performed by user please refer to section 4 3 Verifying evaluation result 4 4 Registering project From Quality Platform register OSS to evaluate 1 Start and log on to Quality Platform At Login section on
27. orange colored can be observed 2 Change settings Change boundary so that the current Regular KPI value 2 9980636 is made to Warning In addition change display color of Warning in chart to violet Current display 5 levels VeryGood Good Regular Warning Bad ccm Average Cyclomatic Complexity 29980636 10 AP per 2 9980636 1 0 Expected display after change ccm Average Cyclomatic Complexity 29980638 10 per MO 9 ii 1 Log on to Spago4Q as administrator 2 Select Spago4Q gt KPI Model gt Threshold Definition and show Thresholds List Ki 4 Qualips EO Dashboard Resources 7 Analytical model Behavioural model Toob 7 User menu 7 Kpi Model Welcome s4qadmin 1 9 Exit Extractors Y KPI Definition 8 Threshold Definition Functionality Tree 8 Browser 7727 Root 38 9 Model Instance Ej 1 Monitoring 27 Tools lj Resources Definition 4 99 Alarms Management 3 From Thresholds List select Code of KPI threshold value you wish to change and then click on Threshold values button 35 B Dashboard Resources Y Analytical model Behavioural model Toob User menu Kpi Model Welcome s4qadmin ES D Extractors MAJOR REL TH MAJOR REL TH Q MINOR REL TH MINOR REL TH LOC CHANGE PER YEAR TH LOC CHANGE PER YEAR TH A Kalibro Generic Threshold Kalib
28. riodicity 2 Processing status can be confirmed on log file Example log file tomcat root logs catalina out tomcat root logs SpagoBl log This operation allows analysis of measurement data produced by each tool using the process described in section 4 2 1 Extracting project information and later Once this execution completes evaluation result can be verified 25 4 3 Verifying evaluation result Verify result of OSS project evaluation 1 Show list of evaluation reports Select Quality Platform Actions Quality Report and show list of evaluation reports Select OSS s report you wish to verify from table Example To view report of Checkstyle 5 0R2505 which has been evaluated using Macxim 9 WS Trust and Quality in Open Quality Platform for Open Source Softwares Source Systems Home Qualipsa Community Download Tools Actions PROJECTS REPORTS Quality Report APR anonsvnRHEAD StatSVN Models Ant 1 8 18961732_______ ___L_____ i MOSST Q7 E CppUnit 1 12 1R582 Stats VN Kalibro OP2A Verify evaluation result Result display entry form appears Usually leave Behaviour blank and click on Execute Document on upper right If Force Recalculation is selected at Behaviour recalculation i
29. ro Generic Threshold AR Kalibro ACC Kalibro ACC Threshold Kalibro ACCM Kalibro ACCM Threshold Q Kalibro AMLOC Kalibro AMLOC Threshold 9 Kalibro ANPM Kalibro ANPM Threshold Kalibro CBO Kalibro CBO Threshold Kalibro DIT Kalibro DIT Threshold Q Kalibro LCOM4 Kalibro LCOM4 Threshold A Kalibro LOC Kalibro LOC Threshold Q Kalibro MMLOC Kalibro MMLOC Threshold Kalibro NOA Kalibro NOA Threshold Kalihra NOC Kalihra Threshold Q 4A From Threshold Values List select Position and click on Select button Q _NSpoge 4 Dashboard Resources Analytical model Behavioural model Y Toob Usermenu KpiModel Welcome 4 Extractors Threshold Values List nS KN 4 The value of the column Position asa string starts with Filter All Min Value Max VAlue L Very good 0 0 11 Q 2 Good 11 20 3 Regular 2 0 31 E 4 Waming 3 1 41 2 5 Bad 47 94 Q page 1041 b bi 5 Settings are available for changes in Threshold Values Detail Once Select is clicked in Color section Select Color screen appears and color settings become available for change For Regular set Min Value to 2 0 and Max Value to 2 8 For Warning set Min Value to 2 8 and Max Value to 4 7 Set Color to violet and then click on Save button B E Dashboard Resources 7 Analytical m
30. s performed and result is shown Please select this option when evaluation result is possibly different from the previous occasion where the result was shown U q DS at Trust and Quality in Open Er Open Saee Source Systems Home Gualipso Community Download Tools cions me Quality Report Fill form below and click on the inp rightbutien execute he document RI T v a rg gt 1 1 Models Register Values 1 1 Behaviour I Date _ 880 ec Ug 17 MOEST _ Detiled Result Customized views Enpago4t descriplion cer crealion dale lat mocilication cate viability Login Document has no custonized views 26 This page is blank 27 Evaluation result appears Trust and Quality in Open Source Systems Qualips Quality Plattorm for Open Source Software Home Qualipso Community Download Tools Actions Quality Report Models RISORSA Checkstyle 5 3R2587 OMM MODELLO EMO MXM OP2A QF4 Actual Exploit in dev Maintainability 1 Q41 Analyzability For Maintenance Detailed Results 4 Q4 1 1 Code Documentation 4 1 1 41 Comment Lines Per eLOC Spago4Q M4 1 1 2 Comment Lines Per Class E M4 1 1 3 Comment Lines Per Interface Login M4 1 1 4 Inline Comme
31. ss 3534 M4 1 1 3 Comment Lines Per Interface 15 56 Q L Login 7 M4 1 1 4 Inline Comment Lines per 051 p Class 9 Username M4 1 1 5 Inline Comment Lines Per 0 0 No Interface 2 5572 m El M4 1 1 6 Missing Javadoc Comments 0 E 2 2 04 3 Code Quality A 4 i 6 Login U eem M432 MethodsRespec ng Max eLOC gg gg m 7 4 z 4 Y 4 2 55 7 7 d Pd Pd Ci E M4 1 1 2 Comment Lines Per Class 35 34 a 1 gt lt 2 gt 3 lt 4 gt lt 5 gt 6 29 Description of each part 1 The color indicates which range in threshold area the current KPI value exists The color represents the position where black line of KPI chart described in 4 terminates 2 Model Instance name evaluation scale In this example comment lines per class 3 KPI value 4 KPI chart Threshold example Red Problem Yellow Warning Green Good Black line Actual KPI value lt 5 gt KPI overview T opens KPI overview window in which threshold values described in lt 4 gt can also be verified X KPI Overview ES Kpi Mame Comment Lines Per Class Kpi Code commentLinesPerClaes Description T KPI Interpretation T Model Instance T Technical Data 5 Kpi Value Begin Date 2011 06
32. tern Major Release Pattern CVS Connection Protocol pnr 1 __________________ gt 9 Build Type edt Entry details 1 c2 lt 3 gt lt 4 gt lt 5 gt lt 6 gt lt gt lt 8 gt lt 9 gt OSS project name Enter folder name which exists in repository In StatCVS a folder which has this project name is accessed to check out project Project cannot be checked out if there is no folder with its project name Please ensure to specify project name which has been registered to CVS repository OSS project version Programming language Select java or c c Repository type Select cvs Tool selection Models on the left put a check on MOSST Tools on the right put a check on evaluation tool Selected tool will be subject to execution of evaluation Select Macxim JaBUTi StatSVN CVS or Kalibro Some tools may not be available for selection depending on selection made in lt 3 gt and lt 4 gt URL of OSS project repository When evaluation is executed source code at this URL is checked out Repository user password Enter as required Revision eligible for checkout Enter existing revision CVS connection protocol Select pserver extssh pserverssh2 or ext uos 4 Verify registered information from Spago4Q Log on to Spago4Q as administrator and select Models gt Resources Definition to show list Verify registered project Please also refer to
33. tional cooperation This document describes basic operations of the tools named MOSST for its use in OSS evaluation For other function details which are not covered by this document please refer to relevant documents such as user manual of each tool 1 2 Intended audience of this document This document is intended for IT system professionals who are involved in use of OSS The description in this document assumes that the reader has a basic knowledge of software development and evaluation 1 3 About MOSST MOSST Model for OSS trustworthiness is an open source software trustworthiness model designed for evaluating quality of OSS products in a quantitative manner MOSST provides various analyses for source code as well as user interface with which analysis result can be visually presented MOSST involves the following tools Spago4Q Evaluation result visualization tool Quality Platform Web interface for evaluation tools Kalibro C code metrics measurement tool StatCVS StatSVN Repository statistics measurement tool Macxim Java code metrics measurement tool JaBUTi Test coverage measurement tool For details of each tool used by MOSST please refer to the following QualiPSo website lt http www qualipso org mosst champion gt 1 4 About use of MOSST Tools for use of MOSST are available for download at the following URL lt http www qualipso org mosst champion gt For details on how to install them please refer to
34. xtraction Process Detail Name MACXIM EXTRACTOR PRCS De scription e eS Coordinator class ite ng spagoedq extractors DefaultCoordinator Periodic ity Processing status be confirmed on log file Example log file tomcat root logs catalina out tomcat root logs SpagoBl log This operation provides access to repository URL registered in section 4 1 Registering project to check out source code Only for JaBUTi checkout uses OS command operation For details please refer to the next section and beyond 16 4 2 2 Preparing automated test for JaBUTi only JaBUTi tool allows to measure test coverage of Java programs Project environment for executing automated test build environment for project and test scripts is required to be prepared and built by the user prior to test execution For details on how to prepare and build environment and on how to run test scripts please refer to information provided by each OSS project respectively Precautions for the 2nd or later Execute processing While test coverage measurement is being executed during Execute processing JaBUTi tool embeds its proprietary processing which is designed for coverage measurement onto the class files class being tested Once it is completed and if measurement is executed once again the above class files will produce inconsistency and the result of test covera

QualiPSo MOSST Operating Manual

Contents

Download Pdf Manuals

Related Search

Related Contents