Home

Aeolus Level 2b Processor Software Verification & Validation Plan

image

Contents

1. OLUS SCENENE wind Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 52 54 Doc Title Verification Validation Plan Aeolus Level 2B Processor Software requirement Test Case Name Verifi cation Method Software Component remark L2BP 720 Each L2BP product shall annotate quality statistics as specified in the Aeolus L2B L2C processor IODD AD 8 L2bP_OPT_01 L2BP L2BP 730 Each L2BP product shall contain a Main Product Header as specified in the Aeolus L2B L2C processor IODD AD 8 L2bP_OPT_01 L2BP L2BP 740 Each L2BP product shall contain a Specific Product Header as specified in the Aeolus L2B L2C processor IODD AD 8 L2bP_OPT_01 L2BP L2BP 760 Each L2BP product shall contain at least one Data Set Descriptor as specified in the Aeolus L2B L2C processor IODD AD 8 L2bP_OPT_01 L2BP L2BP 770 The L2bP shall be capable of processing a full orbit worth of L1B data EE or BUFR format within 30 min tbd on the specified reference target platform L2bP_PERF_01 T L2BP L2BP 780 The L2BP shall be run on a single processor Pentium 4 PC clock rate 2 5GHz with a minimum of 256 Mbytes of free RAM space and 500 Mbytes of free disk space L2BP_GEN_01 check the hardware L2BP 790 The L2BP shall be programmed in Fortran90 and or Ansi C C and or Mahom ama ei L2bP_GE
2. cp JobOrder test12 xml JobOrder FAT_test xml Edit JobOrder FAT_test xml and point it to any valid L1B file that needs to be tested L2B_processor JobOrder FAT_test xml gt textoutput txt Verify L2BP 250 and L2BP 520 by observing that the above commands produced a valid L2B product file named AE_TEST_ALD_U_T_2B DBL HDR Verify L2BP 270 by observing in the textoutput txt file that all Aux_Par file settings present in the input file AE_TEST_AUX_PAR_2B 20050112T000000_20110112T0 00000_0012 EEF are printed on lines starting with L2BP_Settings L2B_AuxPar If desired edit this file run the processor again and observe that the changed entries are imported in the software Verify L2BP 280 by observing that the Aux_Clim file named AE_TEST_AUX_CLM_AX_20050331T000000_20111231T0 00000_0000 DBL HDR is read not yet implemented Verify L2BP 290 by observing that the Aux_RBC file named AE_TEST_AUX_RBC_AX_20060703T123456_20070703T1 23456_0001 is read search for the string Load_Rayl_Brill_Tables in the textoutput txt file Verify L2BP 300 by observing that the Aux_Met file named AE_TEST_AUX_MET_12_20041201T000000_20041201T0 03000_0001 is read search for the string reading aux met data in the textoutput txt file Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 25 54 Doc Title Aeolus Level 2B Processor Software Verification
3. Procedure Command comments Observations passed failed t b d Table 4 19 test procedure for test L2bP_TOOLS_04 4 19 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 19 are passed and failed otherwise Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 42 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan A Verification Cross Reference Matrix A verification cross reference matrix VCRM provides a mapping between the L2bP requirements as listed in AD 7 the software components that satisfy them and the test cases that will be used to verify them The L2bP VCRM has several columns Software Requirement Test Case Name Verification Method and Software Component remark Their meaning and possible entries in the matrix are described in detail below e Software Requirement This column provides the number and text of all the requirements specified in the Aeolus L2bP and End To End Simulator Software Requirements Specification Document AD 7 e Test Case Name This column cross references the Software Requirement in the first column with the test case that will be used to show that this requirement is satisfied The identifiers used in the matrix for these test cases are summarised in Table 3 2 e Verification Method This column s
4. L2bP_OPT_01 the L2BC_file_handling module L2BP 120 The L2BP software delivery shall include a tool for graphical display of XX data from a L1b product T12 L2BP 130 The L2BP software delivery shall include a tool for graphical L2bP_TOOLS_02 D 1 Criteria for valid observations are specified in the Aeolus Level 2B Processor design document RD 1 The criteria include no process decisions based on invalid or missing data OLUS sense ne wind Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 46 54 Doc Title Verification Validation Plan Aeolus Level 2B Processor Software requirement Test Case Name Verifi cation Method Software Component remark display of calibration data from Auxiliary Calibration products L2BP 140 The L2BP software delivery shall include the input data and output products used in the L2BP factory acceptance test L2bP_DEL_01 R amp I L2BP 150 The L2BP software delivery shall include the installation scripts and tools required to execute the L2BP factory acceptance test and evaluate the test results L2bP_DEL_01 FAT script L2BP 160 One representative set of input Auxiliary Data Files shall be provided with the L2BP system delivery L2bP_DEL_01 R amp I L2BP161 The L2bP software shall include functionalities to generate or update any L2B input
5. passed failed With a text editor open the file textoutput txt created during the L2bP_HMI_01 tests described in section 4 7 Verify L2BP 340 by searching for the string I and observing that some examples have been printed to stdout Verify L2BP 350 by searching for the string P and observing that some examples have been printed to stdout Verify L2BP 360 by searching for the string W and observing that some examples have been printed to stdout Verify L2BP 370 by searching for the string E and observing that some examples have been printed to stdout the order type Backlog Processing in the JobOrder file generates an error at the moment which can be used for this example even though the processor ignores it only if an error is provoked Alternatively some dedicated code might be added to enable triggering such conditions not yet implemented Verify L2BP 380 by searching for the string D and observing that some examples have been printed to stdout not in use yet close the text editor Rerun the command L2B_processor JobOrder test12 xml in directory BUILD Test main as specified in Table 4 7 Verify L2BP 450 by giving akill or terminate signal type control c when the above command is running and observing that the processing is aborted Note that the verification of L2BP 310 in Table 4 7 already showed that under normal circumstance
6. 29 11 2005 AE SW ESA GS 023 AD 4 ADM_Aeolus Implementation of Level 2B 2C Processing Facility Technical Requirements Issue 1 1 06 06 2004 XADM GSEG EOPG RD 04 0003 AD 5 ADM Aeolus PCD ECMWF Interface Control Document Issue 1 5 18 10 2006 XADM GSEG EOPG ID 04 0002 AD 6 Earth Explorer ground Segment File Format Standard Issue 1 4 13 06 2003 PE TN ESA GS 0001 AD 7 Aeolus Level 2B Processor Software Requirements Document Issue 1 0 04 12 2006 AE RS ECMWF L2B 001 AD 8 ADM Aeolus Level 2B 2C Processor input output data definitions interface control document issue 1 2 11 12 2006 AE IF ECMWF L2BP 001 previously labelled as RD4 AD 9 Aeolus Level 2B Processor External Interface control document issue 1 0 11 12 2006 AE IF ECMWF L2BP 002 previously labelled as RD5 2 1 Reference Documents RD 1 Aeolus Level 2B Processor Design Document Currently referred to as Definition of Baseline Aeolus Level 2B Processing and Design Issue 1 2 09 09 2005 AE TN ECMWF L2B 0022 RD 2 Level 1B Input Output data definitions interface control document issue 3 0 31 07 2006 ADM IC 52 1666 RD 3 Aeolus Level 2A Processor Input Output data definition issue 01 09 2006 AE IF DLR L2A 004 RD 4 Aeolus Level 2B Algorithm theoretical baseline document Currently referred to as Mathematical description of the Aeolus Level 2B Processor Issue 2 0 05 12 2006 AE TN ECMWF L2P 0023
7. RD 5 Aeolus Level 2B Processor Software User Manual issue 1 2 07 12 2006 AE MA ECMWF L2BP 002 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 10 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 2 2 variable names In this section some names are defined that are used in several places in this document and which change for each new software delivery The definition of these names in this place makes it possible to refer to them in the remainder of this document which makes maintenance of this document much easier variable name variable definition L2BP_source L2BP_Release1 2a_source_20070125 tar gz L2BP_datapack L2BP_Release1 2a_datapack_20070125 tar gz L2BP_TDS L2BP_Release1 2a_TDS_20070125 tar gz Table 2 1 2 3 Acronyms ADM Aeolus ATBD BUFR CLI COTS EE2BUFRGuide ESA ESTEC ExtICD FAT FWHM HLOS ICD IODD LOS RMA SNR SRD SRN SUM TLE VCRM Atmospheric Dynamics Mission Aeolus keeper of the winds Algorithm Theoretical Baseline Document Binary Universal Form for Representation of data Command Line Interface Commercial Off The_Shelf software Earth Explorer to BUFR conversion tool guide European Space Agency European Space Research and Technology Centre Excternal Interface Control Document Factory Acceptance Test Full Width Half Maximum Horizontal Line Of Sight Interface
8. Validation Plan Procedure Command comments Observations passed failed Verify L2BP 301 by observing that the Aux_Cal file named t b d is read not yet implemented Verify L2BP 330 by observing that a proper exit code as defined in the L2b External ICD AD 9 is produced when the processor ends not yet implemented Verify L2BP 500 by observing that all complete observations in the input L1B product file have been processed and written to the L2B product file Check the number of available observations BRC s in the L1B input product by checking the Total Num ot Observations field of the SPHin the L1B product headerfile Check the number of processed observations BRC s in the L2B product by searching for the string nr of processed BRC in the file extoutput txt file Also check the Num_BRC field of the SPHin the L2B product headerfile Edit the file JobOrder FAT_test xml to limit the timerange of the L1B products to be processed and run the processor again L2B_processor JobOrder FAT_test xml gt textoutput txt Verify L2BP 510 by observing that all observations in the given timerange have been processed note that the timerange selection is not yet implemented in the L2BP The L2BP will always process all observations in the L1BP which is not in violation of the formulation of this requirement i e there is no requirement to not process observati
9. or all of them if time permits and observe that they are programmed in one of the permitted languages Fortran90 c c csh sh Python or Make Verify L2BP 800 by opening the design document RD 1 and verify that all non standard Fortran90 calls which are all collected in thedifferent compiler_features_ F90 modules in directory support are listed this is currently not yet the case Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 19 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed Verify L2BP 810 by starting the matlab package using the command matlab nodisplay and observe that the software version is 7 0 0 0 or newer Table 4 3 test procedure for test L2bP_GEN_02 4 3 6 Pass fail criteria The test is considered passed if all requirement tests mentioned in the above Table 4 3 are passed If one of them fails this test is considered to have failed 4 4 Test L2bP_GEN_03 This test procedure verifies the installation of the L2bP software 4 4 1 Purpose Test L2bP_GEN_03 verifies requirements L2BP 20 GEN 80 L2BP 80 L2BP 230 4 4 2 Prerequisites The L2bP software package and documentation must be copied onto the test platform 4 4 3 Input Specification All commands are entered by the operator via Linux command line 4 4 4
10. 001 V1 1 30 01 2007 48 54 OLUS Doc Title EE Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Verifi Software Name cation Component remark Method L2BP 335 The L2BP shall produce a L2bP_EXT_01 T L2BP Product List file for each L2BP processing Job Order as defined in the Aeolus L2B External ICD AD 9 L2BP 340 The L2BP shall provide L2BP L2bP_EXT_03 T L2BP not in use yet Informational messages on the stdout and or stderr stream L2BP 350 The L2BP shall provide L2BP L2bP_EXT_03 T L2BP Progress messages on the stdout and or stderr stream L2BP 360 The L2BP shall provide L2BP L2bP_EXT_03 T L2BP Warning messages on the stdout and or stderr stream L2BP 370 The L2BP shall provide L2BP L2bP_EXT_03 T L2B Error messages on the stdout and or stderr stream L2BP 380 The L2BP shall provide L2BP L2bP_EXT_03 T L2BP not in use yet Debug messages on the stdout and or stderr stream L2BP 381 It shall be possible to write 2 H log warning error messages to alog file for use when the L2bP is not operated via the ThinLayer L2BP 382 It shall be possible to generate H a short log file messages for low level processing steps suppressed L2BP 383 It shall be possible to view L2bP_EXT_01 D Run inside the ThinLayer log warning error data during and observe the log execution of a processing run messages L2BP 3
11. 6 3 INPUT SPOCIICAt OM EE 23 4 6 4 Specific Test Procedure ooomconiccnncninncccnnncccnnccnnn nc 23 4 6 5 Output Specificatii siirrossa a ceases EENS EES de a 24 4 6 6 Pass tail Gerges Ed EES ie 24 4 1 Test C20P_AM OT tati EA 24 AEN PUIPOSO anes a 24 Ed UE 24 4 7 3 INPUt Specification 24 4 7 4 Output Specification E 24 4 7 5 Specific Test Procedure speserei ea iaaa aai 24 4 76 Pass tall Cite llista tada lorena stated 26 4 8 Test L2bP CA RA EE 27 4 8 1 le Le 27 E EE 27 4 8 9 Input SPOCHICATIO EE 27 4 8 4 Output Specification ooonnnninnidinniicnnnnnnnnccccrncccnccnnnrcrrnr 27 4 8 5 Specific Test Procedure ici tite eee he a a E rA Aa Eaa 27 LSO Passitall Criteria E 28 GE E a WEE 28 4 91 RUIDOS O omic ici anta 28 E UE 28 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 5 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan E Ree ten Le Ur EE 28 4 9 4 Output Ee e len EE 28 4 9 5 Specific Test Procedure ici o die ete ene eed ane 28 4 9 6 Pass falll Criteria iii bd 29 410 Test LOOP EXT 08 pica ti 29 AMO PUTOS it tao 29 4 10 2 Ee LEE 29 4 10 39 Input Specification iii is Ee 29 4 10 4 Output Specification rancia aena nn rnnnrrrn 30 4 10 5 Specific Test ProCeQune iii tai ada 30 4 10 6 Pass fail criteria ono od coda 31 4 11 Test L2DP PROD OT di aida idad 31 411 1 die 31 dTi Prerrequisito Sennan 31 411 3 Input SpecificatloM eitasia idas 31 4 11 4 Output
12. Page AE PL KNMI L2BP 001 V1 1 30 01 2007 45 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Name Verifi cation Method Software Component remark exceptions GEN 110 When a mathematical exception has been triggered a warning log msg will be issued if execution is allowed to continue L2bP_GEN_04 all modules GEN 120 When a mathematical exception has been triggered a warning log msg will be issued if execution is terminated L2bP_GEN_04 all modules GEN 130 Error and warning msgs will identify the module or function where the exception occurred when possible L2bP_GEN_04 all modules L2BP 30 The L2BP shall process to completion each JobOrder for which valid L1B observations are available L2bP_HMI_01 T L2BP L2BP 80 The L2BP software shall be delivered as source code including all scripts and libraries required for the installation L2bP_GEN_03 L2BP L2BP 90 The L2BP software delivery shall include a tool for viewing the contents of each input Auxiliary Data File L2bP_TOOLS 01 D the different TestRead tools L2BP 100 The L2BP software delivery shall include instructions for constructing a Job Order L2bP_EXT_02 R amp I L2BP 110 The L2BP software delivery shall include a tool for viewing the contents of each L2BP product
13. Specificatii aia ie ev cde 31 4 11 5 Specific Test ProCeQure nessis aiia iaai ai 32 411 6 Passitall Clear nda a 33 4 12 Re RE 33 Are PUNO ii 33 EE LEE 33 4 12 3 Input SPECI CAL LO E 33 a elt e Eege Le EE 33 4 12 5 Specific Test Procedure ccecccceccccceeeceeneeeeeeeeceaeeeaaeeeseeceaeeeeaeeeeeaeeseeeeeseaeseeaaeseeneessaees 33 4 1 2 6 Pass fall COSTA iniciarte traido 34 4 13 Test L2bP PROD O viii io aa 34 AO RUIDOSO od a con 34 4 132 EE TEE 35 4 13 3 Input Specification iii ade 35 4 13 4 Output Specification is id id 35 4 13 5 Specific Test e UE 35 SE Ee leese eege gees gees geed dE ee eege 35 4 14 Test L2bP OPT O cucinino alar idea ar da dd dies fist 35 AAA e 35 Ee LEE 35 414 3 Input Specific criid id iii 36 4 14 4 Output Specification nda ir lan idle cm leiinde 36 4 14 5 Specific Test Procedure cececccceccceceeceeneeeeeeeeeeaeeeaaeeeseeeeeaeeseaeesseaeeseeeeeseaeeeeaaesseneessaees 36 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 6 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 146 Pass fail Criteria e 37 4 15 Test E2pP PERF A 37 D ge Reie 37 415 2 EE LEE 37 4 15 3 Input SpeciticatiO EE 37 4 15 4 OUTPUT Specificato Messinaan a Ea R 37 4 15 5 Specific Test Procedure nnns 37 4 15 6 Pass fail Criteria E 37 4 16 Test bk TOOLS Oloirien a a a Eaa 38 4 16 1 le 38 Ee LEE 38 4 16 3 Input Specification AEN 38 4 16 4 et eelere EE 38 4 1
14. of tools to display graphically the auxiliary input datafiles used by the L2BP software at least the Aux Cal file and maybe also the L1B input product 4 17 1 Purpose Test L2bP_TOOLS_02 verifies requirements L2BP 130 maybe L2BP 120 can be added here if we agree on that requirement 4 17 2 Prerequisites The L2bP software must be installed onto the test platform 4 17 3 Input Specification All commands are entered by the operator via Linux command line 4 17 4 Output Specification t b d 4 17 5 Specific Test Procedure Commands to be executed are Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 39 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan graphically Procedure Command comments passed Observations failed cd build Matlab_Tools TOOLS run the tool to display the auxiliary calibration data not yet implemented Verify L2BP 130 by observing that the above command produced some graphics holding displaying this auxiliary calibration data maybe a similar thing for L2BP 120 for display of L1B products Table 4 17 test procedure for test L2bP_TOOLS_02 4 17 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 17 are passed and failed otherwise 4 18 Test L2bP_TOOLS_03 This test procedure verifies the pres
15. the Software Verification amp Validation Plan for the ADM L2B operational processor lt is part of the deliverables of the contract study Aeolus and one of the outputs of WP This document describes the tests to be conducted in order to verify that the requirements stated for the Operational L2B processor as listed in AD 7 are met Chapter 2 contains the list of applicable and referenced documents and a list of acronyms and chapter 3 gives an overview of the testing procedure Chapter 4 gives details of all tests defined in this plan In appendix A on page 42 the cross reference matrix is given and finally in appendix B on page 54 a list is given of external tools needed by this plan Todo s David Tan suggested adding a new chapter to describe all scientific tests in this document as well generate the needed TDS files defined in Table 3 3 using the newest E2S and L1BP Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 9 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 2 Documents 2 1 Applicable Documents AD 1 PDS IPF ICD Generic Interface Guideline Issue 2 2 01 08 2006 ESA ID ACS GS 0001 AD 2 Statement of Work Aeolus Level 2B 2C Processing Facility Issue 1B 16 09 2004 AE SW ESA GS 0117 Supplemented by AD 3 AD 3 Statement of Work Enhanced Aeolus Level 2B 2C Functionalities amp Pre Launch Validation Issue 1 0
16. 201T000000_20041201T003000_0001 DBL expected L INUX_pgf90 is present in the listing produced by the above tar command Verify that an example of the AUX RBC file named RayleighBrillouinProcessing AE_TEST_AUX_RBC_AX_200 60703T123456_20070703T123456_0001 DBL is present in the listing produced by the above tar command Verify that an example of the AUX_CLM file named Test AuxClim_file_handling AE_TEST_AUX_CLM_AX_20 0103127123456 20110312T123456_0001 DBL expect ed LINUX_pgf90 is present in the listing produced by the above tar command Verify that an example of the AUX_CAL file named an example has not yet been generated is present in the listing produced by the above tar command this file is not yet included in the current delivery Verify L2BP 160 by observing that examples of all auxiliary data files mentioned above are present in listings produced by the above two tar commands tar ztvf L2BP_Release1 2a_TDS_20070125 tar gz Verify L2BP 150 by observing that this TDS dataset contains all additional datafiles needed to perform the FAT Note that this FAT depends largely on visual inspection of results so at the moment it is not clear to me what can be packed into atest script and what not This needs further discussion after we have agreed on and completed this list of tests Is pdf Verify L2BP 170 by observing that a file named AE MA ECMWF L2BP 001_20061207_SU
17. 6 5 Specific Test Procedure ooooncccnncccnoncconocnnnncncnoncccnncnnn nn 38 4 16 6 Pass fail Crta iia dico 39 4 17 Test L2bP TOOLS Oli ds ide 39 Ai PUTOS oi A ci 39 ak ere ET 39 4 17 3 Input Specifications 39 4 17 4 OUtput Specificato M E 39 4 17 5 Specific Test Procedure ooooncccinncccnoncconncnnncncconeccnncrnnnn rn 39 41 36 Pass Tal CULO dai teo 40 4 118 Test L2DP TOOLS OS isaac eat E ee 40 4 181 e 40 EE LE 40 4 18 3 Input Specification aid 40 4 18 4 Output Specificato M ssnipe Ae Reena 40 4 18 5 Specific Test Procedure cmctiric nta dt rre 40 4 18 6 Pass fail Criteria E 41 419 Test L2bP TOOLS E 41 4 19 1 le 41 SE EE 42 4 19 3 Input Specification oononnnicinnidininnnnnnncnnncconnccnn nec 42 4 19 4 Output Specification EE 42 4 19 5 Specific Test ProCeQure ccceccccccccecececeeneeeeeeeecesaeeeaaeeeseeceaeeeeaeesseaeeseeeeesaeeesaaeeseneeesaees 42 4 19 6 PASS Talll GOOI EE 42 A Verification Cross Reference Matrix c ccceccecceeeeeseeeceeeeeceaeeeeaaeeseaeeesaeeeseaeeeeeeeesecaeesiaaeseeneesaas 43 A A E ES 55 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 7 54 Doc Title Aeolus Level 2B Processor Software Verification amp Validation Plan Document No Issue Date Page AE PL KNMI L2BP 001 VII 30 01 2007 8 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 1 Introduction and Purpose of Document The present document is
18. 90 One Workstation Configuration L2bP_EXT_02 R amp I file shall be provided with the L2BP system delivery as specified in the Aeolus Level 2BP External ICD AD 9 L2BP 400 The L2BP Workstation L2bP_EXT_02 R amp I Configuration file shall list each L2BP processing service L2BP 410 At least one Task Table shall be L2bP_EXT_02 R amp I Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 49 54 OLUS Doc Title EE Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Verifi Software Name cation Component remark Method provided with the L2BP system delivery as specified in the Aeolus Level 2B Processor External ICD AD 9 L2BP 420 The L2BP Task Table file shall L2bP_EXT_02 R amp I define the L2BP processing tasks required to provide a processing service L2BP 430 The L2BP Task Table file shall L2bP_EXT_02 R amp I define the input and outputs for each L2BP processing task L2BP 440 Each L2B processing task shall L2bP_HMI_01 D L2BP be initiated as acommand line task with the Job Order filename as the only parameter L2BP 450 The L2BP shall provide for L2bP_EXT_03 D L2BP stopping each processing task by akill or terminate signal Under normal conditions the different tasks constituting a processor shall terminate on their own without the need to receive akill or terminate
19. All commands are entered by the operator via Linux command line 4 9 4 Output Specification e first expected test result should be e second expected testresult should be 4 9 5 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed Verify L2BP 100 by reviewing chapter 4 2 1 of AD 9 Verify L2BP 320 by comparing the example JobOrder file JobOrder test12 xml in directory BUILD Test main with chapter 4 2 1 of AD 9 Verify L2BP 390 by comparing the example Workstation Configuration file named Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 28 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed WorkstationConfigurationFile xml in directory BUILD ThinLayer with chapter 4 1 1 of AD 9 Verify L2BP 400 by observing that the example Workstation Configuration file named WorkstationConfigurationFile xml in directory BUILD ThinLayer lists the allowed order types of the L2BP Verify L2BP 410 by comparing the example Task table file named TaskTable AE_L1B L2B WIND xml in directory BUILD ThinLayer with chapter 4 1 2 of AD 9 Verify L2BP 420 by observing that the example Task table file named TaskTable AE_L1B L2B WIND xml in directory BUILD ThinLayer lists two tasks each
20. BP 700 L2BP 710 L2BP 720 L2BP 730 L2BP 740 L2BP 760 4 14 2 Prerequisites The L2bP software must be installed onto the test platform Test L2bP_HMI_01 defined in section 4 7 must have been run Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 35 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 14 3 Input Specification All commands are entered by the operator via Linux command line 4 14 4 Output Specification t b d 4 14 5 Specific Test Procedure Commands to be executed are Procedure Command comments Observations passed failed cd BUILD Test main L2BC_file_handling Write_L2B Text_Product L2B_Product Verify L2BP 110 and L2BP 162 by observing that the above command converted the L2B product generated by test L2bP_HMI_01 in section 4 7 to plain ascii Open the HDR and DBL files of this L2B product in a text editor Also open the DBL file of this L2B product using a hexdump utility Verify L2BP 260 and L2BP 700 these requirements are identical i m o by observing that the format of the just opened files is according to the L2B IODD AD 8 Verify L2BP 710 by observing that the L2B KVT section has a field which gives the JobOrder type that was used not yet implemented Verify L2BP 720 by observing that the L2B KVT section has afields giving quality statistics of
21. Control Document Input Output Definitions Document Line Of Sight Reference Model for the Atmosphere Signal to Noise Ratio Software Release Document Software Release Notes Software User Manual Thin Layer Emulator Verification Cross Reference Matrix Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 11 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Test Procedure Overview oO 3 1 Test Items The item under test during the Factory Acceptance Testing is the L2bP system as designed and built by ECMWF and subcontractors The specific L2bP requirements that will be verified during factory acceptance testing FAT are identified in AD 7 All deliverable software many ascii data files and system build files will be under the control of Configuration Management PerForce Binary data files and some associated ascii header files will be combined in a binary datapack Each new version of this datapack will be archived in the ECMWF tape archive ecfs The system software build and install procedures will be conducted at the start of the FAT as part of the Factory Acceptance Test Procedures If changes are required to the software between FAT events the system software will be rebuilt again from the orignal copy retrieved from the version control system which will be made available using the eRoom All required vendor supplied software such as the ope
22. Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 1 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Doc No AE PL KNMI L2BP 001 Doc Title Aeolus Level 2b Processor Software Verification amp Validation Plan Number of 54 pages pages Prepared by Jos de Kloe KNMI David Tan ECMWF Dorit Huber DLR Doc Title Aeolus Level 2B Processor Software Verification Validation Plan J de Kloe D o 15 Dec 2006 P first draft version Huber EN 30 Jan 2007 almost every page ESA comments of 15 Jan 2007 incorporated J de Kloe Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 3 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Table of Contents RISD y e e E E A E E E E A ree ereerrrererT 1 Document Change LOG usripe nainen a aaae eaaa a Eaa aa EEEa aa aaa EED 2 Re e Tun EE 3 1 Introduction and Purpose of Document 8 ER Let Lu CEET 9 2 1 Applicable Documents enken cnn norris 9 21 Reference DOCUMENTS isirisotasaricns aleta AEN 9 ENEE 10 2 3 ACTION ME iii A net eines 10 3 Test ee le Ce e 11 St TESEO MS a io renner rrr re 11 3 2 Acceptance Test Cases nn 11 3 3 Test Data SUMMA Yin A ad 13 4 Acceptance Test Procedures coccoonccccnononoccnononeccnnnnnecnnnnnnecnnnnnnncn nn nnne cnn name cnn name cnn nece creanme ca nnnnns 15 Al Test E ER D is II A a 15 AAG
23. M_lIss1 2 pdf is present in the listing generated by the above Is command similar checks for the other documentation Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 16 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Table 4 1 test procedure for test L2bP_DEL_01 4 1 5 Output Specification All tar commands produce a listing of files available in the delivered tar gz packages The Is command produces a listing of files available in the current directory 4 1 6 Pass fail criteria The test passes if all mentioned data and documentation files are present If one or more are missing the test fails 4 2 Test L2bP_GEN_01 This test procedure verifies the hardware to be used 4 2 1 Purpose Test L2bP_GEN_01 verifies requirements L2BP 780 4 2 2 Prerequisites A test platform must be available 4 2 3 Input Specification All commands are entered by the operator via Linux command line 4 2 4 Output Specification The commands list some of the properties of the current hardware 4 2 5 Specific Test Procedure Commands to be executed are Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 17 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed cat proc cpuinfo verify that the processor on th
24. N_02 R amp I all modules L2BP 540 The L2BP shall detect missing or corrupted data in the input Level 1b product and continue to process remaining valid data L2bP_PROD_02 L2BP L2BP 550 The L2BP shall stop processing and produce an error message if any input file is not accessible prior to the start of an L2BP processing task L2bP_PROD_02 L2BP L2BP 560 The L2BP shall log messages in the L2BP event log listing each input file that was not accessible to a started L2BP executable L2bP_PROD_02 L2BP 570 If an L2BP processing run fails irrecoverably the L2BP event log will list the last successfully completed processing step and no further events will be listed for that JobOrder L2bP_PROD_02 L2BP L2BP 580 The L2BP Product Report shall contain the version number of the L2BP executable software L2bP_PROD_01 R amp I L2BP L2BP 590 The L2BP Product Report shall contain the names of the input L2bP_PROD_01 R amp I L2BP Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 51 54 OLUS Doc Title EE Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Verifi Software Name cation Component remark Method files some ascii test prints L2BP 600 The L2BP Product Report shall L2bP_PROD_01 R amp I contain the names of the generated product fi
25. N_02 R amp I inspect the source code L2BP 800 A list of any non standard functions modules compiler specific shall be maintained and included in the design document L2bP_GEN_02 R amp I L2BP 810 The L2BP shall make use of the following commercial tools Matlab SCILAB L2bP_GEN_02 R amp I 22 requirements on the EE2BUFR tool which converts L1B files L2bP_TOOLS_04 T Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 53 54 OLUS Doc Title EE Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Verifi Software Name cation Component remark Method from EEto BUFR format This should probably be split into the following items tool compilation and installation tool execution inspection of the outputs execution of the L2bP on the generated BUFR file to demonstrate correct production of an L2B product Table 4 21 Tracability or Cross Reference matrix Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 54 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan B Test Tools The following additional tools are used in the tests described in this document Most of them are common unix linux tools but still it should be checked whether they are installed before starting the FAT e
26. Output Specification After this test the software is installed on this platform in working order 4 4 5 Specific Test Procedure Commands to be executed are Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 20 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed note the current time Install the L2BP softwareby following the instructions detailed in the SRN document section 3 Verify success of the installation by observing that the Install directory contains an executable named L2B_ processor When executed without JobOrder file by giving the command install L2B_processor a help message should be printed giving instructions how the processor should be used issue the commands grep i failed build Test testresults accumulated wc and grep i passed build Test testresults accumulated wc and verify that no unit test failed and that 166 unit tests passed note the elapsed time since the start of installation Verify L2BP 20 by observing that a successfull installation took less than 4 hours combined with the observation that all unit tests passed and that the L2B_ processor executable was successfully build When L2BP 20 is passed this automatically means that GEN 80 and L2BP 80 are passed as well Verify L2BP 230 by observing that in the
27. PUIPOS Ocarina ice 15 41 2 E UE 15 4 1 3 INPUT SpecifiCatiO Ne EE 15 4 1 4 Specific Test Procedure ooooconcccnnnninnccnnnncccnncrnnn acc rn 15 4 1 5 Output Specification aia ibas 17 4 1 6 Pass fall mer ria a 17 4 2 TestiL20P GEN RAN 17 d2 Mie Le 17 E UE 17 4 2 3 Input e ele e enetrensdeeudasvat shistedaeev shine etees 17 D Welle lte len NEE 17 4 2 5 Specific Test Procedure ecccccecceceseeceeeececeeeeeaeeeeeeeeceaeeseaaeeseeeeeesaeeseeaaeeeeaeestaeseeeeeeneaees 17 4 2 0 Pass fall CIOT viciado lts dd 18 4 3 Test 2bP GEN Ol TEE 18 43 1 leie 18 E UE 18 WC D ller ee Dn Le EE 18 4 34 Quiput SpecificatiON EE 18 4 3 5 Specific Test Procedure icon nia dais 19 4 3 6 Pass fail crier 20 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 4 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 4 TestiL2bP GEN BA EE 20 44 ele israelitas lis 20 d UE 20 4 4 3 INput ee ele a cias 20 4 44 Output SPECI ICA ION EE 20 4 4 5 Specific Test Procedure ooomconncccnnnninnncnnnacccncccnnn a E Eaa aaa 20 4 4 6 Pass falll sCrite E 21 4 5 Test L2bP GEN 04 08 EE 21 AO PUD Le 22 E EE 22 4 5 3 Input Spechticatioms zc degen ada 22 4 5 4 Output Specification AER 22 4 5 5 Specific Test Procedure leen tes 22 49 06 TUN ii a 23 4 6 Test L2DP GEN COD scott dai tad 23 4 6 1 RUIDOSO aiii diia 23 4 6 2 Prerequisiltesin tuys soot vena tecen apy sctsctie uu uaeces N a aa 23 4
28. atext editor any editor will do for example vi x emacs nedit zile pine e adifference generator for example diff xdiff or xxdiff e atool to view binary files for example hexdump e atool to edit binary files for example hexedit e more
29. auxiliary files L2bP_TOOLS_03 D L2BP 162 The L2bP software shall provide a functionality to convert L2B products in EEformat to ascii for a user selected ADS MDS and range of records L2bP_OPT_01 WriteL2BtoTxt in directory L2BC_file handling L2BP 170 The L2BP delivery shall include a user manual in Adobe Portable Document Format PDF L2bP_DEL_01 R amp I L2BP 200 L2BP 210 L2BP 220 L2BP 230 It shall be possible to install and change configuration settings of the L2bP by a user with no administrator privileges L2bP_GEN_03 Install and edit some settings as normal user to demonstrate this L2BP 250 The L2BP shall accept as input L2bP_HMI_01 L2BP Document No Issue Date Page S AE PL KNMI L2BP 001 V1 1 30 01 2007 47 54 OLUS Doc Title EE Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Verifi Software Name cation Component remark Method any valid Level 1b product provided by the Front End Processor of the PDS The content of the Level 1b product is defined in RD 2 L2BP 260 The L2BP shall produce a Level L2bP_OPT_01 T the L2BC file_handling 2B formatted product as module see also L2BP specified in the Aeolus L2B L2C 700 Processor IODD AD 8 L2BP 270 The L2BP shall accept an L2bP_HMI_01 T L2BP Auxiliary L2B Pro
30. build directory the files Makeoptions and Systemsettings are ascii files that may be edited by the user if needed to change configuration options If understand correctly the settings in the AUX_PAR file are not tested by this requirement Table 4 4 test procedure for test L2bP_GEN_03 4 4 6 Pass fail criteria The test is considered passed if installation of the L2BP was successfull and was completed within 4 hours 4 5 Test L2bP_GEN_04 This test procedure verifies correct handling of mathematical exceptions in the L2bP software Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 21 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 5 1 Purpose Test L2bP_GEN_04 verifies requirements GEN 100 GEN 110 GEN 120 GEN_130 4 5 2 Prerequisites The L2bP software must be installed onto the test platform 4 5 3 Input Specification All commands are entered by the operator via Linux command line 4 5 4 Output Specification t b d 4 5 5 Specific Test Procedure Commands to be executed are Procedure Command comments Observations passed failed Verify GEN 100 by searching the source code using for example the grep tool for calls to log atan etc and observe that the inputs are properly checked on their valid range including possible NaN and Inf numbers in the input files before entering th
31. cessing Parameters file as specified in the Aeolus L2B L2C Processor IODD AD 8 L2BP 280 The L2BP shall accept an L2bP_HMI_01 T L2BP Auxiliary Climatology file as specified in the Aeolus L2B L2C Processor IODD AD 8 L2BP 290 The L2BP shall accept an L2bP_HMI_01 T L2BP Auxiliary Rayleigh Brillouin Calibration file as specified in the Aeolus L2B L2C Processor IODD AD 8 L2BP 300 The L2BP shall accept L2B L2bP_HMI_01 T L2BP Meteorological Parameters file as specified in the Aeolus L2B L2C Processor IODD AD 8 L2BP 301 The L2BP shall accept an L2bP_HMI_01 T L2BP see section 4 3 in the Auxiliary Calibration L2A IODD RD 3 Note that Parameters file as specified in this file still needs to be the L2A IODD RD 3 defined L2BP 302 The L2bP shall be capable of L2bP_PROD_03 IT L2BP processing a L1B input product EE or BUFRformat containing up te 8 orbits worth of data L2BP 310 The L2BP shall provide for L2bP_HMI_01 T L2BP processing a Job Order initiated by the thin Layer L2BP 320 The Job Order files accepted by L2bP_EXT_02 R amp I S the L2BP shall be formatted as specified in the Aeolus L2BP External ICD AD 9 L2BP 330 The L2BP shall produce an exit L2bP_HMI_01 T L2BP code upon the completion or termination of each processing job as defined in the Aeolus Level 2B External ICD AD 9 Document No Issue Date Page AE PL KNMI L2BP
32. ct Reports OLUS SCENENE wind Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 12 54 Doc Title Aeolus Level 2B Processor Software Verification amp Validation Plan Test Case Test Case Identifier bP Product Validation L2bP Performance Description ncludes validation o requirements L2bP_PERF requirements Includes validation of L2bP performance L2bP Tools L2bP_TOOLS Includes testing of additional tools delivered this covers the LIB EE2BUFR conversion tool Table 3 1 L2bP Acceptance Test Cases Table 3 2 below gives the full list of tests to be performed on the L2bP Test Case description see name section for full details L2bP_DEL_01 check that all needed documentation and data files are delivered 4 1 L2bP_GEN_01 check the hardware 4 2 L2bP_GEN_02 check the formatting and contents of the documentation 4 3 check the source code of the software L2bP_GEN_03 installation of the software on alinux platform 4 4 L2bP_GEN_04 handling of mathematical exceptions 4 5 L2bP_GEN_05 check bit and byte ordering 4 6 L2bP_HMI_01 general check of the correct functioning of the processor and the CLI 4 7 L2bP_EXT_01 check the external Thin Layer Emulator TLE interface 4 8 L2bP_EXT_02 check the documentation and example files needed for using the TLE 4 9 L2bP_EXT_03 check generation
33. dit any inputfile L2B_processor JobOrder test12 xml After running the L2BP on a test file containing some missing or corrupt L1B inputs using the command above verify L2BP 540 by observing that the problematic inputs are detected flagged and reported while the remaining correct inputs are processed anyway Remove one of the necessary input files by renaming it and run the test again mv AE_TEST_AUX_PAR_2B_20050112T000000_20110112T 000000_0012 EEF AE_TEST_AUX_PAR_2B_20050112T000000_20110112T 000000_0012 EEF orig L2B_processor JobOrder test12 xml Verify L2BP 550 by observing that the L2BP stops and issues a proper error message about this missing file Verify L2BP 560 by observing that a suitable error is written to the event log about the missing inputfile Verify L2BP 570 by observing that the last successfully completed processing step is reported when the L2BP fails irrecoverably and by observing that no more steps are reported except for the error that occurred Verify L2BP 660 by observing that all above produced warnings and errors have been logged Table 4 12 test procedure for test L2bP_PROD_02 4 12 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 12 are passed and failed otherwise 4 13Test L2bP_PROD_03 This test procedure verifies the ability of the L2BP sof
34. e calculation Also search the ascii L2BP product and note that no suspicious outputs like NaN or Inf occur This may be done by using the Write_L2B_Text_Product tool which should be present in the install directory on any valid L2B product file Verify GEN 110 by taking one or more examples found in the above test and observing in the source code that the variable is set to missing when a non fatal mathematical exception is found without producing any log messages For an example see handling of the log function in subroutine Calc_Extinction_lterative in file opticalproperties F90 in directory OpticalProperties Alternatively some dedicated code might be added to enable triggering such conditions not yet implemented Verify GEN 120 and GEN 130 by taking one or more examples found in the above test and observing in the source code that the error_flag is set and a proper log message is issued when a fatal mathematical exception is found For an example see the several checks for negative attenuation numbers in subroutine calc_FP_Molecules_Only in file opticalproperties F90 in directory OpticalProperties Alternatively some dedicated code might be added to enable triggering such conditions not yet implemented Table 4 5 test procedure for test L2bP_GEN_04 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 22 54 Doc Title Aeolus Level 2B Processor Software V
35. e current machine is a Pentium 4 or better with a clock speed of 2 5 GHz or better cat proc meminfo verify that the available total RAM memory is 256 MB or more df h verify that the disk on which the installation is to be performed has at least 500 MB of free space Verify L2BP 780 by observing that the above 3 conditions are met Table 4 2 test procedure for test L2bP_GEN_01 4 2 6 Pass fail criteria The test is considered passed if all mentioned hardware properties are equal to or better than the mentioned minimum values Otherwise the test fails 4 3 Test L2bP_GEN 02 This test procedure verifies the formatting and contents of the documentation and the formatting of the source code of the L2bP software 4 3 1 Purpose Test L2bP_GEN_02 verifies requirements GEN 50 GEN 60 L2BP 490 L2BP 530 L2BP 790 L2BP 800 L2BP 810 4 3 2 Prerequisites The L2bP software package and documentation must be copied onto the test platform the package must have been unpacked by using the command tar zxvf L2BP_Release1 2a_source_20070125 tar gz 4 3 3 Input Specification All commands are entered by the operator via Linux command line 4 3 4 Output Specification tod Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 18 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 3 5 Specific Test Procedure Comma
36. ence of tools to generate the auxiliary input datafiles used by the L2BP software 4 18 1 Purpose Test L2bP_TOOLS_03 verifies requirement L2BP 161 4 18 2 Prerequisites The L2bP software must be installed onto the test platform 4 18 3 Input Specification All commands are entered by the operator via Linux command 4 18 4 Output Specification t b d 4 18 5 Specific Test Procedure Commands to be executed are Procedure Command line comments Observations passed failed cd build Test main using a text editor open Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 40 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed AE_TEST_AUX_PAR_2B_20050101T000000_20110101T 000000_0001 EEF Observe that this file may be edited using a simple text editor cd build Test AuxClim_file_handling TestWriteAuxClimData Observe that this above command has created a new AUX_CLM product named AE TEST AUX CLM AX_200103127T123456 20110312T 123456 0001 cd build Test AMD_file_handling TestWriteAMDdata Observe that this above command has created a new AUX_MET product named AE_TEST_AUX MET 12 20041201T000000_20041201T 003000 0001 cd build Test RBC_FileHandling GenerateRBCdata RBCModel Tenti Ob
37. erification Validation Plan 4 5 6 Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 5 are passed and failed otherwise 4 6 Test L2bP_GEN_05 This test procedure verifies bit and byte ordering in the L2bP software 4 6 1 Purpose Test L2bP_GEN_05 verifies requirements GEN 10 GEN 20 4 6 2 Prerequisites The L2bP software and associated binary datapack must be installed onto the test platform and the set of unit tests must have been run at least once to create the necessary symbolic links in the Test DirectbinarylO directory 4 6 3 Input Specification All commands are entered by the operator via Linux command line 4 6 4 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed cd SOURCE_DIR Test DirectBinarylO WriteSomeNumbers Verify that the generated file SomeNumbers bin is written in the native byte order of the current platform Inspect for example bytes OE and OF using the command hexdump C SomeNumbers bin These bytes should hold the numbers 02 00 for little endian platforms like linux Example files SomeNumbers bin expected are provided as reference TestDirectBinarylO Verify that the file test_file bin has bigendian byteorder no matter what platform it runs on This can be easily checked by using the command hexdump C test_fi
38. ests not mentioned in Table 3 3 below use datafiles provided with the default L2B processor source code and datapack todo check if this is sufficient for us todo these files still need to be created TDS ID Duration Notes Used by Job Used for Test Order L2B_TDS_01 1 orbit used to test the L2bP_PERF_01 200 BRCs runtime performance for processing a typical LIB product L2B_TDS_02 2 BRC s file containing L2bP_PROD_02 missing and or corrupted data L2B_TDS_03 8 orbits used to test the L2bP_PROD_03 1600 BRC s ability to process an extremely large L1B product Table 3 3 L2bP Acceptance Test Data Set Summary Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 14 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 Acceptance Test Procedures This chapter describes all tests needed to demonstrate that all requirements are met The full list of tests is given in Table 3 2 The tracability matrix defining which test demonstrates which requirement is given in Table 4 21 in appendix A on page 42 In the next subsections further details will be given on each defined test on the tests purpose prerequisites input and output specifications specific test procedure and expected results pass fail criteria Note that some tests should be completed before some other tests are started The recommended order of execution of tests is the order spec
39. et but will be tested here once it becomes clear what we have to do here L2BP 650 4 11 2 Prerequisites The L2bP software must be installed onto the test platform Test L2bP_HMI_01 defined in section 4 7 must have been run before starting this test 4 11 3 Input Specification All commands are entered by the operator via Linux command line 4 11 4 Output Specification t b d Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 31 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 11 5 Specific Test Procedure Commands to be executed are Procedure Command comments Observations passed failed produce a product report from the file textoutput txt created during the L2bP_HMI_01 tests described in section 4 7 using the following commands cd BUILD Test main Scripts L2B_ReportGenerator py textoutput txt open the product report file which has the default name DefaultProductReport with a text editor Verify L2BP 580 by observing that a Processor_Version field is present Verify L2BP 590 by searching for the string and observing that the input files are listed this is not yet implemented Verify L2BP 600 by searching for the string and observing that all output products are listed this is not yet implemented Verify L2BP 610 by searching for the string and observing
40. h the general correct functioning of the processor 4 7 1 Purpose Test L2bP_HMI_01 verifies requirements L2BP 30 L2BP 250 L2BP 270 L2BP 280 L2BP 290 L2BP 300 L2BP 301 L2BP 310 L2BP 330 L2BP 440 L2BP 500 L2BP 510 L2BP 520 4 7 2 Prerequisites The L2bP software must be installed onto the test platform Additional L1B product files produced by the L1BP are available for testing An example JobOrder file produced by the real ThinLayer not the Emulator is available 4 7 3 Input Specification All commands are entered by the operator via Linux command line 4 7 4 Output Specification t b d 4 7 5 Specific Test Procedure Commands to be executed are Document No Issue Date Page AE PL KNMI L2BP 001 VII 30 01 2007 24 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments Observations passed failed cd BUILD Test main L2B_processor JobOrder test12 xml Verify L2BP 30 L2BP 440 by observing that the above commands produced a valid L2B product file named AE_TEST_ALD_U_T_2B DBL HDR Copy a JobOrder file produced by the real ThinLayer to the current directory assume it is named obOrder ThinLayer xml L2B_processor JobOrder ThinLayer xml Verify L2BP 310 by observing that the above commands produced a valid L2B product file named AE_TEST_ALD_U T_2B DBL HDR
41. ified in this document 4 1 Test L2bP DEL 01 This test procedure verifies delivery requirements for the L2bP software 4 1 1 Purpose Test L2bP_DEL_01 verifies requirements L2BP 140 L2BP 150 L2BP 160 L2BP 170 4 1 2 Prerequisites The L2bP software and documentation must have been copied on the target platform 4 1 3 Input Specification All commands are entered by the operator via Linux command line 4 1 4 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed tar ztvf L2BP_Release1 2a_TDS_20070125 tar gz Verify L2BP 140 by observing that the datafiles needed for the FAT as mentioned in Table 3 3 named L2B_TDS_01 etc are present in the listing produced by the above tar command tar ztvf L2BP_Release1 2a_source_20070125 tar gz Verify that an example of the AUX_PAR_2B file named ThinLayer AE_TEST_AUX_PAR_2B 20050331T000000 2 0111231T000000_0000 EEF is present in the listing produced by the above tar command tar ztvf L2BP_Release1 2a_datapack_20070125 tar gz Verify that an example of the AUX_MET_12 file named Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 15 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments Observations passed failed Test AMD_file_handling AE_TEST_AUX_MET_12_20041
42. ile L2bP_GEN_05 dito GEN 30 GEN 40 The L2BP software system shall be designed to separate process tasks into modular configuration items GEN 50 All documentation produced in the context of this contract shall be produced in accordance with the pertinent European Cooperation for Space Standardisation ECSS standards as tailored by the Statement of Work documents AD 2 and AD 3 L2bP_GEN_02 R amp I GEN 60 All documentation produced in the context of this contract shall be delivered in the following formats PDF drafts and final versions and RTF final versions only L2bP_GEN_02 R amp I The word format allowed for intermediate and draft versions is not applicable for this test plan L2BP 10 The L2BP software will be maintained and warranted against design defects from delivery through to the launch of the satellite plus 39 months all modules L2BP 20 A new release of the L2BP software will take less than 4 hours to install L2bP_GEN_03 all modules GEN 80 L2bP_GEN_03 all modules GEN 90 The L2BP system will be designed to use files and directory structures for storage and management of system data L2bP_EXT_01 all modules GEN 100 The L2BP software will be designed to trap mathematical L2bP_GEN_04 R amp I all modules OLUS sense ne wind Document No Issue Date
43. in its own pool one for the actual L2B Processor and one for the ReportGenerator Verify L2BP 430 by observing that the example Task table file named TaskTable AE_L1B L2B WIND xml in directory BUILD ThinLayer lists 5 input files and 1 output file for the L2B_ processor and 1 input file and 1 output file for the ReportGenerator task Table 4 9 test procedure for test L2bP_EXT_02 4 9 6 Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure in Table 4 9 above are passed and failed otherwise 4 10 Test L2bP_EXT_03 This test procedure verifies the ability of the L2BP software to issue the different types of log messages on the stdout and stderr channels It also verifies the respons of the L2BP to external signals 4 10 1 Purpose Test L2bP_EXT_03 verifies requirements L2BP 340 L2BP 350 L2BP 360 L2BP 370 L2BP 380 L2BP 450 L2BP 670 4 10 2 Prerequisites The L2bP software must be installed onto the test platform 4 10 3 Input Specification All commands are entered by the operator via Linux command line Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 29 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 10 4 Output Specification t b d 4 10 5 Specific Test Procedure Commands to be executed are Procedure Command comments Observations
44. ivery and run the processor by clicking the process button Note that error and or warning messages appear in the log and control panel of the user interface of the TLE This verifies L2BP 383 Check that both the L2BP processor and the ReportGenerator task finished successfully This verifies GEN 90 L2BP 470 L2BP 480 Verify L2BP 460 by observing that the above test run generated a product report Document No Issue Date Page AE PL KNMI L2BP 001 VII 30 01 2007 27 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed Verify L2BP 335 by observing that the above test run generated a Product List file as defined in the L2B External ICD AD 9 Table 4 8 test procedure for test L2bP_EXT_01 4 8 6 Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 8 are passed and failed otherwise 4 9 Test L2bP_EXT_02 This test procedure verifies the formatting of the example files needed to interface the L2bP software with the ThinLayer emulator 4 9 1 Purpose Test L2bP_EXT_02 verifies requirements L2BP 100 L2BP 320 L2BP 390 L2BP 400 L2BP 410 L2BP 420 L2BP 430 4 9 2 Prerequisites The L2bP software must be installed onto the test platform 4 9 3 Input Specification
45. le Aeolus Level 2B Processor Software Verification Validation Plan Verification Method Demonstration Verification Description Method Identifier This method is similar to a Functional Test but is D informal in nature and may not have specific input data sets or procedures Table 4 20 L2bP Verification Methods e Software Component Remark This column cross references the Software Requirement in the first column with the first level L2bP Software Components described in Level 2 Design Document Sometimes this column is used to add additonal remarks on the test case Note that rephrased some of the requirements this is indicated in yellow Please check if you can agree on these modifications and if so change them in the requirements document accordingly Also some additional remarks todos and questions from me are marked in OLUS SCENENE wind Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 44 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Name Verifi cation Method Software Component remark GEN 10 The L2BP shall use bit 0 as the most significant bit for each external interface file L2bP_GEN_05 D all file reading and writing code in the DirectBinarylO module GEN 20 The L2BP shall use byte O as the most significant byte for each external interface f
46. le bin to verify that for example bytes 14 17 hexadecimal OE 12 which should contain a 4 byte signed integer IntAl type with a value of 4 does indeed contain the bytes 00 00 00 04 Compare this with the output of hexdump C SomeNumbers bin which writes the IntAul number 2 on alittle endian platform like linux as 02 00 00 00 in bytes 38 41 hexadecimal Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 23 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed 26 29 This verifies requirements GEN 10 and GEN 20 Table 4 6 test procedure for test L2bP_GEN_05 4 6 5 Output Specification The WriteSomeNumbers tool produces a binary file named SomeNumbers bin and writes some information to the screen The TestDirectBinarylO tool produces a binary file named test_file bin which should always be in bigendian format no matter what the native format of the platform on which it is installed uses It also reads this file again and reads the SomeNumbers bin file produced by WriteSomeNumbers 4 6 6 Pass fail criteria The generated binary files should be in native and big endian byteorder as is detailed in the test procedure If they are not the test fails 4 7 Test L2bP_HMI_01 This test procedure verifies the human machine interface for the L2bP software combined wit
47. les contain the size of each generated product file L2BP 620 The L2BP Product Report shall L2bP_PROD_01 Ra contain an exit code indicating success or failure L2BP 630 The L2BP Product Report shall L2bP_PROD_01 R amp I contain a list of errors and warnings if applicable L2BP 640 The L2BP Product Report shall L2bP_PROD_01 R amp I include the start and stop time of operation SE L L L L2BP 650 The L2BP shall generate log L2bP_PROD_01 D messages indicating L2BP processing task status L2BP 660 The L2BP shall generate log L2bP_PROD_02 D messages indicating L2BP process warnings and errors L2BP 670 The L2BP shall provide the L2bP_EXT_03 D event log data stream through the stdout and stderr L2BP not implemented yet L2BP 610 The L pp Product Report shall L2bP_PROD_01 BA L2BP not implemented yet L2BP not implemented yet L2BP L2BP 2BP 2BP 2BP 2BP L2BP 680 The L2BP software shall L2bP_PROD_01 D generate log messages for the Informational Warning Error events specified in the Aeolus L2BP external ICD AD 9 mi SS L2BP 700 The L2BP shall generate aL2B L2bP_OPT_01 T see also L2BP 260 product as specified in the Aeolus L2BP IODD AD 8 jerone o S S L2BP 710 Each L2BP product shall be L2bP_OPT_01 T annotated with the Job Order Type as Nominal Processing Reprocessing or Backlog Processing L2BP
48. nds to be executed are Procedure Command comments Observations passed failed Verify that an up to date copy of the documentation is present in pdf format by giving the command ls pdf Verify GEN 60 by opening each of these files with a suitable pdf viewer like xpdf and observing that its contents is readable Verify GEN 50 by opening each of these files with a suitable pdf viewer like xpdf and observing that their structure is according to the ECSSstandards as taylored by the SOW documents AD 2 and AD 3 This includes the following files IODD AE IF ECMWF L2BP 001_ _IODD_ pdf ExtICD AE IF ECMWF L2BP 002_ _ExtICD_ pdf SUM AE MA ECMWF L2BP 001_ SUM_ pdf SRN AE RN ECMWF L2BP 001_ SRN_ pdf SRD AE RS ECMWF L2B 001_ _SRD_ pdf ATBD AE_TN_ECMWF_L2P_0023_ _ATBD_ pdf EE2BUFRGuide AE TN ECMWF L2P 0072_ _EE2BUFRGuide_ pdf Verify L2BP 490 by opening the SUM document and observe that in section 4 5 the exceptional manual operation of the L2BP software is described and in section 7 the additional assimilation interface to be used in the ECMWF IFS context is described Verify L2BP 530 by opening the ATBD document selecting some algorithms at random or all of them if time permits locate them in the source code and compare the ATBD description with the source code Verify L2BP 790 by opening some source code files at random
49. of warning error and other log messages 4 10 L2bP_PROD_01 Test generation of a product report according to specs 4 11 L2bP_PROD_02 Test the capability to handle files containing missing or corrupted 4 12 input numbers or missing input files L2bP_PROD_03 Test the L2bP capability to process a very large L1B inputfile 4 13 containing 8 orbits worth of data Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 13 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Test Case description see name section for full details L2bP_OPT_01 Test the formatting of the L2B product 4 14 L2bP_PERF_01 Test the runtime performance of the L2BP when processing 1 full orbit 4 15 worth of data L2bP_TOOLS 01 demonstrate by running the TestRead tools in each of the file 4 16 handling directories available for handling each auxiliary file L2bP_TOOLS 02 test any tools for graphical display of auxiliary calibration data files 4 17 L2bP_TOOLS 03 Test generation and or editing of auxiliary input files 4 18 L2bP_TOOLS 04 Demonstrate the EE2BUFR tool 4 19 Table 3 2 full list of test definitions 3 3 Test Data Summary Table 3 3 summarizes the test data sets used in the various Test Procedures These data sets are created using the MDA E2S and MDA L1b Processor and different versions are archived in the ECMWF ecfs system All t
50. ons outside the given timerange Table 4 7 test procedure for test L2bP_HMI_01 4 7 6 Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 7 are passed and failed otherwise Document No Issue Date Page AE PL KNMI L2BP 001 VII 30 01 2007 26 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 8 Test L2bP_EXT_01 This test procedure verifies the external interface for the L2bP software especially the ThinLayer emulator interface 4 8 1 Purpose Test L2bP_EXT_01 verifies requirements GEN 90 L2BP 470 L2BP 383 L2BP 460 L2BP 480 4 8 2 Prerequisites The L2bP software must be installed onto the test platform The ThinLayer Emulator must be installed onto the test platform 4 8 3 Input Specification All commands are entered by the operator via Linux command line or via the ThinLayer emulator user interface 4 8 4 Output Specification t b d 4 8 5 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed Insert the L2BP in the ThinLayer emulator TLE by note that this following the commands detailed in AD 9 description of this procedure is not yet available in this document Start the TLE user interface usr acs bin TIStandaloneMMI select the example order nr 5 supplied by the L2BP del
51. packed in directory TDS 4 15 3 Input Specification All commands are entered by the operator via Linux command line 4 15 4 Output Specification t b d 4 15 5 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed cd TDS extra Data not yet available note the current time INSTALL L2B_processor JobOrder L1B_fullorbit xml not yet available note the elapsed time since the start of processor Verify L2BP 770 by observing that the above command successfully processed an L1B product holding a full orbit of data within 30 minutes Table 4 15 test procedure for test L2bP_PERF_01 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 37 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 15 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 15 are passed and failed otherwise 4 16 Test L2bP_ TOOLS 01 This test procedure verifies the presence of tools to inspect view the auxiliary input datafiles used by the L2BP software 4 16 1 Purpose Test L2bP_TOOLS_01 verifies requirement L2BP 90 4 16 2 Prerequisites The L2bP software must be installed onto the test platform 4 16 3 Input Specification All commands are entered by the operator via Linux command line 4 16 4 Outp
52. pecifies the verification method that will be used to verify that the Test Procedure in the previous column satisfies the Software Requirement of the first column Table 4 20 describes the different verification methods Verification Verification Description Method Method Identifier This method involves verification by executing a test in accordance with an approved test procedure This type of test includes Functional Tests that verify the capability of the component to perform that function Test T and Quantitative Tests that measure a quantitative performance characteristic The test involves executing the test procedures and observing the desired results without quantitative assessment of the result This is the analytical determination that a requirement is met Verification by analysis will constitute one or more of the following engineering Analysis A evaluation mathematical modelling and technical or mathematical deduction This analysis depends upon test results published specifications as well as design considerations and operating conditions Verification by review or inspection will constitute a visual examination of the item together with a R amp I review of the descriptive documentation and or a comparison of the physical characteristics with those identified in the applicable specification Review and Inspection Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 43 54 Doc Tit
53. rating system compilers and external libraries will be installed and configured prior to the tests Test data sets if required will be identified in this document They will be made available as binary datapack and archived at ECMWF to ensure the repeatability of the Acceptance Tests The test procedures in this document can be used for regression testing of future versions of the L2bP software after the initial Factory Acceptance Test 3 2 Acceptance Test Cases Table 3 1 below summarises the main test classes to be performed on the L2bP Test Case Test Case Description Identifier L2bP Delivery L2bP_DEL Includes a validation checklist for L2bP deliverables L2bP General L2bP_GEN Includes software compilation and installation validation of Bit Byte documentation maintenance reliability and security requirements L2bP HMI L2bP_HMI Includes validation of the commandline usage of the main processor and command line tools that can be used for construction of auxiliary datafiles L2bP External Includes validation of the Job Order Products Interface List event logging exit code processor control and product report interface requirements as required by the ThinLayer Also requirements needed for the standalone and IFS integrated versions of the L2bP can be stated here L2bP Product Includes validation of Level 2b processing Generation requirements event logging data validation processing reference frames and Produ
54. s the processor does not need such a signal to stop after it has been launched Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 30 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed cp JobOrder test12 xml JobOrder testFAT xml edit JobOrder testFAT xml and change the Stderr_Log_Level field to any other valid log level except NOOP Then run the following command L2B_processor JobOrder testFAT xml gt text_stdout txt Verify L2BP 670 by observing that log messages are printed to the screen now which is only connected to stderr in this test case since all output to stdout is redirected to the file text_stdout txt Table 4 10 test procedure for test L2bP_EXT_03 4 10 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure in Table 4 10 above are passed and failed otherwise 4 11 Test L2bP_ PROD 01 This test procedure verifies the ability of the L2BP software after a successfull run to generate a product report according the specifications and verifies that it only produces the messages specified in the L2BP external ICD AD 9 4 11 1 Purpose Test L2bP_PROD_01 verifies requirements L2BP 580 L2BP 590 L2BP 600 L2BP 610 L2BP 620 L2BP 630 L2BP 640 L2BP 680 Not tested y
55. serve that this above command has created a new AUX_RBC product named AE TEST AUX RBC_AX_20060703T123456 20070703T 123456 0001 Verify L2BP 161 by observing that 3 of the 4 defined auxiliary files have been generated by the above commands and the 4th can easily be copied and edited by asimple text editor Table 4 18 test procedure for test L2bP_TOOLS_03 4 18 6 Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 18 are passed and failed otherwise 4 19Test L2bP_TOOLS 04 This test procedure verifies the presence of a EE2BUFR conversion tool for L1B product files 4 19 1 Purpose Test L2bP_TOOLS_04 verifies requirements on the EE2BUFR tool Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 41 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan no requirements defined yet in the SRD Run the EE2BUFR tool on any L1B file then check the contents of the generated BUFRfile by reading it and producing an ascii dump of the result 4 19 2 Prerequisites The L2bP software must be installed onto the test platform The BUFRtool must be installed onto the test platform 4 19 3 Input Specification All commands are entered by the operator via Linux command line 4 19 4 Output Specification t b d 4 19 5 Specific Test Procedure Commands to be executed are
56. signal L2BP 460 The L2BP shall produce a L2bP_EXT_01 D Product Report file upon completion of each processing Job Order as specified in the Aeolus L2B External ICD AD 9 L2BP 470 The L2BP shall provide for L2bP_EXT_01 D L2BP processing a Job Order initiated by the Thin Layer Emulator L2BP 480 The L2BP shall use the Thin L2bP_EXT_01 D L2BP Layer Emulator for testing the L2BP independently of the rest of the PDS L2BP 490 Ways to operate the L2BP L2bP_GEN_02 R amp I through interfaces different from the Thin Layer shall be specified in the L2BP Software OLUS SCENENE wind Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 50 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan requirement Test Case Name Verifi cation Method Software Component remark User Manual RD 5 L2BP 500 The L2BP shall process all complete observations in a Level 1b product L2bP_HMI_01 L2BP 510 The L2BP shall process all complete observations in a Level 1b product that are within the start and end times specified in the Job Order L2bP_HMI_01 L2BP 520 The L2BP shall process valid observations in a Level 1b file to produce an Aeolus L2B product L2bP_HMI_01 L2BP 530 The L2BP will use the Level 2B processing algorithms specified in the L2B ATBD RD 4 L2bP_GE
57. that the sizes of all output products are reported this is not yet implemented Verify L2BP 620 by searching for the string and observing that an exit code indicating success or failure field is present this is not yet implemented Verify L2BP 630 by searching for the string gt W lt or gt E lt and observing that warnings and errors if applicable are reported Verify L2BP 640 by searching for the strings Started L2B Processor and Finished L2B Processor and observing that these messages have a date time tag note that this first msg is not yet implemented As a replacement the first msg of any type reported in the report may be used Verify L2BP 650 by observing that tbd Verify L2BP 680 by that all informational Warning Error messages issued by the processor and written to the ProductReport are listed in the L2BP external ICD AD 9 this list needs to be added to the ICD Table 4 11 test procedure for test L2bP_PROD_01 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 32 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 11 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure defined in Table 4 11 above are passed and failed otherwise 4 12 Test L2bP_PROD_02 This test procedure verifies the ability of the L2BP sof
58. the generated product as specified in the L2B IODD AD 8 Verify L2BP 730 by observing that a Main Product Header is present in the L2B product and has a structure as specified in the L2B IODD AD 8 Verify L2BP 740 by observing that a Specific Product Header is present in the L2B product and has a structure as specified in the L2B IODD AD 8 Verify L2BP 760 by observing that the Specific Product Header in the L2B product contains several data set descriptors which have a structure as specified in the L2B IODD AD 8 Table 4 14 test procedure for test L2bP_OPT_01 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 36 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 14 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 14 are passed and failed otherwise 4 15Test L2bP_PERF_01 This test procedure verifies the ability of the L2BP software to process a L1B input product holding a full orbit of data within 30 minutes on a specific target platform 4 15 1 Purpose Test L2bP_PERF_01 verifies requirements L2BP 770 4 15 2 Prerequisites The hardware of the testplatform must have been verified using test L2bP_GEN_01 described in section 4 2 The L2bP software must be installed onto the test platform The additional test dataset must be un
59. tware to process a very large L1B input product holding 8 orbits of data 4 13 1 Purpose Test L2bP_PROD_03 verifies requirement L2BP 302 Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 34 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan 4 13 2 Prerequisites The L2bP software must be installed onto the test platform The additional test dataset must be unpacked in directory TDS 4 13 3 Input Specification All commands are entered by the operator via Linux command line 4 13 4 Output Specification t b d 4 13 5 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed cd TDS extra Data not yet available INSTALL L2B_processor JobOrder L1B_8orbits xml not yet available Verify L2BP 302 by observing that the above command successfully processed an L1B product holding 8 orbits of data Table 4 13 test procedure for test L2bP_PROD_03 4 13 6 Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 13 are passed and failed otherwise 4 14Test L2bP_OPT_01 This test procedure verifies the correct format of the L2B output product 4 14 1 Purpose Tests after a successfull run so following PROD_02 Test L2bP_OPT_01 verifies requirements L2BP 110 L2BP 162 L2BP 260 L2
60. tware to react properly on missing or corrupted input dat and missing input files and verifies a proper warning error messages is issued 4 12 1 Purpose Test L2bP_PROD_02 verifies requirements L2BP 540 L2BP 550 L2BP 560 L2BP 570 L2BP 660 4 12 2 Prerequisites The L2bP software must be installed onto the test platform The TDS dataset must be unpacked in directory TDS 4 12 3 Input Specification All commands are entered by the operator via Linux command line 4 12 4 Output Specification t b d 4 12 5 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed if not yet available unpack the TDS dataset with the following command tar ztvf L2BP_Release1 2a_TDS_20070125 tar gz cd TDS extra Data not yet available INSTALL L2B_processor JobOrder L1B_Corrupt xml not yet available Or alternatively as long as we have not produced a suitable test L1B product containing invalid or missing data use a hexidecimal editor to edit the L1B input product used for the previously used test L2bP_HMI_01 in section 4 7 change some numbers in it cd BUILD Test main Document No Issue Date Page AE PL KNMI L2BP 001 VII 30 01 2007 33 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed hexe
61. ut Specification t b d 4 16 5 Specific Test Procedure Commands to be executed are Procedure Command comments passed Observations failed cd BUILD Test RBC_FileHandling TestReadRBCdata AE_TEST_AUX_RBC_AX_20060703T123456 20070703T 123456 0001 cd BUILD Test L2B_AuxPar_file_handling Test_Read_L2B AuxPar file AE TEST AUX PAR 2B 20050112T000000_20110112T 000000_0012 EEF cd BUILD Test AMD_file_ handling TestReadAMDdata AE TEST AUX MET 12 20041201T000000_20041201T 003000_0001 cd BUILD Test AuxClim_file_handling TestReadAuxClimData not yet implemented Document No Issue Date Page AE PL KNMI L2BP 001 V1 1 30 01 2007 38 54 Doc Title Aeolus Level 2B Processor Software Verification Validation Plan Procedure Command comments passed Observations failed AE_TEST_AUX_CLM_AX_20010312T123456_20110312T 123456_0001 Verify L2BP 90 by observing that each of the above used tools converts one of the auxiliary input files into plain ascii and that such a tool is available for all 4 defined auxiliary filetypes Table 4 16 test procedure for test L2bP_TOOLS 01 4 16 6Pass fail criteria This test is considered passed if all requirements mentioned in the specific test procedure above in Table 4 16 are passed and failed otherwise 4 17 Test L2bP_TOOLS_02 This test procedure verifies the presence

Download Pdf Manuals

image

Related Search

Related Contents

Session Six: Software Evaluation Rubric    Kenwood JE950 Juicer  Cover 2450.p65  Fujitsu Windows Server 2012 Standard  ベビー食器セッ トボックス 取扱説明書  livret estival 2014 - Athletic Brunoy Club  Tyan S7016WGM3NR motherboard  V7 USB Wall Charger 1.0A  液晶式自動遮光溶接面  

Copyright © All rights reserved.
Failed to retrieve file