Home

User`s Guide - Spirent Knowledge Base

1. VC description The description of the video content file selected for capture VC v fr The frame rate of the captured video content VC v size The frame or image size of the captured video content VC v codec The video codec of the captured video content VC a codec The audio codec of the captured video content VC v br VC a br The audio bit rate of the captured video content VC uri The URL of the test video clip VC image uri The name of the sample image available on the server for this video VC protocol The network protocol used to play the test video VC format The container format of the test video clip VC group Please contact Spirent Product Support for information about this parameter VC duration The actual length of the source video Note that the video may be configured to replay from the server when it completes ALT e ELO The defined segment duration within the source video AKO EE Please contact Spirent Product Support for information about this parameter uri ALAE TITA Ju Please contact Spirent Product Support for information about this parameter uri The video bit rate of the captured video content VC a freq The audio sample rate of the captured video content Copyright Spirent Communications Inc 2014
2. capAwi 7 15 2014 5 31 28 PM 7 15 2014 5 31 43 DM vice XYZ CW 033 FL capAwi 7 11 2014 2 52 33 PM 7 11 2014 2 53 45 PM vice XYZ CW 033 FL capAwi 7 11 2014 1 46 21 PM 7 11 2014 1 46 33 PM vice XYZ CW 033 FL capAwi ScreenCapture 07 15 2014 13 42 7 15 2014 1 42 00 PM 7 15 2014 1 42 18 PM nCapture ScreenCaptureFile Figure 6 8 Selecting a File to Import 19 Select the file or multiple files and click Process Selected 20 You can now perform the same data analysis that you would on a standard Chromatic file Copyright Spirent Communications Inc 2014 44 Chromatic User s Manual 7 Chat Use the Chat function to test the video quality of your transmissions You can configure as shown in the previous diagrams Chromatic to simultaneously capture two video from different cameras You can use this to measure video chat latency between source stimulus and UERsx or between UETx and UERx Chromatic treats this as any other data input To install and enable the Chat function perform the following steps 1 Open your laptop as seen in the following figure Figure 7 1 Chat Setup 2 Set up devices for Skype Set up Daptor 2 4 Play Stimulus video BBBBIG20A 30min mp4 on the laptop or play the 3 4 UE Stimulus UE download from or set up chat between the Tx and Rx UEs 5 Align the camera and achieve a minimum of a 40 frame detection 6 Verify the audio is transmitting from Tx to Rx Keep recording levels medium
3. Included Seg The number of 12 second video segments in this test session to be included in report Count calculations The user has the option to exclude segments after testing on the Chromatic Data gt Review tab Se Te E T a The number of 12 second video segments in this test session to be excluded from Count report calculations The user has the option to exclude segments after testing on the Chromatic Data gt Review tab Skewness A measure of the asymmetry of the PDF for the video score data for this session Kurtosis A measure of the peakedness of the PDF for the video score data for this session Mean Audio The mean audio score for the channel Median The median audio score for the channel Audio Max Audio The maximum audio score for the channel Min Audio The minimum audio score for the channel MEL C The test device manufacturer as recorded in the metadata area of the Config or Record Options dialog Model The test device model name as recorded in the metadata area of the Config or Record Options dialog Role The role this device plays in the current test i e Reference DUT etc as recorded in the metadata area of the Config or Record Options dialog HW Identifier The device s serial number i e ESN IMEI etc as recorded in the metadata area of the Config or Record Options dialog Events This tab lists each event marked by the user both during capture using the Insert Event Marke
4. e Summarizing the results e Interpreting the results These steps are described in the following sections Additionally Chromatic data may be correlated with RF data from QXDM or IP data from a network sniffer 5 1 Reviewing for Data Integrity When data collection is complete navigate to the Data Review tab The Data Review tab may appear if the Automatically switch to Review tab when recording completes option has been selected on the Settings tab Copyright Spirent Communications Inc 2014 24 Chromatic User s Manual Chromatic 1 6 51G ja Home Capture Data Settings Help Review Unprocessed Processed Utilities Session 7 10 2014 2 46 40 PM Test 1 v Open Session Folder capA wmv Capture Source Length 00 00 07 Name CW 033 FL Framerate 15 fps Frame rate 60 fps Size 176x144 Bitrate 64K Play Stop Add Event Events vd Mute Audio Figure 5 2 Data gt Review Tab This tab allows the verification of data integrity prior to processing the results into a formatted output The review mechanisms available here are e Playing the recorded video e Opening the Session Folder These review techniques are described in the following sections 5 1 1 Play To gauge user perception of video quality and to ensure that captured results align with expectations the video captured during each Chromatic test may be played back on the Data gt Review screen You
5. Connections From the front of the device connect the following 1 Cell phones to channel 1 or channel 2 Red to red and white to white 2 Cameras to Cam 1 and or Cam2 3 PC to the USB port of your laptop Copyright Spirent Communications Inc 2014 Chromatic User s Manual 4 Optional GPS cable to the GPS port and use the auxiliary ports AUX for the cell phone chargers 5 Audio capture modules and the GPS receiver to the USB hubs 6 Plugin the power cord to power up the unit There is no on off switch The USB hardware detection occurs upon the first connection A notification displays when the automatic driver installation procedure finishes During testing each test device is mounted to the hardware fixture The following diagram shows the Chromatic system configuration UE11 gt UE12 UE21 gt UE22 UE1 F22 y e MEASURING TWO A SIMU LTAN EOUS Headset Audio In ONE WAY VIDEO Chromatic Headset CHAT SESSIONS Laptop Audio Out Using Chromatic Audio Daptor 2 Cable Connect Chromatic Audio Cable to Daptor 2 Line Audio Out with Splitter Input Play out Laptop Can also use same Chromatic Laptop with extended monitor Connect Playout Laptop Audio Out to balag Pring Daptor 2 Line In via Chromatic Cable Red Daptor Tw Connector Daptor T ro Inturface Connect Daptor 2 Headset Output to UE Headset using 3 5mm Daptor 2 cable for HTC others For Samsung need R2 S reversal ada
6. XYZ CW 064 FL capA Metrico Office 2 9 14 2011 1 19 15 AM 9 14 2011 1 19 56 AM ce XYZ CW 064 FL capA Metrico Office 3 9 14 2011 1 30 02 AM 9 14 2011 1 30 32 AM ce XYZ CW 064 FL capA Metrico Office 4 9 14 2011 1 31 40 AM 9 14 2011 1 32 10 AM ce XYZ CW 064 FL capA Mark Selected As Processed Figure 5 7 Data gt Unprocessed Screen 2 The processing queue lists Unprocessed test files Use the Add button to add locally stored files to the queue for processing Use the Remove Selected button to remove files from the Copyright Spirent Communications Inc 2014 28 Chromatic User s Manual queue Files removed from the queue will not be deleted and can be processed at a later time 3 Use the Edit Selected button to modify the processing parameters for a file In most cases the default parameters should be maintained Please accept the defaults and do not change them unless instructed by Spirent Support Edit Session Processing Parameters Bes Session Description Metrico Office 1 Ch A Device XYZ CW 064 FL FilePath C Users sb AppData Local Metrico Wireless Chromatic captures 2011 09 14 011724 capA wmy Circle Radius Min 20 Max 80 Averaging Window Video 5 Audio 10 FrameProcessor Additional Command Line Text FrameProcessor Command Line output C Program Files Metrico Wireless Chromatic FrameProcessor exe m C Users sb AppData Local Metrico Wireless Chromatic captures 2011 09 14 011724 capA w
7. completed successfully click OK to dismiss the Time Sync dialog i Time Sync Time Synchronization Source Internet Time Server GPS V Sync time on application startup Time sync completed successfully Cancel Sync Now OK Figure 3 3 Time Sync Dialog Copyright Spirent Communications Inc 2014 19 Chromatic User s Manual 4 Initiating the Test 4 1 Overview The system streams a test video from the hosted video server to the test device The Spirent supplied test video shows both a live action sequence and a Series of circular symbols that are frame markers The symbol position changes as the video plays and identifies the video frame number as shown in the following image Figure 4 1 Test Video Sample Chromatic marks individual frames with symbols which it automatically interprets as frame numbers during playback on the test device Chromatic automatically detects these symbols when observing video played back on the test device as shown in the following image FEEL IP UEEPEEEE Ea m Pa KAG Figure 4 2 Chromatic Video Stream The video camera and control software record the captured video from the handset Chromatic processes this video and assesses each frame based upon timing and video integrity using a Gross Error Detection algorithm Chromatic uses a five point video quality score to summarize performance Chromatic also assesses streaming media audio
8. files at the same time This option may shorten overall processing time on powerful multi core systems e If performance suffers with the Concurrent Processing option lower the Max number of concurrent processes setting or disable concurrent processing entirely 6 Click the Process Selected button underneath the file list SE Copyright Spirent Communications Inc 2014 29 Chromatic User s Manual 7 10 2014 8 45 43 PM 7 10 2014 8 45 50 PM 7 10 2014 5 20 52 PM 7 10 2014 5 21 05 PM 7 10 2014 2 46 40 PM 7 10 2014 2 46 48 PM 7 10 2014 2 38 55 PM 7 10 2014 2 42 26 PM Edit Selected Process Selected Lo LE ei Channel B ce XYZ CW 033 FL capA ce XYZ CW 033 FL capA ce XYZ CW 033 FL capA ce XYZ CW 033 FL capA A Mark Selected As Processed Figure 5 9 Processing the Data 7 Each file that has been successfully processed will move from the Data gt Unprocessed screen to the Data gt Processed screen 8 The Processing Complete dialog will appear after all files have been processed Note that the processing for each file will take at least as long as the capture and may take up to twice as long 9 Click OK to exit 5 3 Summarizing the Results Navigate to the Data gt Processed screen to summarize the results Copyright Spirent Communications Inc 2014 30 Chromatic User s Manual Test Description 7 10 2014 8 47 20 PM 7 10 2014 8 47 25 PM Device XYZ CW 033 FL test4 7 10 2014
9. performance The audio portion of the Chromatic test clip plays a repeating sequence of dual tone multi frequency signaling DTMF The system records and scores the audio and based upon the number of tones correctly received The processing software also keeps timing information about which video frames correspond to the audio tones Chromatic also reports impaired and frozen frames In a frozen frame the circular frame symbols are distinguishable but no change can be detected from the previous frame As shown in the following image Figure 4 3 Impaired Frame Copyright Spirent Communications Inc 2014 20 Chromatic User s Manual The following figure displays Chromatic frame detection e b ew EN ie Chromatic detects when frames are streaming normally Nag HP ali Observed Video Playback Da aii f f aaa ERE RE RE RRR ER RRR RE RE RE RE RE RE EEE EE EG wwe v A ri ger Pad BL Pa REPRE EERE Ea EE aaa R RR ERE EER REE EEE E e X X P D EN nn ME RA wCH a ka on d pa a bb a d RRR EERE RRR RRR RRR RRR RE E E RR REE EEE GS RE R ERR RE RRR RRR ERR ERE S BERBER EEE EE ES When frames are When frames are frozen not detected Figure 4 4 Video Playback Combined the video score audio score impairment and freeze metrics provide a quantitative assessment of mobile video performance 4 2 Testing When the video audio and GPS devices are working start testing by
10. saving At this time the test videos will appear in the Video A and or Video B windows The audio and video sampling statistics that appear in the Information area are used to ensure that the test devices are positioned properly Copyright Spirent Communications Inc 2014 17 Chromatic User s Manual E G Home Capture Data Settings Help Current Time GPS Duration LAT 2506178297 6 19 53 PM EEN LON 12164026606 W Record Time Sync Config UTC Local Mute Audio Warnings Channel A Camera Settings Information Reset 53 Channel Sampled Frames Circle Detection Rate of sampled Frame Detection Rate 96 of sampled Last Audio Sequence Figure 3 2 Device Setup on the Capture Tab Confirm that the test video is actively playing on the test device For the best test results the Circle Detection Rate and the Frame Detection Rate should be as high as possible These values are color coded green yellow and red to indicate good fair and poor performance with respect to detection rate Physically adjust the cameras or use the Camera Settings button to maximize the Circle Detection Rate and the Frame Detection Rate See Appendix A for recommendations on finding the optimal camera settings For the best results e Circle Detection Rate should be equal to 100 e Frame Detection Rate should fall between 50 and 100 Press Reset following a
11. tel o gt Figure 4 7 Capture Tab during Device Testing The video that appears is a sample of the live video being captured As a result not every video frame is displayed An audio warning an electronic pulse sounds if the camera is not properly positioned and cannot detect the frame or circles for more than one second Check the Mute Audio Warnings box to disable these notifications Use the Insert Event Marker button to log a playback interruption 9 Device Interrupted Playback Figure 4 8 Event Type Selection Select whether this is an instance of Device Interrupted Playback or User Interrupted Playback The Event Type and Time will appear in the Events dialog accessible from the Data 5 Review page Events are also presented in the Chromatic output report Copyright Spirent Communications Inc 2014 23 Chromatic User s Manual 5 Analyzing Results Click Stop to end the test and enter an optional description The system adds the test file to the list of files to be processed Check Discard session to delete all files associated with this capture E Session Description Le LEI a Enter a description for this session Test Description Discard Session Save Figure 5 1 Session Description Dialog The steps to analyze video quality data captured with Chromatic include e Reviewing the recorded video and captured session files for data integrity e Processing the data into a meaningful format for analysis
12. this test as entered in the setup Channel The description of the capture channel as entered in the Record Options dialog at the start of the test Playback Success Chromatic automatically tags a capture as successful or not successful depending upon a threshold timeout ratio of N seconds Finish Frame Reached Chromatic recording ends when end frames are encountered Measured Duration Measures duration is from the first moving frame to the timestamp of the first occurrence ECU Co dl Mollie El Measures the startup latency from Play to First Moving Frame Total Impaired Duration When the Video is lost no circles detected vs when the video is tiled at least one circle detected but no frame is detected Impaired Period Count The number of times and durations that the playback was interrupted Rebuffering Re buffering time will be measured as the Total Playback time minus the source clips known duration Playback Percentage Playback percentage is a function of Total playback time and re buffering time It should be measured as TotalPlaybackTime Rebuffering Time T otalPlaybackTime Test Video Length Actual length of the video with a known length with a special indicator that marks its end Timeout Threshold Pre set seconds of the timeout threshold Figure 5 27 Playback Delivery of KPI Statistics Copyright Spirent Communications Inc 2014 40 Chromatic User s Manual 6 Screen Capture optional If you purchase th
13. to keep the tones from becoming distorted 7 Record for 3 10 minutes at a frame detection rate of 40 percent for Chat 8 Click Stop 9 Process the KPIs Ge Copyright Spirent Communications Inc 2014 45 Chromatic User s Manual 10 Note that Chromatic Score and Weighted Session Scores are referenced to 20fps for Chat when you use 20fps stimulus 11 Review your Excel output which should look like the following example Time CamA MarkerA 8 CamB 7 MarkerB Offset Unadj LKPI Calib Offset 6 149 FRAME 369 12 5 566 FRAME 333 12 0 583 6 165 FRAME 370 12 5 583 FRAME 334 13 NAME 6 182 FRAME 371 13 5 599 FRAME 335 13 0 583 6 199 FRAME 372 14 5 616 FRAME 336 14 0 583 6 215 FRAME 373 14 5 633 FRAME 337 14 0 582 6 232 FRAME 374 14 5 649 FRAME 338 15 NAME 6 249 FRAME 375 15 5 666 FRAME 339 15 0 583 6 265 FRAME 376 15 5 683 FRAME 340 16 NAME 6 282 FRAME 377 16 5 699 FRAME 341 16 0 583 6 299 FRAME 378 16 5 716 FRAME 342 17 NAME 6 315 FRAME 379 17 5 733 FRAME 343 17 0 582 6 332 FRAME 380 17 5 749 FRAME 344 18 NAME 6 349 FRAME 381 18 5 766 FRAME 345 18 0 583 6 365 FRAME 382 18 5 783 FRAME 346 19 NAME 6 382 FRAME 383 19 5 799 FRAME 347 19 0 583 6 399 FRAME 384 20 5 816 FRAME 348 20 0 583 6 415 FRAME 385 20 5 833 FRAME 349 20 0 582 6 432 FRAME 386 21 5 849 FRAME 350 21 0 583 6 449 FRAME 387 21 5 866 FRAME 351 21 0 583 6 465 FRAME 388 22 5 883 FRAME 352 22 0 582 6 482 FRAME 389 22 5 899 FRAME 353 22
14. 0 583 6 499 FRAME 390 23 5 916 FRAME 354 23 0 583 6 515 FRAME 391 23 5 933 FRAME 355 23 0 582 6 532 FRAME 392 23 5 949 FRAME 356 24 NAME 6 549 FRAME 393 24 5 966 FRAME 357 24 0 583 6 565 FRAME 394 24 5 983 FRAME 358 25 NAME 6 582 FRAME 395 25 5 999 FRAME 359 25 0 583 6 599 FRAME 396 25 6 016 FRAME 360 26 NAME 6 615 FRAME 397 26 6 033 FRAME 361 26 0 582 E Cc C12 rmaAaar ana arc Cc nan rnAnar ECH ET H HALAARAr This report contains a specific comparison file indicated in yellow By comparing the time offsets for the same Marker Number in Captures A and B the report displays the end to end latency In this example the LKPI 233 ms Copyright Spirent Communications Inc 2014 46 Chromatic User s Manual Appendix A Definitions of Exported Result Fields The Data gt Processed page in Chromatic provides the Generate Excel Report from Selected option as a way to obtain detailed setup and performance results This Appendix describes many parameters that can be found in the exported result file REPORT Tab This formatted tab summarizes video and audio performance for the selected sessions Portions of the data marked by the user for exclusion are omitted from the calculations on the REPORT tab Video Score Statistics elle ln TA AVE fOe The mean video score for this session Aa of time Frozen The amount of time the video was frozen divided by the total session duration Frozen video occurs when the circular fr
15. 100 46K mpa remp Link CW 036 768k libx264 320x240 20 tibfaac 44100 46k mp rtsp Link ai 768K libx26a 320x240 20 men 44100 46K beem Link CW 037 2048K libx264 320x240 30 tibfaac 44100 J46k mp4 rtsp Link SC 2048K libx264 320x240 30 Iren 44100 46K beem Link CW 038 4096K libx264 640x480 15 tibfaac 44100 46K mp44 rtsp Link aaa 4096K libx264 640x480 15 mz 44100 Luet mpa rtmp Link CW 059 768K llibx264 320x240 20 libfaac 44100 46k 3gp rtsp Link CW 063 800K libx264 384x240 30 tibfaac 44100 J46k 3gp rtsp Link Figure 1 6 Video Test Site 4 Click any item in the Content column to select the test video Adjust the handset volume level to approximately 7596 of the maximum 6 Connect an audio cable from each audio capture module to the headset jack of each mobile device 7 Position the test devices in the rig CF 1 4 Ensure Proper Positioning Use the Chromatic software to ensure the test devices are properly positioned in front of the cameras This section discusses the basics of positioning and configuring the camera Fine tuning is discussed in the next chapter Channel A Camera Settings Figure 1 7 Chromatic Software From this screen perform the following steps Copyright Spirent Communications Inc 2014 9 Chromatic User s Manual 1 2 To begin video performance testing double click the Chromatic icon on the Windows Desktop or from the Wi
16. 8 45 43 PM 7 10 2014 8 45 50 PM Device XYZ CW 033 FL Test2 7 10 2014 5 20 52 PM 7 10 2014 5 21 05 PM Device XYZ CW 033 FL Test1 7 10 2014 2 46 40 PM 7 10 2014 2 46 48 PM Device XYZ CW 033 FL Figure 5 10 Data 5 Processed Screen 5 3 1 Reporting Scripts The Reporting Scripts button on the Data 5Processed page provides access to informational charts for any file that has been processed Analysis options here include e Compare Time Series Data e Compare Video Score PDFs e Compare Audio Score PDFs e A V Sync Report To display the analytical charts perform the following steps 1 Select the desired test file s 2 Click Reporting Scripts and choose the desired action 3 Confirm that each file to be compared has been added in the Compare Time Series Data dialog Copyright Spirent Communications Inc 2014 31 Chromatic User s Manual E 9 14 2011 1 17 24 AM Metrico Office 1 a capA wmv Device XYZ CW 064 FL Col 9 14 2011 1 19 15 AM Metrico Office 2 2A capA wmv Device XYZ CW 064 FL E 9 14 2011 1 30 02 AM Metrico Office 3 SA capA wmvy Device XYZ CW 064 FL E 9 14 2011 1 31 40 AM Metrico Office 4 4 capA wmv Device XYZ CW 064 FL lt Remove Figure 5 11 Task Inputs Task Outputs Dialog 4 The time series data video score PDFs or audio score PDFs will appear together for comparison CES Instantaneous Audio amp Video Performance Metrico Office 1 Device XYZ CW 064 FL 10 15 20 25 Time s
17. Figure 5 6 Session Folder Contents after Processing 5 2 Processing the Data New folder Name S capA wmv capA wmv frameprocessor csv capA wmv frameprocessor csv audio csv capA wmv frameprocessor csv bins csv capA wmv frameprocessor csv markerlo capA wmv frameprocessor csv segments capA wmv frameprocessor csv tonetransi capA wmv frameprocessor csv totals csv capA wmv frameprocessor csv video csv B capA wmv frameprocessorlog txt capA wmv postprocessorlog txt capA wmv toneSequences csv ZIL capA Plots pdf captureinfo xml gps gpx Date modified 9 13 2011 9 18 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 2 57 PM 9 14 2011 3 47 PM 9 14 2011 2 57 PM 9 15 2011 4 29 PM 9 13 2011 9 18 PM Type Windows Media A Microsoft Excel C Microsoft Excel C Microsoft Excel C Microsoft Excel C Microsoft Excel C Microsoft Excel C Microsoft Excel C Microsoft Excel C Text Document Text Document Microsoft Excel C Adobe Acrobat D XML Document GPX File To process the data perform into a useable format perform the following steps 1 Navigate to the Data gt Unprocessed screen 9 600 KB 31 KB 1 KB 4 KB 1 KB 1 KB 3 KB 1 KB 50 KB 31 KB 1 KB 1 KB 16 KB 3 KB 5 KB Metrico Office 1 9 14 2011 1 17 24 AM 9 14 2011 1 18 10 AM ce
18. aQ SPIRENT Communications Pa a Spirent Chromatic 1 7 User Manual 5280 Corporate Drive Frederick MD 21703 Document Version 2 1 August 2014 Chromatic User s Manual Contents L TOO O E 6 1 1 OVET La AA E T eke eae IORAA 6 12 Hardware LOAN aaa ah 6 1 3 Mobile Device Configuration luummmmsanussawanaawawanaawawanawananaasananaasanansanananaananannnanannann nananana 8 L4 Fee Proper ETH 9 ZI NEE aaa aa 11 SE 11 AN ee ee eee 11 2 2 1 Tm yaC ee O ME 12 2 2 2 Eeer 12 293 O72 0 UR eal ap 81 E 13 2 3 1 LAPU ODO E 13 2 3 2 Pen ES GG AA 14 2 30 MICO EE 14 Di AA 15 Confirming Device ege e TE 17 ION de TN KE 20 41 OVO AA terete tert en terrestres cert eer eter tr er err n eer errr rr 20 PE THEN AABANGAN NANANA ENNA AA AANO AA 21 3 AMAZING RES ABA ANAKAN GAAN AA AA 24 5 1 Reviewing for DAG E 24 5 1 1 PU AA E 25 5 1 2 Open SESSION POC maka aieiaa k ANNA NANANA DIA egri NANANA NA 2 T3 P E AA AA 28 SG DUMAN ER UA AA AA AA 30 5 3 1 EECHER 31 5 3 2 Generate Excel Report From Selected uuuummmmnnuanananawawanananuanawawawawawawananananaanawawawawawasanananananasaauanananana 34 5 3 5 Mark Selected As Unprocessed isinisisi nna nannaa dadaan Nii AAAA aai 37 5 3 4 Re R n Post Processing EE 37 E ANNE Eer EE 38 Sa HETO MERES IS dor EEEE AA NAE 38 5 5 1 bat ge eet Video SCOTS aaa AA AA 38 5 5 2 Piterprenn e AUO Ee 39 Copyright Spirent Communications Inc 2014 3 Chromatic User s Manual 5 6 Correlating Chromatic a
19. aa AA AA 20 Pers Wee E Da EE 20 POE NINO Ply NAK a AA AA ERAEN NRA 21 Figure 425 Record Reie EE E 21 Figure 4 6 Content Selection Dialog aan ANAN AA ANAN 22 Figure 4 7 Capture Tab during Device Testing uuu sssssssscssssssssssessscssssesesssssseneanscsesseeanecsssneeaseeseeneanessesneneanenseea 23 BEE Event HEEN 23 Figure 5 1 Session Description Dialog 1 1 manana nana nnanawasanaanasasananaanasasananaanasananasnnn nn 24 BEE 5 2 Data REVIGW Ee 25 Figure 5 3 Event Description Dialog idaan NAA 26 Bone 4 EU DN r a 217 Figure 5 5 Session Folder Contents Prior to Processing s esssesssssrrssrersrenrnssrinsnennnennnsnninnninnnennnnnnnnnnnnnnnnnnnns 27 Figure 5 6 Session Folder Contents after Processing mmmmmmmmunmananuanawawaawawanaawawanaawawannawawannawanaanawanaanawansananansanaannans 28 Figure 5 7 Data gt Unprocessed SCIree sssssscssessssessssecssssessecsessssessecsnssesearessnseeseecsessssesrecensseserersnsseataressnssesnensnseess 28 Figure 5 8 Edit Session Processing Parameters Dialog ee 29 Mu O Processine DAA AA AA AA 30 Fig re 5 10 Data ProceSSeG Screen cizesscescsesedcsedvendscscyostscesyelanescensievesenadansaesadenedvelenascwnsbesanetaryeocenslensveletstpeedaveceeudees 31 Figure 5 11 Task Inputs Task Outputs Dialoguuuuummmmmaanananuwananunuanawawawawawanananannawanawawawawanananananaanananawasaanananananasasuna 32 Figure 5 12 Compare Time Series Data Output uuuummmmumasasunuwunununuawawawawawawananananaanawawawawanana
20. aired 4b greater than or equal to 3 0 less than 2 0 o greater than or equal to 4 0 Device Playback Interrupted E ee O eee ee a EECH 34G a E mmm mm PE Figure 5 16 Video Scores by Segment Copyright Spirent Communications Inc 2014 0 0056 0 0056 100 00 0 00 100 00 34 Chromatic User s Manual Video Score Distribution 71 4 6 4 5 4 4 4 9 4 214 1 4 0 15 90 5 95 8 5 7 5 61 5 51544 4 7 4 6 4 5 4 4 4 3 4 2 4 1 4 0 3 9 3 7 26 35 Bal aala i V ef 1 Mm On ON om OM O om o os oms OM ON ON ON ON ON N 064F1 on 0 1 Om oN ON ow 50N at lamon eieiei Z CW 064 F yu E H ox O ox ow ow Om alal aalala d CW O064 4L 0 O Tee 100 Data om OR ox ox Ox amaseton mapan 09 O Figure 5 17 Video Score Distribution Video Performance Comparision Chart gt Device AYZ CO Device AYZ COP Device XYT CW OAFL Device XYZ CW 061 FL 1 LS Segment segment 12 seconds Figure 5 18 Video Performance Comparison Chart Copyright Spirent Communications Inc 2014 35 Chromatic User s Manual Video Score CDF Device XYZ CW 061 FL Device NYI CW O6AFL pa a a Pri age IE e Device XYZ CW OAFL Dewice XYZ CW DAF Device XYZ CW 064 FL Device XYZ CW 064 FL Device XYZ CW 064 FL Device XYZ CW 064 FL Average 1 89 Standard Deviation Maximum Score Segment Count Duration seconds greater than or equal to 3 0 less th
21. ame markers are distinguishable but no change was detected from the previous frame of time Impaired The amount of time the video was impaired divided by the total session duration Impaired video occurs when the video is so distorted it is not possible to distinguish the circular frame markers to 3 0 value greater than or equal to 3 0 value less than 2 0 to 4 0 value greater than or equal to 4 0 Device Playback The number of events marked by the user either during testing or Interrupted during data reviews This statistic includes playback interruptions by both the device and the user Audio Score Statistics Duration seconds The length of the session in seconds greater than or equal The percentage of audio score measurements for the session with a value to 3 0 greater than or equal to 3 0 less than 2 0 The percentage of audio score measurements for the session with a value Copyright Spirent Communications Inc 2014 Chromatic User s Manual less than 2 0 greater than or equal The percentage of audio score measurements for the session with a value to 4 0 greater than or equal to 4 0 Validation Tab This tab contains statistics to quickly help determine whether valid data was captured during each test session Session A unique identifier for each test session included in the data set Channel The Chromatic video capture channel Channel The description of the capture channel as entered i
22. an 2 0 o greater than or equal to 4 0 Figure 5 20 Audio Score Statistics Audio Score Distribution Percentage of Values in Range nmmnmmammammmmmammamana ks 33 32151 rarr 29 124 30 4 9 4B 4 7 had 4 5 44 4 3 4 2 4 1 40 38 3 7 3 6 35 34 33 32 31 30 29 28 2 28 27 2 Z ON 064 H 0 0 0 0 o ox 0 o 0 ox 3 EEN 0 0 DS Fa ox EEN 0 0 d OW 064 FAL 0 0 0 0 0 0 o 0 0 0 0 03 lo 0 0 0 0 oo 100 sted a 0 CW O64 alo maman mamam mi lox o HEH 0 EE CW 064 FL Ox o many los Figure 5 21 Audio Score Distribution Copyright Spirent Communications Inc 2014 36 Chromatic User s Manual Audio Performance Comparision Chart Device XYZ CW 064 FL Device XYZ OW 064 F a Device XYZ CW 064 FL W dulio Scom Device XZ OW 064 FL A i 1 5 segment segment LA seconds Device XYZ DA DA FL Dever XA CW 64 A ng E CG ie i Device XYZ OW 04 FL Devece XYZ ON A4 Figure 5 23 Audio Score CDF 5 3 3 Mark Selected As Unprocessed Use this option to change the status of a processed file to that of unprocessed You have the reverse option under the Processed tab 5 3 4 Re Run Post Processing Should you wish to change or correct the FITT as discussed in section 2 4 you can use this option to re run an already finished capture at a different FITT Copyright Spirent Communications Inc 2014 37 Chromatic User s Manua
23. anged the test videos in use through the Content Metadata area of the Settings gt Capture Processing tab click Refresh in the Content Selection dialog to display the correct file list Sa E Content Selection Directory 4 http updates metricowireless com cw Files Name Description FPS Resolution Protocol vcodec acodec bitrate CW 033 F CW 033 FL CW 033 CW 036 FL CW 036 CW 037 FL CW 037 CW 038 FL CW 038 CW 033 F CW 033 FL CW 033 CW 036 FL CW 036 CW 037 FL CW 037 CW 038 FL CW 036 15 15 15 20 20 30 30 15 15 176x144 176x144 176x144 320x240 320x240 320x240 320x240 640x480 640x480 libx264 libx264 libx264 libx264 libx2 4 libx264 libx264 libx264 libx264 libfaac libfaac libfaac libfaac libtaac libtaac libfaac libfaac liptaac Refresh Figure 4 6 Content Selection Dialog Click Start in the Record Options dialog to start the test During testing each test video will appear in the Video A or Video B area of the Capture tab and the Duration and Information areas will update continuously as shown in the following example Copyright Spirent Communications Inc 2014 Z2 Chromatic User s Manual BB Chromatic 1 6 Current Time GPS Duration LAT 25 06178297 7 34 12 PM Gana LON 121 64026606 Record Time Sync Config UTC O Local Mute Audio Warnings Channel A i A iW ka MIA Camera Settings Information Reset Ss C GE Fame Deteion Rate 6
24. apInfoTM and similar mapping applications To capture GPS information with Chromatic perform the following steps 1 Connect a GPS device and enable the device to acquire a signal 2 Inthe GPS area of the Settings dialog confirm that the Enable GPS box is selected Copyright Spirent Communications Inc 2014 12 Chromatic User s Manual 3 Select the GPS Type as Garmin or NMEA for DeLorme or any device that supports this standard For a Garmin device click the Detect Garmin GPS button to activate For an NMEA device select the corresponding COM Port If available live GPS data will display here This includes e Current latitude and longitude e GPS Fix status which is indicated by the colored circle in this area Hover over the circle for the status tooltip The status is provided as NO FIX 2 D DIFF 3 D or 3 D DIFF DIFF status refers to a lock on differential GPS sensors providing a more accurate location reading than standard GPS e The blinking heart blinks each time a GPS message is received e The yellow triangle A indicates an error Click the Restart GPS button to activate in some cases it may be necessary to click this button twice 2 3 Capture Processing Specify settings related to video capture and processing on the Capture Processing tab The bb o_o different areas of this tab are discussed in detail below E Chromatic 1 6 Home Capture Data Settings Help 7 3 d Gener GPS Time Ca
25. can also use this screen to e Set the session start and end times e Exclude portions of data from report calculations e Flag significant events e Measure the time between playback initiation and the first frame seen To play the video 1 Select the desired test file from the Session drop down 2 Click Play in the video playback area Setting the Session Start and Session End limits the reporting for the session to data collected between these time markers To set the Session Start and Session End 1 Position the playback cursor at the desired session start time 2 Select Add Event gt Set Session Start and End gt Session Start 3 Position the playback cursor at the desired session end time and repeat choosing Session End this time Copyright Spirent Communications Inc 2014 25 Chromatic User s Manual 4 The Session Start and Session End times will appear in the Events dialog Data occurring before the Session Start marker and after the Session End marker will be ignored in the Chromatic output report The Exclude Video Range Segment choice provides the option to mark data for exclusion from the final report To exclude a range 1 Gs 3 4 5 Select Add Event gt Exclude Video Range Segment gt Range In the Define Range dialog slide the red markers along the playback bar to define the range to exclude In the Description box enter descriptive text giving the reason for the exclusion Click OK to continu
26. d first frame seen 1 SE EN Da 5 1 2 Position the playback cursor at the time of playback initiation This is usually the time when the user s finger can be seen manually pressing the button to start the video Select Add Event gt First Frame Time Measurement gt Playback Initiated Wait until you see the video start to play Select Add Event gt First Frame Time Measurement gt First Frame Seen The Playback Initiated and First Frame Seen events will appear in the Events dialog and in the Chromatic output report The time difference between the First Frame Seen and the Playback Initiated is reported as the Startup Time on the Validation tab of the Chromatic output report Select the Events button on the Data gt Review tab to view all events entered during and after testing Channel Event Type Start 00 00 00 000 00 00 01 208 Peginn ng Excluded Playback Intiated First Frame Seen RangeExclude 00 00 12 000 00 00 23 999 Bad Segment Device Interrupted Stop 00 00 40 658 00 00 43 016 End Excluded UserlnitiatedPlayback 00 00 01 223 PlaybackStarted 00 00 06 001 UserlnterruptedPlayback 00 00 35 619 Figure 5 4 Events Dialog Open Session Folder The Session Folder for each recorded test includes the recorded WMV file and associated GPS and capture logs After processing see Section 9 2 this folder will also contain video and audio scores in text and comma delimited format as well as a time series plot
27. depicting key test metrics Access to this raw data may be desirable for detailed analysis or data manipulation To access the Session Folder 1 _2 On the Data gt Review tab select the desired test file from the Session drop down Click the Open Session Folder button OO ss e AppData Local gt Metrico Wireless Chromatic captures 2011 04 14 192015 v 5 Search 2011 04 14 19201 Organize v Include in library Share with New folder Kr Favorites Name Date modified Type Size HO Desktop capA wmv 4 14 2011 3 20PM Windows Media A 6 420 KB JB Downloads captureinfo xml 4 14 2011 3 20PM XML Document 3 KB E Recent Places gps gpx 4 14 2011 3 20PM GPX File 4 KB Libraries Figure 5 5 Session Folder Contents Prior to Processing Copyright Spirent Communications Inc 2014 27 Chromatic User s Manual 3 After processing the screen will look like the following os w Joo lib GN n ie gt D AppData Local Metrico Wireless Chromatic captures 2011 09 14 011724 m i Search 2011 09 14 011724 P Organize v Include in library Share with v 4 3X Favorites BR Desktop Downloads S Recent Places 4 9 Libraries D Es Documents gt Music gt El Pictures gt EB Videos s Homegroup gt 2 Suzy Home SUZYHOME PC ab Computer gt os c gt ca Microsoft Office Click to Run 2010 Protected Q gt Network h 15 items
28. e The excluded range will appear in the Events dialog Data within this range will be ignored in the Chromatic output report Note The actual time range excluded will start at the beginning of the 12 second segment containing the start marker and finish at the end of the 12 second segment containing the end marker For example if the user selects to exclude 10 seconds to 20 seconds the actual excluded time range will be from 0 seconds to 24 seconds Chromatic operates exclusively in 12 second segments To exclude a segment 1 Se 3 4 Position the playback cursor at the time to exclude Select Add Event gt Exclude Video Range Segment gt Segment Enter an Event Description The 12 second range containing the selected point will appear in the Events dialog Data within this range will be ignored in the Chromatic output report 2E Event Descri ption Figure 5 3 Event Description Dialog To manually mark an event in the recorded video 1 Position the playback cursor at the desired event time 2 Select Add Event gt Add Event and then one of the three options e User Interrupted Playback e Device Interrupted Playback e Custom When this option is selected it is necessary to enter an Event Description The marked event will appear in the Events dialog and in the Chromatic output report Copyright Spirent Communications Inc 2014 26 Chromatic User s Manual To measure the time between playback initiation an
29. e screen capture option you will be able to remotely capture images on your cellphone import them into chromatic and analyze the results Screen capture is a separate program that requires you purchase a license The maximum length of a video you can capture is 90 minutes at 60 fps The audio will be between192 and 196 kbps To run this upgrade perform the following steps 1 Contact Spirent Technical Support to obtain a screen capture download 2 After receiving the file use any unzip tool to perform an extract all After the extracts are complete Spirent recommends you create a shortcut icon on your desktop Also set your desktop view to 100 3 Click on the desktop executable and a screen like the following displays E Capture Utility Reset To 480x360 640x480 640x360 854x480 Output Location CA Users rkrummeric Desktop Capture Name ScreenCaptureFile Target Frame Rate 30 Enable GPS Ah Latitude Longitude Capture Duration 7 minutes seconds start Figure 6 1 Capture Utility 4 From the Capture Utility menu select an aspect ratio to record the video 5 Set the Output Location as the folder in which you wish to store the data you captured in the images These files will be imported into Chromatic Enable the GPS option if desired and connect your GPS device By unclicking the show capture option you can remove the red capture box until you need it 8 Connect the ROXIO GAMECAP HD PRO provid
30. econds Metrico Office 3 Device XYZ CW 064 FL video impairment timer 18 video freeze timer J 20 25 30 35 Time seconds Figure 5 12 Compare Time Series Data Output Copyright Spirent Communications Inc 2014 32 Chromatic User s Manual Mi s LS d OO tc SR Video Performance Distribution Metrico Office 1 Device XYZ CW 064 FL Metrico Office 3 Device XYZ CW 064 FL 1000 0 L 600 0 800 0 500 0 o 400 0 E 600 0 8 81 300 0 400 0 L 200 0 200 0 Ion 0 i 0 de 0 2 0 4 0 6 0 8 1 0 de 0 2 0 4 0 6 0 8 1 0 Video Performance Video Performance Figure 5 13 Compare Video Score PDFs Output PER Sr HOO e SR Audio Performance Distribution n e Office 1 Device XYZ deiere yale Office 3 Device XYZ CW 064 FL 12 0 7 0 10 0 6 0 S 8o ERE 8 6 0 S35 4 0 Se 2 0 1 0 0 0 Qo 0 2 0 4 0 6 0 8 1 0 0 0 2 0 4 0 6 0 8 1 0 Audio Performance Audio Performance Figure 5 14 Compare Audio Score PDFs Output 5 The A V Sync Report provides both time series and distribution views for audio variation Audio variation refers to the time offset between the captured video and audio When the audio leads the video audio variation is reported as a positive number When the audio lags the video audio variation is reported as a negative number Copyright Spirent Communications Inc 2014 33 Chromatic User s Manual lees AVSync Report Nag nba Office 1 D
31. ed by Spirent to the laptop and the cellphone As shown in the following image na lt pap DT AU D V ee e Audio Input MWEN Figure 6 2 ROXIO Profile Copyright Spirent Communications Inc 2014 41 Chromatic User s Manual 9 Connect the cellphone to the ROXIO unit and connect the unit to the USB port on your laptop as in the following image Q 7 ch 5 gt H T O U D O Figure 6 3 ROXIO Setup 10 Open the ROXIO software and a screen like the following displays File Tools Help EDIT amp SHARE Figure 6 4 Image Capture Tool 11 Attach your cell phone and begin playing your video You may use the recommended Spirent approved test videos found at 12 When the image is playing click Capture on the ROXIO screen and the image on the telephone should appear as in the following screen If you do not see the screen verify that the Input is set to HDMI If you still do not see the screen try restarting your cellphone Copyright Spirent Communications Inc 2014 42 Chromatic User s Manual Le Rowo Game Capture HD PRO e e Figure 6 5 Image Capture Example 13 Center the two red boxes over the image with the smaller interior darker box centered over the spinning circles as in the following image Figure 6 6 Centering the Capture Screen 14 Begin recording your chosen video by clicking Start on the Chromatic software 15 Click Start on the Capture Utility and the sys
32. etween the audio and video is often undesirable DE The capture date Segment Start The segment start time in UTC Segment End The segment end time in UTC Copyright Spirent Communications Inc 2014 52 Chromatic User s Manual Relative Start The start time of the segment in seconds relative to the entire captured video Relative End The end time of the segment in seconds relative to the entire captured video Length The length of the segment in seconds defined as the difference between the relative end and relative start times Seg Perf Index The ratio of observed video frames to expected video frames for this segment Capture Frames The total number of frames analyzed in this 12 second segment of the recorded video In the ideal case Chromatic analyzes 60 frames per second Detected Markers In this 12 second video segment the number of frames in which Chromatic was able to interpret a frame number Unique Markers In this 12 second video segment the number of unique frame markers interpreted Note that because Chromatic analyzes 60 frames per second if the source video plays at 30 frames per second Chromatic will ideally interpret the marker for each frame twice Perfect Tones The number of perfect audio tone sequences detected in this 12 second segment Freeze Periods The number of time periods within this segment when the circular frame markers were distinguishable but no change was detected from the previo
33. evice XYZ CW 064 FL Metrico Office 1 Device XYZ CW 064 FL 35 0 t AvSync seconds O 5 10 15 20 25 30 35 40 3 2 1 0 1 2 3 Time seconds AvSync Distribution seconds pats ico Office 3 Device XYZ CW 064 FL Metrico Office 3 Device XYZ CW 064 FL AvSync seconds 2 0 r 0 0 O 5 10 15 20 25 30 35 40 3 2 1 0 1 2 3 AVSync Distribution seconds Time seconds Figure 5 15 A V Sync Report 5 3 2 Generate Excel Report From Selected The Data gt Processed page also provides the option to generate an Excel report containing overall session level and segment level statistics for the data To generate the Excel report perform the following steps 1 Se 3 4 Select the desired test file s Use the up and down arrows to order the sessions as you wish for them to appear in the report Select the Generate Excel Report from Selected button Enter a file name and save The video performance table and charts shown below are included on the formatted REPORT tab of the Excel output report Similar analysis views are provided for audio performance Additional report tabs provide statistics for the data aggregated by channel session and video segment Video Scores by Segment Device XYZ CW 064 FL Device XYZ Zan 064 FL Device XYZ CW 064 FL Device XYZ CW 064 FL session Score Average Standard Deviation Maximum Score Segment Count Duration seconds of time Frozen of time Imp
34. evice metadata Select this option to display fields in the Record and Config dialogs for entering device Make Model Role and HW Identifier information If entered this information will appear in the Chromatic output report Content Metadata Enter the URL and the Path of the test videos in use The URL and Path must match the destination entered on the mobile device The default settings point to the standard Spirent hosted video test clips and are appropriate in most cases The files contained in the directory specified here are listed upon test initiation allowing the user to specify the actual file in use for the test 2 3 3 Video Processing Use these fields to control the processing of session data 2 3 3 1 Enable concurrent processing Check this box to allow Chromatic to process multiple output files at the same time for data analysis This option may shorten overall processing time on powerful multi core systems In some cases concurrent processing may result in a drastic decline in processing speed If this occurs Spirent recommends disabling this option or lowering the Max number of concurrent processes allowed Copyright Spirent Communications Inc 2014 14 Chromatic User s Manual 2 3 3 2 Max number of concurrent processes Use this option to specify the maximum number of simultaneous processes allowed when concurrent processing is enabled Raise this value to take advantage of powerful processing capabilities of
35. he captured video and each audio tone for the current segment audio minus video In the ideal case the test video and corresponding audio are captured simultaneously by the Chromatic software While a small amount of offset with audio either leading or lagging the video is acceptable a large offset between the audio and video is often undesirable ES The geographic latitude at the start of this segment as reported by the GPS Start Lon The geographic longitude at the start of this segment as reported by the GPS End Lat The geographic latitude at the end of this segment as reported by the GPS End Lon The geographic longitude at the end of this segment as reported by the GPS File Location The name of the captured test video containing this segment SessionMetadata Tab Copyright Spirent Communications Inc 2014 Chromatic User s Manual This tab defines each test session including details of the video sample in use Session A unique identifier for each test session included in the data set Description The Session Description as entered at the end of each Chromatic test session Date The session capture date Start The session start time in UTC End The session end time in UTC Channel The Chromatic video capture channel Ch Description The description of the capture channel as entered in the Record Options dialog at the start of the test VC name The name of the video content file selected for capture
36. i Max The maximum audio score for the channel ucio Mana EUC The minimum audio score for the channel Session Summary and Session Summary Raw Tabs These tabs contain high level statistics for each test session captured in the report Portions of the data marked by the user for exclusion are omitted from the calculations on the Session Summary tab The calculations on the Session Summary Raw tab include all data Session A unique identifier for each test session included in the data set Channel The Chromatic video capture channel ko E E The description of the capture channel as entered in the Record Options dialog at the Description start of the test Copyright Spirent Communications Inc 2014 49 Chromatic User s Manual E ge S Greater The percentage of video score measurements for the session with a value greater than 3 than 3 CH BR E The percentage of video score measurements for the session with a value less than 2 Greater The percentage of video score measurements for the session with a value greater than 4 than 4 Stdev The spread of the video score data for the session about the mean 95 The range about the mean video score in which you expect the actual mean to fall Confidence with 95 certainty for any number of times the test is repeated based on the test session data As a general rule Spirent recommends collecting enough samples such that the confidence interval falls below 10 of the mean
37. ion to be included Count in report calculations The user has the option to exclude segments after testing on the Chromatic Data gt Review tab Excluded Seg The number of 12 second video segments in this test session to be excluded Count from report calculations The user has the option to exclude segments after testing on the Chromatic Data gt Review tab Event Count The total number of events marked by the user on the Chromatic Data gt Review tab Interrupt Count The number of interrupt events marked by the user on the Chromatic Data gt Review tab This statistic includes playback interruptions by both the device and the user Startup Time The time in seconds between the Playback Initiated and First Frame seconds Seen events marked by the user on the Chromatic Data gt Review tab Bad AVSync The percentage of audio variation measurements that fall into the Bad range as defined in the AVSync Thresholds area of the Settings gt Capture Processing tab Audio variation refers to the time offset between the captured video and audio In the ideal case the test video and corresponding audio are captured simultaneously by the Chromatic software While a small amount of offset with audio either leading or lagging the video is acceptable a large offset Copyright Spirent Communications Inc 2014 48 Chromatic User s Manual between the audio and video is often undesirable This parameter cap
38. l 5 4 AV Sync KPIs Tab The AV Sync KPIs tab provides a comprehensive list of summary performance data and Key Performance Indicators KPIs relating to the audio video sync performance of the capture session s AV Sync KPIs Capture 1 Capture 2 eren 3 eren 4 AV Sync Lead Limit ms 5 0 AV Sync Lag Limit ms 200 200 200 a Average of AV Sync Lead ms 9 4 None Average of AV Sync Lag ms 159 Max AV Sync Lead ms Co Max AV Syne Lag ms Segment Count 12s each No of Segments gt 50ms enzegen um BECH ee No of Segments within Limits Segments Within Limits 100 0 AV Sync Lead Limit ms The audio lead threshold The default value is 50ms but it can be changed according to the operator s requirement AV Sync Lead Limit ms The audio lag threshold The default value is 200ms but it can be changed according to the operator s requirement Average of AV Sync Lead ms The average of the audio lead for all leading segments Average of AV Sync Lag ms The average of the audio lag for all lagging segments Max AV Sync Lead ms The maximum segment value of the audio lead for all leading segments Max AV Sync Lag ms The maximum absolute segment value of the audio lag for all lagging segments Segment Count 12s each The number of 12 second video segments included in this session No of Segments gt 50ms The number of segments which had leading AV audio higher than the lead threshold No of Segments lt 200m
39. le Spirent recommends collecting enough samples such that the confidence interval falls below 1096 of the mean EI LTE El The number of 12 second video segments in this test session to be included in report Count calculations Skewness A measure of the asymmetry of the PDF for the video score data for this session Kurtosis A measure of the peakedness of the PDF for the video score data for this session UE IR Te Ten The mean audio score for the session Median The median audio score for the session NTO o Max Audio The maximum audio score for the session Copyright Spirent Communications Inc 2014 51 Chromatic User s Manual Min Audio The minimum audio score for the session Capture The total number of frames analyzed in this test session In the ideal case Chromatic Frames analyzes 60 frames per second Detected In this test session the number of frames in which Chromatic was able to interpret a TT i frame number Unique In this test session the number of unique frame markers interpreted Note that because Markers Chromatic analyzes 60 frames per second if the source video plays at 30 frames per second Chromatic will ideally interoret the marker for each frame twice Perfect Tones Periods were distinguishable but no change was detected from the previous frame Time Period Mean Freeze The mean freeze period length for this test session Period Impaired The
40. le GPS Source Internet Time Server GPS Type LAT 25 06178297 w GPS Garmin NMEA LON 121 64026606 Sync time on application startup Detect Garmin GPS COM Port Figure 2 2 GPS Time Settings 2 2 1 Time Synchronization Time synchronization is required when the data captured with Chromatic will be correlated with Qualcomm eXtensible Diagnostic Monitor QXDM data collected on another device Time synchronization should also be performed on the QxDM collection device if necessary through the Operating system for proper correlation To specify time synchronization options in Chromatic perform the following steps 1 Internet Time Server Chromatic will synchronize the PC s clock to internet time on demand In order to use this method you must have a dedicated internet connection 2 GPS Spirent recommends using GPS for mobile environments ITS may encounter latency issues in a drive test GPS Chromatic will synchronize the PC s clock to GPS time on demand Spirent recommends using this time synchronization method for mobile tests 3 Sync time on application startup to automatically perform time synchronization when the Chromatic software is opened Do not select this option if the locally captured Chromatic data is to be correlated with QXDM data collected on another device 2 2 2 GPS Chromatic can record GPS information during testing Location information can be used to display data testing results graphically in M
41. multi core systems and lower overall processing time The maximum value allowed in this field corresponds to the machine s number of processors Lower this value if performance suffers with concurrent processing on less powerful machines The standard Spirent provided Chromatic laptop contains a processor with eight cores allowing up to eight captures to be processed simultaneously Set the Max number of concurrent processes to eight to take advantage of the laptop s computing capabilities This option maximizes efficiency by shortening overall processing time in batch mode 2 3 3 3 Notify when processing completes Select this option if you wish Chromatic to issue a pop up message when the test completes 2 3 3 4 Freeze Impairment timer trigger FITT Use this option to set the number of individually impaired images the system will ignore before registering the test as impaired For example the system comes configured to 10 an allowed range of 1 to 10 with the default as 10 then it would require 10 or more impaired images to qualify for impaired status Spirent recommends you set this parameter to 6 Assuming the image is transmitting at 10 frames per second a setting of six would be 200 Ms To create a 200 ms threshold corresponding to human eye sensitivity you would use the following formula FITT 2 framerate of the test video If the testframe 30 FPS then the FITT 6 The FITT impacts the calculation of frozen and impaired f
42. mv symbolarea 60 300 520 160 symbolradius 20 80 tones C Program Files Metrico Wireless Chromatic tones 12x1000ms tones txt ok Cancel Figure 5 8 Edit Session Processing Parameters Dialog e The Circle Radius Min and the Circle Radius Max settings are detected from the information stored within the capture file If post processing is not working these settings may need to be manually adjusted Please contact Spirent Product Support for more information e The Averaging Window Video and Audio settings refer to the number of frames used as the unit of measurement for determining how many expected frames were actually captured For example if the test video frame rate is 15 frames second and the Video Averaging Window is 5 seconds you would expect to receive 75 frames during that time If fewer than 75 frames are received the video will be considered impaired or frozen for that measurement e The FrameProcessor Additional Command Line Text field is generally reserved for Spirent use Please contact Spirent Product Support for assistance with this field Click OK to accept the settings and exit the Edit Session Processing Parameters dialog Select one or more unprocessed files from the list on the Data Unprocessed screen The selections made in the Video Processing area of the Settings tab affect the processing sequence e Checking Enable Concurrent Processing on the Settings tab allows Chromatic to process multiple
43. n the Record Options Description dialog at the start of the test Source Frame The frame rate of the captured video content rate Observed FPS This is the calculated FPS frames per second measurement based on the Mean data collected by Ge This value ger be relatively close to the Frame rate fps value set in the Chromatic Config dialog If the Frame rate fps setting exceeds the observed value by more than 10 the parameter may have been set incorrectly BIO e BR OEI cle In this test session the number of frames in which Chromatic was able to interpret a frame number as a percentage of all observed frames E CRT This is the default setting of the Chromatic camera for FPS This value should FPS Setting be set to 60 ENE OTEN This is the mean value calculated by Chromatic as a check to confirm the FPS Mean camera is capturing at a rate close to the Camera Capture FPS Setting If the calculated value is not within 1096 of the setting it is an indication that the PC may not have captured all the video frames and a re test should be considered OFERT Oc This is the minimum value calculated by Chromatic as a check to confirm the FPS Min camera is capturing at a rate close to the Camera Capture FPS Setting If the calculated value is not within 10 of the setting it is an indication that the PC may not have captured all the video frames and a re test should be considered Included Seg The number of 12 second video segments in this test sess
44. nananaanananasananananananananasanans 32 Figure 5 13 Compare Video Score PDFS Output cssssesesssessssssssssssscecscsessessssssssseasecacesesesssessesesenenecaess 33 Figure 5 14 Compare Audio Score PDFS Output csessseeesessssssssssseesescscssesesesesssessececaceeesesesessesennanaceess 33 Copyright Spirent Communications Inc 2014 4 Chromatic User s Manual Pure 5 15 AIN SYNCREDPOL EE 34 Figure 5 10 VIDEO E 34 Figure 5 17 Video ee RE gt 35 Figure 5 18 Video Performance Comparison Chartuuuummuamanannaanansawanaasawanaasasanaasananaanananaananannasanamnananananananana 35 Fiure p19 EE 36 Keure Ne Me Ee E 36 Figure 5 21 Audio Score EE Ne EE 36 Figure 5 22 Audio Performance Comparison Chart ee 37 BIS UEC 52 3 Audio COM KE 37 Figure 5 24 AV Ee 38 Feire 5 23 Video QU y SCONE amanda aan aan aaa N 39 Figure 5 26 AldioQUal SCO AA ANAN ANA ORRO 39 Figure 5 27 Playback Delivery of KPI Statistics mmanaananawananaanawasananaasasananasaanasananasasasanansnan aa 40 FIC Ure On Captare Be Tt 41 Bt 2 GP NG O O c masna ne A ne eee meer teen ten Rae eee reer rere et ee 41 Eet ROXIO EE EE 42 Figure 0 4 Tmase Capture RTE 42 Figure 6 5 Image Capture FE Xai E 43 Figure 6 6 Centering the Capture Sereen amn GANI NMA NADAANAN NANANA 43 Det 6 7 Import Screen CaptU rE EE 44 Figure O70 Sele Cie a Fleto MPO E 44 P eC AA Tee cere ree rear 45 Copyright Spirent Communications Inc 2014 5 Chromatic User s Manual 1 Introduction 1 1 O
45. nd Third Party Data ummmmunuanasawawanaawawawananaawawananaasasasananaanananananaananananannanasana 39 Der Playpack RTE E E 39 GENE OPO EE 41 E E AA AA AA NA AA 45 Appendix A Definitions of Exported Result FieldS m m1mmununuawawunanuawawawanansawawananaawawawananaasawananaaawanananaasasanananuaans 47 Figures Figure 1 1 Chromatic UNPACKING ANGAL ANAAD NAAN ANAKAN 6 Pone 1 2 Camel Ajdnintniiiininnnraannnnn MN ERG IEREME ENR 7 Figure 1 3 Hardware Mounting Fixture Side VieW ccssesesssseseseeseseseseeeesesesesseneneeseseeneneieaeesenenseateneneneeaeeneen 7 He Cable CONN AA AA tae mentee erie rte nese teeters 7 Figure 1 5 Chromatic system Overview AA NAAN AA 8 POU lao VASO NG E E AA IEE A EE E E A E E 9 Heure e Gir OM ate oW geesde 9 Figure 1 8 Camera Settings Starting POInt csssssssssssssssessssssssssssrsrsssrsssesssesesesesosssasesesaracacaccorscseeaesseessseseseaess 10 Figure 2 1 Accessing the Chromatic Settings Tab 1 1 mmmnanananaanawawananaasasananansanasananasnanasananasnnananannnananana 11 More ZC LING CN AA AA NAA cease 12 Figure 2 3 Capture Processing Settings terre 13 Figure 2 4 Caphure Been YA EE 14 Figure 2 5 AVSync Thresholds Area nana ign 16 Figure 3 1 Chromatic Capture TaD EE 17 Figure 3 2 Device Setup on the Capture Tab uuuuummmmmmunuanasawawawanananuawanawawawawanananananaananawawawanananananaaaananananasananananananananans 18 Meure3 Time Syne ET 19 Eech TEN EE 20 Pigure4 Z Chromatic Video Streat
46. ndows Start Menu select All Programs gt Chromatic The first time Chromatic is opened an internet connection is required for product activation Click Camera Settings and the following screen displays Properties UVC Video Controls UVC Special Controls Camera Control Video Proc Amp Gain Exposure Auto Reference Auto Max Value WhiteBalance White Balance Red White Balance Blue Figure 1 8 Camera Settings Starting Point Spirent offers the following recommendations for optimal camera settings If possible adjust your camera Settings while playing a test video directly stored on the device for example on the SD card The camera should be positioned under the same light shade you will be using for your test If possible set the phone screen brightness to a fixed value around 75 of the maximum Use the settings below as a default then make small adjustments to the gain to produce the desired level of picture contrast o Disable automatic gain control o Disable automatic exposure control o Set exposure to 1 120 s o Set gain to 645 adjust as necessary Copyright Spirent Communications Inc 2014 10 Chromatic User s Manual 2 Setting User Preferences Prior to first use Chromatic must be configured with user preferences To configure the program specify General Settings GPS Time Settings and Capture Processing Settings Each of these configuration options is accessible from the Chromatic Set
47. number of time periods within this test session when the video was so distorted it Periods was not possible to distinguish the circular frame markers Time Period Period Source The frame rate of the captured video content Framerate Path The file path of the captured test video Segment Data Tab This tab contains in depth statistics for each 12 second video segment captured in the report Portions of the data marked by the user for exclusion are highlighted in dark gray on this tab Session A unique identifier for each test session included in the data set Bei ITT El The Chromatic video capture channel Cycle The identifier of the 12 second video segment under consideration Exclude An x in this column indicates that the user has marked this segment for exclusion using the options available on the Chromatic Data gt Review tab Video Score The video score of this segment as the observed video frames to expected video frames represented on a 5 point scale Audio Score The audio score of this segment as the observed audio tones to expected audio tones represented on a 5 point scale Avg AV Sync The mean time offset between the captured video and each audio tone for the current segment audio minus video In the ideal case the test video and corresponding audio are captured simultaneously by the Chromatic software While a small amount of offset with audio either leading or lagging the video is acceptable a large offset b
48. ny camera changes to confirm the metrics Inspect the audio performance bar to the right of the video playback area to confirm that audio is playing at an acceptable level The audio bar background color indicates the volume level e Green background indicates that the audio is at an acceptable level e Yellow background indicates that the audio level is too low or missing e Red background indicates that the audio level is too high If the volume is too high or too low confirm that the device volume is set to approximately 7506 of the maximum level The audio level can then be adjusted by rotating the SENS control knob on the audio capture module You can also check the detected audio level by the device from the Windows Sound menu Copyright Spirent Communications Inc 2014 18 Chromatic User s Manual e Right click on the Volume ER icon in the Windows System Tray e Select Recording Devices e Check the meter to the right of each Chromatic audio capture unit to determine the level of audio detected by the device 8 Confirm that the GPS is reporting location if enabled 9 If Sync time on application startup is not selected manually synchronize the time if time sync is required for correlation with data collected from another source such as QXDM 10 On the Chromatic Capture tab select the Time Sync button 11 Select the Source as Internet Time Server or GPS 12 Select the Sync Now button 13 Once the status shows as Time sync
49. perfuming the following steps 1 Click Record to begin testing EE Record Options E Max Record Time Unlimited Hours 0 Minutes 4 Seconds 0 Stop recording after seconds of End Frames Channel A Description Make Make A Device XYZ CW 033 FL Model Model A Video Content Role Reference CW 033 FL HW Identifier 123456789 Video Content fps 15 Clear Data Cancel Start Figure 4 5 Record Options Dialog Copyright Spirent Communications Inc 2014 21 Chromatic User s Manual 2 Fither enter the Max Record Time in Hours Minutes and Seconds or check Unlimited to continue recording until stopped by the user The setting in the Max Record Time area defaults to the Default Duration specified on the Settings tab 3 Enter an identifying Description such as handset type to be used as the file name for each capture in this session Note Spirent recommends entering the device name and video content clip name in this field For example Device XYZ CW 064 FL 4 If the metadata fields Make Model Role HW Identifier appear populate as desired This information will appear in the Chromatic output report To control whether or not these fields appear use the Prompt for device metadata setting on the Settings Capture Processing tab 5 In the Video Content area use the drop down or the Chooser LG to match the video playing on the test mobile Click OK to confirm the selection If you ch
50. pter or 2 5mm Daptor 2 cable with R2 S reversal adapter JK Audio Camera Capture USB Figure 1 5 Chromatic System Overview 1 3 Mobile Device Configuration Perform the following steps to configure the test devices for Chromatic testing 1 Turn on each test device 2 In the device s web browser navigate to the standard Spirent or custom test site containing a series of test videos Copyright Spirent Communications Inc 2014 8 Chromatic User s Manual e Standard Spirent test site http updates metricowireless com cw index html e Custom test site Navigate to the custom test clip URL listed at the bottom of the Capture tab in the Chromatic software 3 The videos on the test site use different video codes and frame rates The videos marked FL are in Flash format and can be played in a web browser The others use standard Real Time Streaming Protocol RTSP for use in a video player Title Windows Internet Explorer 6 E bttp updetes metricomreless com ow index html v x AH File Edt View Favorites Tools Help A dE Gre th de gt Page O Tock HOB Video Video Bit Frame Audio Sample Audio Bit Content Paba ii Rate Size Rate Cada Rate Rate Format Protocol Image CW 033 Jeak libx264 176x144 15 libfaac 44100 J46k mp4 rtsp Link naa 64K libx264 176x144 15 mz 44
51. pture Processing Reporting Capture Options Content Metadata Healthy FPS Theshold 50 URL http updates metricowireless com FPS alarm Threshold 30 Path cw d Default duration to unlimited Default duration in seconds 240 Figure 2 3 Capture Processing Settings 2 3 1 Capture Options Use these fields to control the recording session Copyright Spirent Communications Inc 2014 13 Chromatic User s Manual 2 3 2 Capture Options Healthy FPS Theshold 50 FPS alarm Threshold 30 d Default duration to unlimited Default duration in seconds 240 Default Automatic Stop After 1 seconds of End Frame Markers V Automatically switch to Review tab when recording completes J Prompt for device metadata Figure 2 4 Capture Options Area Healthy FPS Threshold The limit of frames per second This is primarily internal testing data and not intended for customer use FPS Alarm Threshold This is primarily internal testing data and not intended for customer use Default duration to unlimited Select this option to end the test session manually by clicking Stop Default duration in seconds When Default duration to unlimited is left unchecked this field provides the test duration Automatically switch to Review tab when recording completes At the end of the test session Chromatic automatically display this screen to replay the recorded video or review the raw data in the session folder Prompt for d
52. r Figure 5 25 Video Quality Score 5 5 2 Interpreting Audio Scores Chromatic calculates the audio score by comparing the number of observed and expected audio tones in each 12 second segment The audio track contains a sequence of DTMF tones The Chromatic software assesses whether the expected tones are recognized The audio score is the ratio of observed audio tones to expected audio tones represented on a 5 point scale Excellent Good excelent ER 2 fro Figure 5 26 Audio Quality Score In addition the DTMF audio tones are synchronized to specific video frames Chromatic evaluates the timing of the tones with respect to the video frames The result is presented as an audio advance or delay with respect to the video in the A V Sync Report Typically the smaller the advance or delay the higher the quality of the end user experience 5 6 Correlating Chromatic and Third Party Data Reserved for future use 5 7 Playback Delivery KPIs The Playback Delivery of KPIs tab provides comprehensive data to evaluate the performance of streaming videos on networks Carriers will use this to determine the quality behavior of their transmissions The Excel spread sheet from this tab will indicate the start and stop time of videos as well as accurate assessments of the access buffer phase and playout phase Copyright Spirent Communications Inc 2014 39 Chromatic User s Manual Description The nomenclature used to label or identify
53. r button and after capture from the Data gt Review tab Se A unique identifier for each test session included in the data set HEULA The Chromatic video capture channel Time The timestamp at which the event occurred Type Describes the event selected by the user Text Provides detailed information about the selected event by either the system or by the user Copyright Spirent Communications Inc 2014 Chromatic User s Manual Session Data and Session Data Raw Tabs These tabs contain in depth statistics for each test session captured in the report Portions of the data marked by the user for exclusion are omitted from the calculations on the Session Data tab The calculations on the Session Data Raw tab include all data Session A unique identifier for each test session included in the data set Description The Session Description as entered at the end of each Chromatic test session Channel The Chromatic video capture channel Channel The description of the capture channel as entered in the Record Options dialog at the Description start of the test Date The session capture date Start The session start time in UTC Duration The length of the session in seconds BI mie In this test session the number of frames in which Chromatic was able to interpret a frame number as a percentage of all observed frames Capture fps This is the mean value calculated by Chromatic as a check to confirm the camera is capturing at a rate clo
54. rames as a low FITT 1 makes Chromatic very sensitive where as a FITT of 10 would be more forgiving If you change the FIT you do not need to recreate the capture You only need to re run post processing as shown in section 2 4 Reporting Use these fields to define the BadAVSync parameter on the Validation tab of the Chromatic output report In the ideal case the test video and corresponding audio are captured simultaneously by the Chromatic software While a small amount of offset with audio either leading or lagging the video is acceptable a large offset between the audio and video is often undesirable The BadAVSync parameter captures the frequency of undesirable offset conditions Copyright Spirent Communications Inc 2014 15 Chromatic User s Manual AVSync Thresholds Set AVSync Thresholds milliseconds Reset 200 d 100 NG AVSync Calibration Factor ms 0 SC Minimum number of good segments V Minimum percentage of good segments 50 4 gt Good Segment score threshold Cu Figure 2 5 AVSync Thresholds Area e Set AVSync Thresholds milliseconds Offset within the green center area of the thresholds bar is considered acceptable Set the maximum acceptable audio lag using the left hand threshold setting Set the maximum acceptable audio lead using the right hand threshold setting e AVSync Calibration Factor The offset value off which the AVSync Thresholds are based With the Calibration Fac
55. s The number of segments which had lagging audio less than the lag threshold No of Segments within Limits The number of segments in which the audio lead or lag was within the threshold limits Segments within Limits The of segments in which the audio lead or lag was within the threshold limits Figure 5 24 AV Sync KPIs 5 5 Interpreting the Results Chromatic calculates video and audio scores based on the difference between the observed and expected results during testing This section describes how Chromatic calculates the video and audio scores and how these scores correlate to user perceived quality 5 5 1 Interpreting Video Scores Chromatic calculates the video score by comparing the number of observed and expected video frames Expected frames are calculated as the number of unique video frames that should appear in each 12 second segment based on the frame rate of the source video Observed frames are calculated based on the circular markers captured in each frame of the recorded video e An impaired frame is distorted and users can no longer detect the circular marker symbols e A frozen frame is one in which the circular frame symbols are distinguishable but no change has been detected from the previous frame Copyright Spirent Communications Inc 2014 38 Chromatic User s Manual The video score is the ratio of observed video frames to expected video frames represented on a 5 point scale Excellent Fair az Poo
56. se to the Camera Capture FPS Setting If the calculated value is not within 10 of the setting it is an indication that the PC may not have captured all the video frames and a re test should be considered Impair Ratio The amount of time the video was frozen divided by the total session duration Frozen video occurs when the circular frame markers are distinguishable but no change was detected from the previous frame Freeze Ratio The amount of time the video was impaired divided by the total session duration Impaired video occurs when the video is so distorted it is not possible to distinguish the circular frame markers Overall The ratio of observed video frames to expected video frames for the entire duration of Session the test Note that for the purpose of this parameter the test duration is considered to BANANA Ea a start at the beginning the first included segment and end at the conclusion of the last included segmen ie Score Score Score Score than 3 3 vey KIS CTIE The percentage of video score measurements for the session with a value less than 2 Greater The percentage of video score measurements for the session with a value greater than than 4 4 St dev The spread of the video score data for the session about the mean 95 The range about the mean video score in which you expect the actual mean to fall with Confidence 95 certainty for any number of times the test is repeated based on the test session data As a general ru
57. tem automatically replaces the red capture field with flashing green brackets 16 Click Stop to end the session 17 After stopping and storing the file return to the main Chromatic program and import the file through the Import Screen Capture File under the Add dropdown menu of the Data gt Unprocessed tabs As shown in the following figure You will not see this option unless you have obtained the license for Chromatic Screen Capture Copyright Spirent Communications Inc 2014 43 Chromatic User s Manual EB chromatic L a Home Capture Cata Settings Help Review Unprocessed Processed Utilities LI test64 7 15 2014 7 3216 PM 7 15 2014 7 32 19 PM Device XYZ CW 033 FL cap waw 7 15 2014 53126 PM 7 15 2014 53143 PM Device XYZ CW 033 FL cap waw T LL 2014 25233 PM 7 11 2014 25345 PM Device XYZ CW 033 FL cap waw T LL 2014 14621 PM 7 11 2014 14633 PM Device XYZ CW 033 FL capA wew Import MP4 WMY file Begirrung Processing of ScreenCapture 2014 07 15 134220 Imported 2014 07 15 162027 ScreenCapturefile mw e Finished Processing of ScreerCapture02014 07 15 134220 Imported 2014 07 15 16202915creenCaptureFie wry Import Screen Capture File PIE eis Ss ER Figure 6 7 Import Screen Capture 18 Click Import Screen Capture File select the file you saved and it appears in the list as shown in the following screen Channel B 7 15 2014 7 32 16 PM 7 15 2014 7 32 19 PM vice XYZ CW 033 FL
58. tings tab The default settings are suitable for most users Home Capture Data Settings Help go o 2 General GPS Time Capture Processing Reporting Application Startup di Check for Updates on Startup Enable Remote Control via TCP socket 7073 Figure 2 1 Accessing the Chromatic Settings Tab 2 1 General To specify general settings for Chromatic choose whether to Check for Updates on Startup to determine whether a newer version of Chromatic is available recommended The Enable Remote Control via TCP socket 7073 option is only visible to customers who have purchased this optional command set for controlling Spirent s Nomad remotely via any socket client This option should be selected in order to access Remote Control functionality Remote functionality includes Time synchronization which consists of e Configuration of capture channels e Starting stopping a capture session e Performing post processing on a session For full details see the Spirent Chromatic Remote Control Guide 2 2 GPS Time Use this option to specify settings related to time synchronization and GPS on the GPS Time tab Copyright Spirent Communications Inc 2014 11 Chromatic User s Manual Chromatic 1 6 Lo S Home Capture Data Settings Help 3 3 d General GPS Time Capture Processing Reporting Time Synchronization GPS GPS d Enab
59. tor set at 0 and the AVSync Thresholds at 200 ms and 50 ms offsets between 200 ms and 50 ms are considered acceptable With the Calibration Factor set at 50 and the AVSync Thresholds at 200 ms and 50 ms offsets between 150 ms and 100 ms are considered acceptable Note In most cases the default settings in this area should be maintained If adjustment is necessary please contact Spirent Support for more information Copyright Spirent Communications Inc 2014 16 Chromatic User s Manual 3 Confirming Device Positioning Prior to testing the position of each test device must be confirmed using the Config option on the Capture tab O cont LOLO as Channel A Enabled Video Device So e Figure 3 1 Chromatic Capture Tab To confirm that the test devices are positioned correctly perform the following steps 5 Check the Enabled box for each device to be used during testing Select the Video Device that will be capturing video for the channel Select the Audio Device that will be capturing audio for the channel Note that capturing audio is optional and is not required to perform tests If the metadata fields Make Model Role HW Identifier appear populate as desired This information will appear in the Chromatic output report To control whether these fields appear use the Prompt for device metadata setting on the Settings Capture Processing tab Click OK to accept the settings or click Cancel to exit without
60. tures the frequency of undesirable offset conditions Channel Summary and Channel Summary Raw Tabs These tabs contain aggregated high level statistics for each test channel captured in the report Portions of the data marked by the user for exclusion are omitted from the calculations on the Channel Summary tab The calculations on the Channel Summary Raw tab include all data Channel The Chromatic video capture channel PIETA ii An aggregate of the unique descriptions provided at test startup for this channel Mean The mean video score for the channel Median The median video score for the channel Max The maximum video score for the channel than 3 greater than 3 than 2 than 2 than 4 greater than 4 Sidev The spread of the video score data for the channel about the mean 95 The range about the mean video score in which you expect the actual mean to fall erie Ca with 95 certainty for any number of times the test is repeated based on the test channel data As a general rule Spirent recommends collecting enough samples such that the confidence interval falls below 10 of the mean Count The number of video samples for this channel Skewness A measure of the asymmetry of the PDF for the video score data for this channel Kurtosis A measure of the peakedness of the PDF for the video score data for this channel Mean The mean audio score for the channel Audio Median The median audio score for the channel auro
61. us frame Freeze Time The total time during this segment in which video was frozen Max Freeze The maximum length of a single freeze period for this segment Mean Freeze The mean freeze period length for this segment Impair Periods The number of time periods within this segment when the video was so distorted it was not possible to distinguish the circular frame markers Impair Time The total time during this segment in which video was impaired Max Impair The maximum length of a single impairment period for this segment Mean Impair The mean impairment period length for this segment Observed This is the calculated FPS frames per second measurement based on the data Framerate collected by Chromatic This value should be relatively close to the Frame rate fps value set in the Chromatic Config dialog If the Frame rate fps setting exceeds the observed value by more than 10 the parameter may have been set incorrectly Audio Perf Index The ratio of observed audio tones to expected audio tones for this segment Audio Tones Total number of tone sequences detected during this segment This number Sequences includes all tone sequences that begin in this segment Tone Sequences The number of tone sequences with AV Sync Offset exceeding either the upper or exceeding lower AVSync Threshold as set by the user on the Chromatic threshold Settings gt Capture Processing tab WEVE AASS TE The maximum time offset between t
62. verview Spirent Communication s Chromatic is a frame delivery testing system for quantifying and benchmarking mobile video performance This section provides an overview of the Chromatic workflow Chromatic comes pre configured and requires no software installation The remainder of this guide is structured along the sequential processes needed to run Chromatic e Hardware Configuration Prepare the mobile device Open the Chromatic software Specify the settings Confirm the device positioning Start the test e Collect and analyze your results Each of these steps is explained in detail in the following sections 1 2 Hardware Configuration Upon opening the Chromatic box you should see a partially configured system as in the following image Figure 1 1 Chromatic unpacking Remove the Wall Charger box and install the cameras which are provided separately in the clear plastic shipping container Copyright Spirent Communications Inc 2014 6 Chromatic User s Manual a Wa LS mas LULU II PONVIZ NIO 9D VONVONVIS NO CFSE 490 Kis Dha BU Wee 92012 HU HI JDUNOSONIOW WI Figure 1 2 Camera Install the cameras and attach the cell phone The finished assembly should look like the following image Figure 1 3 Hardware Mounting Fixture Side View Remove the chromatic box and configure the cables as shown in the following image and directions Channel 1 Channel 2 Figure 1 4 Cable

User`s Guide - Spirent Knowledge Base

Contents

Download Pdf Manuals

Related Search

Related Contents