Home

Formal Technical Proposal - Capstone Experience

image

Contents

1. Software Architecture iOS based Client Application UI Layer Not a two way videoconferencing system wegen aree osrsuve conguaon Tue EE Does not emit audio on the local side e g no speakers Em Seege lose Mada panes No built in recording capability SE No explicit tethering support vseswarsem Advanced Jose Texas Gen No support for bluetooth Ell Brage len ee lee No support for connecting to a phone over USB EE Project Aureole ain e Project Aureole aif e Project Aureole zin e 28 29 30 Technology Comparison ooftware Architecture ooftware Architecture ace A P Android based Client Application Browser based Client Application Eee Nes net Embedded USB Host PCI Express Ul Layer SES Linux Device Device Support Support Support Application Layer Freescale Application Framework Layer i Ea COMREX DirectDraw 2D Windows Sockets i j MX 5 1 M d Surface Manager libc Daly kv ial renda EE Ti OMAP3530 tion System Display driver Audio Driver Network Driver C64x DSP Display driver Audio Driver Network Driver Marvell Kirkwood 6281 Y Y Y Project Aure
2. feedback a ECH at Project Aureole An e Project Aureole ain e Project Aureole alf e 19 20 21 Outline Conceptual Block Diagram Functional Requirements Overview 360 Panoramic Virtual Presence Design ai Embedded Microphone Technical Survey p Accessible from Web iPhones and Android Phones Functional Block Diagram Weem Small Light Rugged Sensor Characterization Battery or Wall Powered Communications Protocols Project Aureole aln e Project Aureole ath e Project Aureole ain e 22 23 24 Functional Requirements Functional Requirements Performance Requirements Device Status and Control I O Device Software Overview Usable with standard wireless 802 11 and wired networks 802 3 Power status mute status and ad hoc wifi instantly Open source operating system platform CR visible via color coded LED indicators Self healing software for robust operation High definition streaming video H 264 480p Q 15fps power is controllable with push buttons Standard Protocols Android Phones Froyo Runtime of one hour from battery Fits within a 10 x 10 x 3 laptop case EN t Weighs less than 1 Ib 450g E Project Aureole aitne Project Aureole aitne Project Aureole aitne 25 Aitne Confidential Page 49 26 27 Limitations Items outside of Scope Software Architecture Device Software Architecture
3. ees 46 Appendix C Capstone Design Document ss 53 Appendix D Problem Statement Memo cccccsscsesccesccecccsccesccesccesccescsceceseeecs 82 Appendix E Conceptual Design Memo cccssccssccsscccssccesccsssccesccescessscesceees 83 Appendix F Functional Design MOM O ccssccsssccssccsscccssccesccsssccssccesccescceesceees 86 Appendix G Work Breakdown Structure WBS ss 90 Appendix H Responsibility Assignment Matrix RAM 94 Appendix I Network Logic Diagram NLD e ENNER eee eene nnn 101 Appendix J Gantt GN GI die oii eri Pee idesiDPrEiRIIId 022075007003 0658050005 00995990099 04095090 08000058 09000 102 Appendix K Risk o o LE 109 Appendix E a EE 122 Aitne Confidential Page 5 List of Tables TapE ET 6 10110 0 RE 10 lfelej ES NOR cea A A eases eee 24 TOEO dis Que Ee ie gia Lie E 33 MOVE ARIS e el Be ein Be E 34 sio ISA e e 0 pde 39 lleie Tomeesees sipeo EE 40 Table 7 Testing amp Development Tool Costls ns 40 TOLES VON IS ee EA R A E A E E 4 Ke e a NAE TE OT a RE E E E nena ne re one 42 elo 218M Break Evon OS E 42 TOIDE TE Te 0 O EE 43 l ble 12 Seguente of e EE 44 TAPIE RAM Ee En EE 94 TIDI TA RAM RE SE EE 7 TADE tS RAM SOWO a de 96 ODE lE RAM OO VOM Cis EE 98 1apDie I7 RAM TESNO E 99 TADIS TS RAM WOD UD EE 100 Aitne
4. ID WBS Task Name Work Start Finish LC Jan 9 11 Jan 23 11 Feb 6 11 Feb 20 11 Mar 6 11 Mar 20 1 Apr 3 Elrlehwislriwelrlehwislriwieirlelwislriwrirlel 144 4 3 2 Software Test Pass 4 hrs Wed 2 16 11 Wed 2 16 11 145 14 3 3 Trial Run 6 hrs Fri 2 11 11 Wed 2 16 11 V LIII 146 4 3 3 1 Web Browser 2 hrs Fri 2 11 11 Tue 2 15 11 La 147 4 3 3 2 iOS 2 hrs Wed 2 16 11 Wed 2 16 11 148 4 3 3 3 Android OS 2 hrs Wed 2 16 11 Wed 2 16 11 i 149 4 3 4 Stress Test 2 hrs Wed 2 16 11 Wed 2 16 11 150 14 3 5 Final Test 6 hrs Mon 2 14 11 Wed 2 16 11 TE 151 4 3 5 1 Web Browser 2 hrs Mon 2 14 11 Tue 2 15 11 IL 152 1 3 5 2 iOS 2 hrs Wed 2 16 11 Wed 2 16 11 153 1 3 5 3 Android OS 2 hrs Wed 2 16 11 Wed 2 16 11 154 5 Wrap Up 90 hrs Wed 1 26 11 Tue 4 5 11 155 5 1 Enclosure 30hrs Wed 1 26 11 Mon 4 4 11 y 156 5 1 1 Design 16hrs Wed 1 26 11 Fri 1 28 11 157 5 1 1 1 Enclosure Design 12hrs Wed 1 26 11 Thu 1 27 11 158 5 1 1 2 Enclosure Review 4 hrs Thu 1 27 11 Fri 1 28 11 159 55 1 2 Procurement 2 hrs Fri 1 28 11 Mon 1 31 11 eegenem 160 5 1 3 Presentation 12hrs Fri 4 1 11 Mon 4 4 11 vu 161 5 1 3 1 Content 4 hrs Fri 4 1 11 Fri 4 1 11 I 162 5 1 3 2 Review 4 hrs Fri 4 1 11 Mon 4 4 11 163 5 1 3 3 Final Presentation 4 hrs Mon 4 4 11 Mon 4 4 11 I 164 5 2 Final Documentation 60hrs Wed 3 30 11 Tue 4 5 11 165 5 2 1 User s Manual 8hrs Thu 3 31 11 Fri 4 1 11 Vu 166 5 2 1 1 Initial Draft 4 hrs Thu 3 31 11 Fri 4 1 11 Il 167 5 2 1 2 Fina
5. A A Oh ra UJ KA E Fa ba bo ai bei bai Foi Foi ba ba E E toi ri t rrrruwwuuuwduvuuo uguv I m oc c c4 7 7 7 7 7 7 M n 7 tr al Al Ai Ai A0 A0 A0 A0 A0 A0 A0 A0 A0 A0 A0 DA I I I I I I I I I I I I I I I I Aitne Confidential Page 98 The responsibilites of the software are then flipped for the hardware Kyle will be responsible for most of the hardware implementation phases with the exception of a few tasks headed by Bill and Troy Table 17 RAM Testing Full System Connectivity Power Management Voltage Levels Stress Test Camera Connectivity On Board Communication Functionality Stress Test Audio Connectivity Communication Stress Test 802 11x Module Connectivity On Board Communication Off Board Communication Stress Test Ethernet Module Connectivity On Board Communication Off Board Communication Stress Test Beagle Board Connectivity Power Ground Functionality Stress Test 4 2 Software D O AAN kA Um Un UU O Ul A 2 o o e 094 0 CO CO CO CO CU CO CO el wl ww KKK nh KK Bol wl sl wd sl s wd si dk KK Lef vd sl s s u ugu A A 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 20272 20 22 0 0 ke ke ke bd be bd bd bel bd bel bel bd bel bed Fe bel bel bel bel kel bel bel kel bei kel kel bed bed ke Heen bk N N EH OM OM EA UNN Oh O GA Ab ta 7 EFFE 0 U U U U U U U Oe eet 7 7 7 7 7 4 1 1 4 4 4 1 3 3
6. eo UO CUUuuuw clrguuurrr rrrrrrrrr D D D D DU T UU UU CU oC of oc oc on eS 7 7 7 OO UO DOTE DNA AD DA A A k k k F H k F Fa F LA LA P NJ MA k N UJ IS k Ma ta bb zl UN The research responsibilities are mainly split up evenly between the three Aitne engineers Kyle will be responsible for most of the hardware component research with the exception of a few items William will be responsible for most of the Linux software and web l research he will also be doing some research in hardware Troy will be responsible for most of the iOS and Android software Aitne Confidential Page 95 research he will also be doing some research in hardware All documentation of the research is split up evenly The sponsor and advisor for project Aureole will interchangeably do the reviewing and input roles for research Table 15 RAM Software 3a Watchdog Daemon e Be Discovery Daemon dub Streaming Daemon 3 2 4 Web Daemon du LED Button Daemon 3 4 H 264 DSP Glue L I P R I 3 9 3 3 2 Undistortion DSP Glue L I P R I 2 7 3 4 1 Login P I L R I q 8 3 4 2 Navigation P I L R I 6 9 3 9 1 Application Base E Applicaton Layer CAR Login Screen 3 5 4 Options Screen 3 9 9 Network Screen 3 4 0 Video Screen 3 6 iOS UI Application Base Application Layer Login Screen Options Screen Network Screen Video Screen Software implementation responsibilities are traded back and forth between William and Troy Kyle will be parti
7. 196 hrs 4 hrs 4 hrs 12 hrs 4 hrs 4 hrs 4 hrs 8 hrs Tue 1 18 11 Wed 1 19 11 Wed 1 19 11 Wed 1 19 11 Mon 1 24 11 Mon 1 24 11 Wed 1 19 11 Fri 1 21 11 Fri 1 21 11 Mon 1 24 11 Thu 1 27 11 Wed 1 19 11 Wed 1 19 11 Fri 1 28 11 Mon 1 31 11 Tue 2 1 11 Wed 2 2 11 Wed 2 2 11 Wed 2 2 11 Wed 2 2 11 Wed 2 2 11 Thu 2 3 11 Thu 2 3 11 Fri 2 4 11 Tue 1 18 11 Fri 2 25 11 Wed 1 19 11 Fri 2 25 11 Thu 1 27 11 Thu 1 27 11 Fri 3 25 11 Fri 1 28 11 Fri 1 21 11 Mon 1 24 11 Fri 1 28 11 Wed 2 2 11 Thu 1 20 11 Mon 1 31 11 Tue 2 1 11 Wed 2 2 11 Fri 3 25 11 Wed 2 2 11 Wed 2 2 11 Fri 2 4 11 Thu 2 3 11 Thu 2 3 11 Fri 2 4 11 Mon 2 7 11 LC Jan 9 11 Jan 23 11 Feb 6 11 Feb 20 11 Mar 6 11 Mar 20 1 Apr 3 F T S W S T M F T S W S T M F T S W S T MIFITIS i M Tm T Task Split Milestone Project Aureole 5 print Date Tue 11 30 10 summary Project Summary External Tasks External Milestone MM 9 Weg M Inactive Task Inactive Milestone Inactive Summary V UJ Manual Task Duration only Manual Summary Rollup ss Manual Summary Start only Finish only Deadline Critical Critical Split Progress M Slack a Page 2 Figure 12 Gantt Page 2 Aitne Confidential Page 103 ee LL E Ee RE F T S W S T MIF T S IW S T MIF TIS WIS TIMIF TIS 2 3 3 1 2 3 3 2 2 3 4 2 3 4 1 2 3
8. 3 746 77 1 956 92 10 1 200 00 430 77 1 630 77 326 15 3 746 77 1 956 92 11 1 200 00 430 77 1 630 77 326 15 3 746 77 1 956 92 12 2 040 00 430 77 2 470 77 494 15 3 746 77 2 964 92 Aitne Confidential Page 44 13 940 00 430 77 1 370 77 274 15 3 746 77 1 644 92 Total 24 000 2 240 8 750 5 600 01 40 590 01 8 118 00 48 708 01 48 708 01 The numbers reflect all of the bills and costs that are paid per week A normalized curve is ideal for any project since the same amount in cash would be paid every week and that there is no surprise increases in weekly spending However that is not the case for any project Spending is sometimes random and at different amounts See next page for Cumulative Vs Idealized Cost figure Cumulative vs Idealized Cost 60 00 50 00 40 00 30 00 20 00 10 00 0 00 Cumulative Actual Cumulative Ideal Thousands of Dollars 123 45 6 7 8 9 10111213 Week Figure 4 Cumulative vs Idealized Cost This chart is the outcome of the Sequence of Cost data The current calculation of costs has most of the spending done at the beginning of the project where labor is most intensive Spending will reduce to an absolute minimum at week 13 when all work is complete Aitne Confidential Page 45 Appendix A Quad Chart s Project Codename Aureole LA Author William Reading bill aitne com aline Features 3609 View of Camera Environment User Controllable Portal into
9. Fortunately Joseph is quite familiar with hardware interfaces and how to use reset buttons He holds down the reset button for 15 seconds and the Aureole resets itself to factory defaults Open Issues None identified at this time Requirements Device OS Drivers and Software e Linux OS and Drivers e Custom daemons e Multitasking Device status amp control I O s e Manual Device I O peripherals e Indicator lights e Buttons Aitne Confidential Page 56 Conference Applications amp Web UI e Dual video panes for user interfaces o Video feed image navigation amp aspect adjustability for user interfaces o Remote interface via user interfaces for Aureole platform o RTSP server configuring from user interfaces o Conference session controls via user interface Multiple Ul availability Mobile device user interface Web user interface Footprint e Mobile Small footprint o Lightweight o Small o Rugged frame Video Audio Encoding amp Quality e 360 degree panoramic video conferencing e Audio and H264 Encoding integration synchronization e HD quality video and refresh rate Network Interface e Multiple network access peripherals e Wireless and On board network ports Power e Battery and Wall outlet power options Data Streaming e RISP server for streaming of video and audio data Aitne Confidential Page 57 Accessible and Configurable via a web browser The user must be able to open a web br
10. benefits component parts and development tools Table 5 Labor Costs Category Cost Hours Total Labor William 22 22 234 5 199 48 Labor Troy 22 22 210 4 666 20 Labor Kyle 2272 227 E 7 910 30 Insurance Wiliam 20 of Base 1 039 90 Insurance Troy 2076 of Base 933 24 Insurance Kyle 2076 of Base 1 582 06 Benefits William 1576 of Base 779 92 Benefits Troy 1576 of Base 5699 93 Benefits Kyle 15 of Base 1 186 55 Subtotal 23 997 58 Aitne Confidential Page 39 At Aitne each Aitne employee is treated equally regardless of position Every engineer gets full medical insurance 2076 of base pay company benetits 1576 of base pay and a decent salary Table 6 Component Costs Category Cost Quantity Total IC Components 60 2 120 PCB Boards 1 000 2 2 000 Passive Parts 40 2 80 Casing 20 2 40 Subtotal 2 240 The Aureole device has various types of analog and digital components that make overall system operations as smooth as possible In order to satisfy these requirements high grade components must be purchased and in multiple amounts This will also ensure that there is back up components incase of a malfunction or any ECs that may occur PCB is custom made and has to be purchased thru a board manufacture which will be a pricier than developing the PCB in house Table 7 Testing amp Development Tool Costs Category Cost Quantity Total Oscilloscope 1 500 l 1 5
11. 4 2 2 3 4 3 2 3 5 2 3 5 1 2 3 5 2 59 2 3 5 3 60 2 3 5 4 61 3 62 3 1 63 3 11 64 3 1 2 65 3 2 66 3 2 1 67 13 2 2 68 3 2 3 69 3 2 4 70 3 2 5 71 3 3 72 13 3 1 73 3 32 74 3 4 51 52 53 54 55 56 57 58 Software Fri 2 4 11 Fri 2 4 11 Mon 2 7 11 Mon 2 7 11 Mon 2 7 11 Tue 2 8 11 Fri 2 25 11 Fri 2 25 11 Fri 3 4 11 Fri 3 11 11 Fri 3 18 11 Thu 1 13 11 Wed 1 19 11 Wed 1 19 11 Thu 1 20 11 Thu 1 27 11 Fri 1 28 11 Thu 2 3 11 Fri 1 28 11 Thu 1 27 11 Fri 2 4 11 Fri 1 21 11 Fri 1 21 11 Mon 1 24 11 Fri 1 28 11 Fri 2 4 11 Mon 2 7 11 Tue 2 8 11 Mon 2 7 11 Tue 2 8 11 Tue 2 8 11 Fri 3 25 11 Fri 3 4 11 Fri 3 11 11 Fri 3 18 11 Fri 3 25 11 Tue 2 15 11 Thu 1 20 11 Thu 1 20 11 Thu 1 20 11 Fri 2 4 11 Fri 1 28 11 Fri 2 4 11 Wed 2 2 11 Fri 1 28 11 Fri 2 4 11 Tue 1 25 11 Mon 1 24 11 Tue 1 25 11 e w s i I emm LL J Project Aureole 5 print Date Tue 11 30 10 Wi Fi Enable Button 4 hrs Local Mute Button 4 hrs GPIO Status LEDs 12 hrs Wi Fi Enable LED 4 hrs Local Mute LED 4 hrs Power On Off LED 4 hrs Design 160 hrs Initial Schematic 40 hrs Initial PCB 40 hrs Final Schematic 40 hrs Final PCB 40 hrs 272 hrs Operating System 12 hrs OS Bringup 8 hrs Init Scripts 4 hrs Daemons 36 hrs Watchdog Daemon 4 hrs Discovery Daemon 4 hrs Streaming Daemon 20 hrs Web Daemon 4 hrs LED Button Daemon 4 hrs Gstreamer Plug ins 20 hrs H 264 DSP Glue 10 hrs Undi
12. Camera Wireless Communication via Internet vo Touch based Control Ed s eet nm DEL LLL We I 2 ROM Timeline Phase 1 2 Weeks 8 000 Phase 1 Planning Requirements Phase 2 10 Weeks 40 000 Specification and Hardware Selection Phase 3 2 Weeks 8 000 Phase 2 Alpha Software build on reference Phase 4 1 Week 4 000 board Alpha Hardware build for selfhost Total 60 000 over 15 weeks platform Phase 3 Iterative Usability and Test Phase 4 Launch Software License Hardware Webcam hardware and iPad Application Technical Approach Deliverables Figure 5 Quad Chart Appendix B Capstone Design Document Presentation Aitne Confidential Page 46 Capstone Design Document Project Aureole xt e Overall Outline Three Overall Sections Overview Design Planning Overview Project Aureole at fe ev aitne Troy Kensinger Software Engineer troy aitne com Project Aureole NT NY fe oss aitne aitne Project Aureole 1 2 Overview Outline Overview Wi T Meet the Team Iam Disclaimer Heading Problem Statement Project Manager Aureole Concepts bill aitne com Applications Personas and Use Cases Project Aureole ah e Project Aureole ai e 4 5 Kyle Mays Disclaimer Hardware Engineer kyleQaitne com Mte TRAN es Project Aur
13. Confidential Page 26 Special Purpose Buttons LEDs Two buttons will be added to the design of Project Aureole with different specific purposes A Power ONT switch will also be added to the design Of the special purpose buttons a Wi Fi Enable button and a Local Mute button will both be incorporated in the design These two buttons will serve device end purposes for the user The Wi Fi Enable button will alert the processor and communication modules to present the device available through wireless access IEEE 802 11 rather than wired Ethernet IEEE 802 3 The Local Mute button will signal to the processor to silence the microphones on the device and thus eliminate all sound sent to the remote users Both the Wi Fi Enable and Local Mute buttons will be connected to the OMAP 3530 processor through the many available general purpose input output pins Project Aureole will also use simple multi color LEDs to signal the various states of the device Power ON Local Mute and Wi Fi Active Each of these multi color status LEDs will be controlled by the OMAP3530 through general purpose input output pins on the processor as well Power Because Project Aureole is designed as a mobile device battery power will be required along with wall power With the wall connection voltage regulators will be used to control the voltage input at 5V and 3 3V fo power the several components within the device In the same circuitry a charging circuit
14. Costs Category Shipping Office Space Utilities Telecom Office Supplies Total 1 000 2 500 1 500 100 500 Total Indirect Costs 5 600 Little fees such as shipping printing office supply and morale booster items are all considered to be general indirect costs These costs add up over time creating the need for a large sum of cash to be allocated into the project budget Company office and lab space will also need to be accounted for because it is necessary to have a main base of operation for engineers to develop the Aureole device These shelter fees are also considered to be indirect costs Finally Aitne will need the proper telecommunication infrastructure in order to connect with clients and stakeholders Table 10 Break Even Costs Category Indirect Direct Total 5 600 34 987 58 Subtotal Costs 40 588 58 The total break even costs come out to around 40 588 This total however does not include any room or consideration for a Profit Margin 20 of the Aitne Confidential Page 42 break even cost was added to the final cost to formulate the expected profit for Project Aureole Aitne will not be adding any extra costs that would mitigate any potential risk occurrences nor will it be adding any sort of time value of money buffer due to increasing inflation Table 11 Total Costs Category Total Break Even Costs 40 588 58 2076 Margin 8 117 72 Total Costs 48 706 30 The final
15. Project Aureole will also use simple multi color LEDs to signal the various states of the device Power ON Local Mute and Wi Fi Active Each of these multi color status LEDs will be controlled by the OMAP3530 through general purpose input output pins on the processor as well Power Because Project Aureole is designed as a mobile device battery power will be required along with wall power With the wall connection voltage regulators will be used to control the voltage input at 5V and 3 3V to power the several components within the device In the same circuitry a charging circuit will be implemented to charge the lithium ion battery while plugged into the wall Once unplugged the lithium ion battery will power the device for a minimum of 1 hour per the performance requirements Aitne Confidential Page 89 As a complete device Project Aureole will have all the capabilities necessary to record video process the stream and transmit that stream over a desired network fo remote users Appendix G Work Breakdown Structure WBS Figure 6 WBS Research Aitne Confidential Page 90 Figure 7 WBS Hardware t amn um qu Aitne Confidential Page 91 Figure 8 WBS Software Figure 9 WBS Testing Aitne Confidential Page 92 Figure 10 WBS Wrap Up Aitne Confidential Page 93 Appendix H Responsibility Assignment Matrix RAM Each Aitne team member has specific
16. Tue 3 29 11 106 4 1 1 3 Voltage Levels 1hr Tue 3 29 11 Tue 3 29 11 107 4 1 1 4 Stress Test 1hr Tue 3 29 11 Wed 3 30 11 108 4 1 2 Camera 3 hrs Mon 3 28 11 Wed 3 30 11 109 4 1 2 1 Connectivity 1hr Mon 3 28 11 Mon 3 28 11 110 4 1 2 2 Functionality 1hr Tue 3 29 11 Tue 3 29 11 111 4 1 2 3 Stress Test 1 hr Wed 3 30 11 Wed 3 30 11 112 4 1 3 Audio 2hrs Tue 3 29 11 Wed 3 30 11 113 4 1 3 1 Connectivity 1hr Tue 3 29 11 Tue 3 29 11 114 4 1 3 2 Stress Test 1 hr Wed 3 30 11 Wed 3 30 11 115 4 1 4 802 11x Module 11hrs Fri 3 25 11 Wed 3 30 11 116 4 1 4 1 Connectivity 1hr Fri 3 25 11 Fri 3 25 11 117 4 1 4 2 On Board Communication 3 hrs Fri 3 25 11 Mon 3 28 11 118 4 1 4 3 Off Board Communication 3 hrs Mon 3 28 11 Mon 3 28 11 119 4 1 4 4 Stress Test 4 hrs Wed 3 30 11 Wed 3 30 11 120 4 1 5 Ethernet Module 8 hrs Fri 3 25 11 Wed 3 30 11 121 4 1 5 1 Connectivity 1hr Fri 3 25 11 Fri 3 25 11 Task ES Inactive Task Start only L Split saaaaaaaaiasisisissss Inactive Milestone Finish only d Milestone Inactive Summary V Deadline A Project Aureole 5 print S qu CR ben Date Tue 11 30 10 Summary Manual Task Critical Project Summary Vv V Duration only Critical Split TTT External Tasks ts Manual Summary Rollup Progress External Milestone Manual Summary Wir Slack MN Page 5 Figure 15 Gantt Page 5 Aitne Confidential Page 106 Task Nam
17. and use DHCP settings As the device is now configured he ships it off to the team in India Upon arriving in India the offshore team puts it in the conference room and turns it on At the next scheduled meeting time George simply puts in the IP address of the Aureole into his web browser logs in again and can see and hear the rest of the team Since George has already configured another Aureole in the local conference room the offshore team can also see and hear him Aitne Confidential Page 54 Bringing Along a Remote Worker to a Meeting Jay is selling an embedded microcontroller to a hardware solutions company located in Texas Due to travel budget cuts as a result of the economy his sales engineer is no longer able to accompany him on all of the sales visits for potential customers Jay brings along an Aureole fo his meeting and a 3G smartphone that supports tethering over WiFi Before the meeting Jay configures the Aureole to use the tethering capability directly from the phone and places the Aureole in the middle of the conference room Jay calls the engineer over a traditional telephone network via his smartphone or the conference room s phone and presses the mute button on the device to avoid any echo from the remote conference room The remote engineer is able to connect to the Aureole to see everyone in the room Remote Connection without Prompting Sejun is a remote worker for a networking company Because h
18. complete with the following network options e 802 11 o USB Wi Fi device support e 802 3 o RJ 45 port located at base of device Auto Recognition Aureole uses Universal Plug and Play UPnP to automatically generate a list of all network devices connected to Aureole Once a list is Aitne Confidential Page 65 generated the Aureole software can automatically choose a preferred network or the best available network for conferencing Power Aureoles two power sources go hand in hand for efficient management of electric resources and for system process enhancements Below are the following power sources and their features e IOVAC wall outlet jack o Located at the bottom of the device e 5VDC Lithium Ion battery o Lasts a minimum 1 hours when processor is utilizing all threads o Non removable charging port on bottom of device Power management features e Automatic switch to battery power when wall outlet power is removed from device e Configurable sleep and idle modes when running on battery power Data Streaming Aitne Confidential Page 66 Aureole runs an RTSP server that allows the streaming of video over the network cloud to any device The RTSP server handles all of the following conferencing features e Buffers and Streams H264 MPEG 4 AVC video e Hosts multiple sessions e Streams both video and audio synchronously Limitations e Nota two way videoconferencing system Does not emit audio on
19. responsibilities for the Aureole project To better organize each person s duties a Responsibility Assignment Matrix was created Each assignment in the RAM is from a work package in the WBS The packages have various roles that need to be played Such roles determine who has the most responsibility in each work package The roles available are leader L participant P input I and reviewer R Table 13 RAM Legend 1 Tei nr Ree The leader is in charge of the entire work package The participant is involved in the execution process of the work package but not solely responsible The input agent is usually a client or stakeholder They usually just make suggestions during the work package execution process Finally the reviewer looks over the work and determines whether or not the work package is complete and was completed well The five main phases are broken down in individual tables and further analyzed as to who within Aitne is doing what see next page for Research table Aitne Confidential Page 94 Table 14 RAM Research E Operating System Ti DSP Bridge WebUI Software RTP Software iOS Android SP Browser Plugin ad Beagle Board Ti OMAP Processor C644 DSP I O Protocols USB GPIO Power Circuit Battery Wall Outlet Camera CMOS sensor Catadrioptric Ethernet RJ 45 USB Wi Fi Adapter I O Buttons amp Indicators Design x Procurement User Manual Test Document i i Nje ta ta k k Fa Fa
20. status reporting project documentation Kyle Mays Hardware Engineer Aitne Confidential Page 36 Great hardware can t be designed with out a great hardware engineer on staff Kyle Mays was an obvious choice to leading the development of the Aureole device hardware and modules His responsibilities in project Aureole include hardware research schematic amp PCB design population of hardware devices hardware module testing ordering of parts and project documentation Troy Kensinger Software Engineer Every team has a jack of all trades who can be utilized in all areas of a project Troy Kensinger is just The guy to pick up work either on his own or undertake software and hardware duties when asked His responsibilities include hardware amp software research IOS client software development amp test Android client software development amp test population of hardware devices hardware module testing and project documentation Member Qualifications Each player on the Aitne squad wasn t picked just because they were able and willing to participate Every engineer had the drive and initiative to spearhead Project Aureole with accuracy and precession All project Aureole team members have years of applicable experience and qualifications that helped them gain the title of Aitne Engineer William Reading Project Manager amp Software Engineer Engineers commonly do not start their professional car
21. will be implemented to charge the lithium ion battery while plugged into the wall Once unplugged the lithium ion battery will power the device for a minimum of hour per the performance requirements As a complete device Project Aureole will have all the capabilities necessary to record video process the stream and transmit that stream over a desired network to remote users Aitne Confidential Page 27 Work to be Performed Please see Appendix H for the Responsibility Assignment Matrix RAM Precedence Diagram Please see Appendix G Task Schedule Please see Appendix J Milestones RTSP RTP Technical Demo This deliverable will be the first technical demonstration of Aureoles software features The RTSP streaming server demonstration ensures that the video can streamed to any peripheral from Aureole WebUI Demo End users must be able to access the video stream through a web browser This demonstration will show how a typical end user could log in to a web browser to view the Aureole video This will simply be a user interface demonstration Main PCB Demo This demonstration will be a functionality demo of the hardware on the main Aureole device PCB The demonstration will consist of powering the board through wall power switching to battery power and demonstrating the functionality of the buttons and LEDs iOS Streaming Demo The first client application will be demonstrated for functionality on this set d
22. 00 Multimeter 30 2 60 Computer 250 750 Hardware Develooment 150 2 300 Board Multisim 1 900 l 1 900 Aitne Confidential Page 40 Ultiboard 2 000 l 2 000 Subtotal 8 750 The remaining direct costs consist of all the tools and development suites needed for Project Aureole The different suites are necessary when developing the PCB amp hardware schematic and simulating the various device circuits The Multimeter and Oscilloscope tools are a must have when testing the hardware Any problems experienced during bring up can be easily traced by utilizing either a Multimeter or Oscilloscope Granted both of these tools are very expensive so they will be rented for a brief period until the final prototype is complete Table 8 Total Direct Costs Category Total Labor 23 797 58 Component 2 240 Other 8 750 Total Direct Costs 34 987 58 The final tally for the direct costs of Project Aureole is 34 987 58 which is a very feasible budget for a venture capital company or a wealthy entrepreneur to support However there are other costs that still need to be accounted for before totaling the final bill Indirect Costs Money spent on every thing that influences or relates to the forward progression of the project is considered indirect costs These costs usually include project Aitne Confidential Page 41 overhead administrative supplies and general items needed for Aitne to remain productive Table 9 Indirect
23. 1 System Hierarchy Flow Charts Sat 29 01 11 Initial Software Architecture Sat 22 01 11 30 Jan 11 Bill of Materials Sun 20 03 11 Critical Design Review Tue 15 03 11 Board Final PCB Fri 11 03 11 20 Feb 11 13 Mar Al Star 03 Apr 11 24 Apr 11 Sat 22 01 T LL o Initial Hardware Block Diagrams Sat 22 01 11 Initial PCB Layouts Sat 29 01 11 Test Plan Sat 05 02 11 Final Software Architecture Mon 07 02 11 Tinish Board Final Schematic Fri 11 03 11 B Sponsor Requirements 4t 30 04 11 Test Results Sat 09 04 11 Working Prototype Sat 23 04 11 Final Documentation Sat 30 04 11 The sponsor behind the Aureole project has asked Aitne Incorporated To submit an abstract and technical document to be presented at the 201 1 ASEE Gulf Southwest Annual Conference in Houston TX The Team will then be sent to Houston TX to present the paper and the Aureole concept to the conference Aitne Confidential Page 32 Section IV Risk Assessment Risk can be defined as the deviation of one or more results of one or more future events from their expected value which are usually negative We at Aitne Incorporated have written an assessment of risks surrounding project Aureole using two risk management methods e Risk Evaluation Matrix e Risk Prioritization Matrix Risk Evaluation Matrix The Risk Evaluation Matrix determines which of the perceived risks are more severe and
24. 2 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 i2 ci152 23285 iB Research iani 1221 DS D S2t8se228 8a82 e528 8 3 HW bring 2n 3 18 11 I o d x wee inm mm B PE Q uestio ns moe Type test x x x mnm x Test 3 1 11 4 25 1 El VO Spec vain x x x Geet Deploy meni 5 5 11 PS Network Spec Validation x x x xt i eee rr i E Mail contact aitne com for more information Ee x x x X x Network query list test X X x x i User error message amp notification tests x X X X X Video and Audio sync tests x x x x Hardware Periphreal Validation x I Video pane virtual zoom amp scri functionality test x auto Network recognition amp connection test x x RTSP to App amp UL connection test x x Connection Latency test x x x x xJ Video frames per second fps test x i Power management tesis x st EX oe oe OS functionality tests 0 0 0 0 0 xIIIIILILIIIILITIISgel Ate rte t t Lo Lo Lo Project Aureole aitne Project Aureole aitne Project Aureole aitne 52 53 54 Appendix C Capstone Design Document Introduction Problem Statement There is a need for a low cost highly mobile video conferencing platform that provides virtual presence for multiple remote users Virtual Presence Virtual presence means that you never have to get someone to move the camera to see what you want Every remote user can independently zoom and turn the camera about without disturbing others watching Vision Th
25. 3 7 1 d 3 3 7 8 2 2 2 2 4 2 1 System Test L I P R I 5 20 4 2 2 Operating System L I P R I 3 10 4 2 2 1 Unit Test L I P R I 3 10 4 2 3 Daemons E I P R I 5 15 4 2 3 1 Web Unit Test L I P R I 1 3 4 2 3 2 Streaming Unit Test L I P R I 1 3 4 2 3 3 LED Button Unit Test P I L R I 1 3 4 2 4 Gstreamer Plug ins L I P R I 1 2 4 2 4 1 Unit Test L I P R I 1 2 4 2 5 WebUI P I L R I 2 4 4 2 5 1 Unit Test P I L R I 2 4 4 2 6 Android UI P I L I R 2 7 4 2 6 1 Unit Test P I L I R 2 7 4 2 7 iOS UI L I P R I 2 7 4 2 7 1 Unit Test L I P R I 2 7 4 3 3 Final Test L P P R I 1 4 4 3 3 1 Web Browser P P L R I 1 2 4 3 3 2 iOS L P P R I 1 1 4 3 3 3 Android OS P P L I R 1 1 Aitne Confidential Page 99 Like the research phases all of the testing is split up amongst the Aitne engineers Each engineer will be doing hardware software and system testing for project Aureole The sponsor will doing most of the input and the advisor will be doing most of the reviewing Table 18 RAM Wrap up 5 Enclosure Enclosure Design Enclosure Review Enclosure Procurement 5 2 Presentation Content P L P R I 2 Review P P L R I 2 Final Presentation L P P R I 1 1 Final Documentation User s Manual Initial Draft Final Draft Bill of Materials Final Documentation 5 4 Prototype 5 4 1 Final Demonstration P E P R I 1 2 5 4 2 Functional Prototype P E P R I 5 20 8 6 The wrap up section is also split up amongst the Aitne Engineers This is mostly the do
26. 38 39 Technology Comparison F Se unctional Block Diagram Ner g Sensor Characterization CMOS Sensor Low Cost Software High Hardware Complexity Bandwidth Aptina Imaging MT9P401112STC me Ethernet d d Pe Ary Beagle Board 5 Megapixel 2752H x2004V Wireless EG n NU Ethernet 15 frames per second TE sra Bluetooth 3 0 V v EES Project Aureole Aine Project Aureole l Project Aureole IE 40 41 42 Protocols Communication Protocols Communication Software Hardware Real Time Protocol RTP Real Time Streaming Protocol RTSP General Purpose I O GPIO Planning HyperText Transfer Protocol HTTP Universal Serial Bus v2 0 USB H 264 Video Encoding Project Aureole sine Project Aureole anne Project Aureole ar 43 Aitne Confidential Page 51 44 45 Aitne Confidential Page 52 Outli Timeline Deliverables Deliverable Member Responsible Delivery Date Initial Hardware Block Diagrams Kyle Mays 1 22 2011 PI i Initial Software Architecture William Reading 1 22 2011 anning Initial PCB Layouts Kyle Mays 1 29 2011 Timeline System Hierarchy Flow Charts William Reading 1 29 2011 Test Plan Troy Kensinger 2 5 2011 Deliverables WebUI Demo Troy Kensinger 2 5 2011 RTSP RTP Technical Demo Wi
27. 7 8 9 10 ITITITITITITITITITITII p M RS IO se El pe pn 2M ee 12 3 4 567 8 9 10 1112 le be la I3 T5 193 ES 19 to IS 1S Io To Section V Team Organization amp Qualifications Hierarchy Chart The Aitne Incorporated ship is sailed by three highly experienced hardware and software engineers Each member of the Aitne Team brings a unique skill set to project Aureole that is necessaryfor proper execution A hierarchy chart of was created in order to shed light on the employee structure of Aitne Incorporated Aitne Confidential Page 35 William Reading Project Manager amp Software Engineer Kyle Mays Troy Kensinger Hardware Engineer Software Engineer Figure 3 Organizational Chart The responsibilities of each engineer were divided amongst each other with respect to their unique skill sets and desired project duties Workloads and responsibilities for each team member reflect their experience in projects and companies prior fo Aitne Wiliam Reading Project Manager amp Software Engineer The captain of the USS Aitne is not only an expert at project management but also a Guru with software design and testing Without Mr Reading the Aureole project would have never been spawned His responsibilities in project Aureole include software research driver software development amp testing daemon software development amp testing WebUI development amp testing hardware testing team management duties project
28. 9 o 9 e MP e lt Formal Technical Proposal Project Aureole Developers Project Manager Wiliam Reading Hardware Engineer Kyle Mays Software Engineer Troy Kensinger Sponsor Dr Sejun Song Advisor Prof George Wright Reviewer Signature Date Aitne Confidential Page Dr Joseph Morgan P E M E Please find attached our formal technical proposal for the Aureole mobile conferencing system proposed by the engineers at Aitne Inc The engineering team includes Wiliam Reading Project Manager amp Software Engineer Kyle Mays Hardware Engineer and Troy Kensinger Software Engineer The Aureole mobile conferencing device is a revolutionary new way for people to connect and communicate with each other around the globe Using Aureole users are able to collaborate via Virtual Presence the ability to have a face to face conversation with someone halfway across the world Due to Its flexible power and network capabilities this highly mobile device can be deployed nearly anywhere people need to collaborate Users can access video streams from Aureole via both traditional and mobile computing devices via the web or native clients Finally at a 100 price point and small footprint the Aureole becomes a must have device for any business or individual with the need stay in touch with others Research for Aureole will commence on January 11th 2011 marking the beginning of the development cycle Au
29. Confidential Page 6 List of Figures LIU I CONC ee DIGON em m MM 22 ROUre 2 le tere iwel BIOck DIAG I RER E EE E 26 ICUS oc Organzalonal CHAN MR 36 Figure 4 Cumulative vs OASOAeCROOS ar 45 FI i IS oLD a E EE 46 FMS Ee 0 aaee ieri iieii 90 Hour 7 WBS EE 9 BIS D S Oe WB SO E 9 POF CS Se getters RE EA AO A AA 92 BIS UNS TO WBS WIID D EE 93 FOS E PAGS EE 102 OS CO PAE a ad ont 103 FOS P COn EPA E 104 IOS TA CO PAGS A NN T 105 HOMME AERO E AEEA EEEE 106 HEUG To ee erugeet 107 REUS A CP PO a ee ose a do dat 108 PCS WO let ee 109 Aitne Confidential Page 7 Section Introduction General Everyday millions of businessmen engineers artists contractors managers CEO s students and many others use some type of video communication or conferencing tool Whether the need is for a multi million dollar partnership or a deployed soldier seeing his newborn child for the first time video conferencing systems are an integral part of everyday life Teachers use video conferencing systems to help educate students in remote countries or to teach from far away schools Airport security is steadily becoming more expensive and strict as government regulations continue to be revised in response to current events Families who are separated by long distances can reduce the stresses of plane travel by using a video conferencing system to visit one another The number of teleconferencing device users increases daily as business needs ch
30. Created diagrams and tables while assisting in writing publishable white papers Experienced hands on development of a working NG9 1 1 Testbed Skills Extensive knowledge of active amp passive circuitry schematic designing and reading Programming experience with C C PowerPC Assembly limited VHDL Visual Basic Software experience Microsoft Office Project ODNET LabVIEW Activities Associations Awards Congressional Nomination to United States Air Force Academy 2004 Deputy Flight Commander AFROTC Det 028 Prescott AZ 2004 2005 Sigma Pi Fraternity International 2004 Current Eo ERAU Prescott AZ Interim Vice President Brotherhood Committee Chairman II TAMU College Station TX Founding Father Vice President Sergeant at Arms IEEE Tech Student Member 2006 Current Texas A amp M University Varsity Inline Hockey 2008 Current ITERA Student Case Study Competition National Finalist 2009 Aitne Confidential Page 125
31. I O perphrials Tethering Watchdog Daemon fe wm wm te wm mm wm wm a wm wm wg wm ee wm wm fe mm wm e wm wm wm wm wm wm wm wm e mm wm wg Appendix D Problem Statement Memo Memorandum TO Dr Joseph A Morgan D E P E FROM Troy Kensinger THROUGH Dr Sejun Song Prof George Wright DATE October 18 2010 REF Problem Statement Memo As conference technology improves the size and price of new conferencing systems increase The hardware peripherals of conference systems such as Cisco s Telepresence and HP s Halo are extremely expensive and require a significant amount of space to deploy Smaller more generic conference tools such as a basic USB web camera have low resolutions and fail to create the sense of Virtual Presence that one experiences using higher priced video conference systems Virtual Presence is when a person obtains the sense that he or she is actually sitting at the conference table and communicating face to face with other members in the meeting when not actually being physically present Under the direction of Dr Sejun Song of Texas A amp M University the concept of a 360 panoramic view known as Virtual Presence has been developed using various software algorithms a catadioptric reflector lens and a small video camera Since this technology is new it has not appeared in the market By integrating this new technology with
32. RN RR 2 PON EE 2 WOIK to De POTION NS ee 28 Precedence OIA DE 28 TOSK o 1210 UE 28 INS STON CS E 28 ab Ge d dii CAMES ego KR 28 i e BEP qo e E M 28 MANTEP DOTIO a E A E T A 28 OS i esaiteibrsuem m T eirin iea eaS ENTES NAS Ua E 28 Android Streaming Demo EE 29 PU RE ne 29 WepUlSireaming Demio EE 29 DVI a ee a ii ln 29 N S ege e ow 2 Ke ISO TRS a nn Da a a a 29 Initial TAGE ei o0 Mere Ne en E 29 Lem e B dps d Bele EE 30 System Hierarchy FHoWw C EE 30 E E E E TERR 30 FOUR ACOSO CY NER M 30 BOGOM IDC LS sa S8 T NT UTEM 30 eese 30 Critical Design RE 30 Bill of Materials AA 3 Test ICT EE 3 OR DO PO tee iem T TETUER e ERROR 31 alto NB SU a RTS ANS LS WT umi dq 3 Section IV Risk ASSESSMENLM ccccssccssccescccsccesccesccesccecdseccsscsusccesccesstecceesceeseeses 33 Risk Evaluation Matrix EE E EE 33 Risk Prioritization Matrix 1 e eeee eee eee eee en eene KEREN ENEE EE KK venu E ee agen 34 Section V Team Organization amp Qualifications 35 Aitne Confidential Page 4 lte lte ne ue EE 35 Member Qualifications 1eeeeee esee eese eee eee eee ee eene nennen enhn netten stehe ete e eset ese sete nonne 37 Section VI Project Costs incl lili tenais Destin 39 DIGS 04 CO 2 eron T 39 Maec e CP E E 41 Appendix A Quad Chart ee 46 Appendix B Capstone Design Document Presentation
33. amera Like the Initial Software Architecture it is subject to change since if is only a checkpoint in the design process Aitne Confidential Page 29 Initial PCB Layouts These Initial PCB Layouts are based on open source reference designs However they will not be exactly the same to the references they were soawned from There are extra features added to the PCB layout that takes up more space on the board and potentially more layers System Hierarchy Flow Charts AT this point in the project the software architecture will be finalized and the System Hierarchy Flow charts can be created These flow charts outline the exact routines of how Aureole s systems subsystems and data processing elements This also outlines the Aureole Software clients as well that will be implemented on other peripherals Test Plan Testing of the overall system will be completed to ensure that the completed device works to specifications and that the user receives a genuine experience when using Aureole The test plan covers everything from both software and hardware aspects of the project Final Software Architecture This is the freeze date for any changes in the software architecture Board Final Schematic This is the freeze date for any changes in the Aureole hardware schematic Board Final PCB This is the freeze date for any changes in the final PCB that the hardware will be deployed on Critical Design Review All development and p
34. ange and become more globalized Organizations and Individuals no longer have the budget to take more than a few long distance trips per year which is why they are turning video conferencing systems to satisfy their needs for a more personal communication system Background There are various types of devices that can accomplish the task of video conferencing Whether it s a Cisco TelePresence conference system or a simple USB web camera each device is limited in some way A Cisco TelePresence system delivers a great conferencing experience but it is permanently stationary once setup and costs thousands of dollars A USB web camerais very cheap and can be highly portable but it lacks quality video feed and has a limited field of view There have been homemade conferencing systems that have utilized multiple web cameras to create panorama field of view video feeds however these systems are prone to bugs and fail to meet most communication protocol specifications With the business world changing the Aitne Confidential Page 8 demand for a protocol and industry specified device that incorporates features from both a Cisco TelePresence system and a USB web camera is increasing dramatically Technical Challenge Over lunch Dr Sejun Song and William Reading discussed the potential application of a catadioptric lens mounted atop a high quality low power web camera With the combination of a Linux operating system the proposed device
35. ate With the deployment of the iOS client application the Aureole conferencing system can be considered functionally possible However the functioning system consists only the Beagle board and not the final prototype Aitne Confidential Page 28 Android Streaming Demo This second streaming demo will mark the end date mobile client application development The Android client must demonstrate the same capabilities as the IOS client Without both client apps running properly there will be an uneven distribution of happy users thus hindering the Aureole experience Final PCB Demo This demonstration will be similar to the Main PCB Demo only this fime with the finalized PCB for the Aureole device WebUI Streaming Demo In unison with the Critical Design Review the WebuUI client application will be demonstrated marking the completion of all Aureole conferencing applications Deliverables Initial Software Architecture The software architecture will fake various shapes and forms during the course of research and implementation This date is simply a checkpoint of where the current software architecture stands Initial Hardware Block Diagrams This deliverable will detail all the selected components of Aureole Most components used in the Initial Hardware Block Diagram will be parts used on the Beagle Board Development Kit The components not native to the Beagle Board Development Kit include I O buttons lights microphone and c
36. ation which is used to view video streams from the Aureole Device Any extra features that attempt to make its way into the Aureole project plan will be considered Scope Creep and will be immediately removed There are zero benefits from allowing Scope Creep to influence changes in the Aureole Project As soon as the project scope is set in stone a Statement of Work can be developed The Statement of Work shifts the focus from what features to add into the Aureole project to determining how the system will act in use This can be examined by using a Conceptual Block Diagram A more low level analysis of the Aureole system modules is developed and explained with a Functional Block Diagram which is also a part of the Statement of Work section Now that the Aureole system operability and components have been defined the responsibilities to get the system up and running is divided amongst the development team All of phases activities tasks and subtasks are stated in a Work Breakdown Structure or WBS The WBS is a hierarchytree that spans all sections of the Aureole project and is a must needed tool in determining the Responsibility Assignment Matrix or RAM The RAM takes each portion of the WBS and assigns duties and allocates labor hours to the members of The development team project sponsor and project advisor The duties that are Aitne Confidential Page 14 assignments for the RAM s tasks are Leader Reviewer Participant a
37. battery for one hour The device must be able to run with all radios and features enabled for at least one hour Able to charge and run from wall power The device must be able to charge and operate solely from wall power and without the use of a battery Aitne Confidential Page 59 Able to fit in a typical laptop case The device must be slim and fit in a typical laptop bag It should be no thicker than 1 5 and no longer than six inches Performance Requirements Device OS Drivers and Software Daemons Underneath Aureoles hood is a fully functional computer that is comparable to older model desktop computers This powerful system can carry out all the processes needed for the Aureole conferencing system to run with very little hiccup Operating System OS The brain that controls Aureole is a Linux operating system Below are features Aureoles onboard Linux system Debian Linux OS o Configured for no GUI console UI only o Bootstrapped to image stored in an onboard 2GB SD card Drivers Both custom and open source drivers are used in the Aureole device The list below details the operations and functions of the drivers Used in Aureole e Video driver for the C64 DSP core that encodes the video data Aitne Confidential Page 60 Network driver for the Ethernet and Wi Fi protocols e Audio driver for mic input e O input driver for the onboard configuration peripherals Software Daemons The combinatio
38. bill for the entire Aureole project comes out to be 48 706 30 This includes every possible cost whether it s direct indirect or any other costs that is present in the present and future timeline of the Aureole project All expenditures will not be made at once The distribution of funds to pay bills and employees is an exponential process that is executed at various points in the 15 week project timeline Paychecks are cut every week ODCs other direct costs are made once and IDCs indirect direct costs in the project timeline This is called the Sequencing of Funds and it can be used as an extraordinarily useful tool when predicting trends in the overall project costs from the beginning to the end of the project See next page for Sequence of Costs table Aitne Confidential Page 43 Table 12 Sequence of Costs Week Labor Components ODC IDC Break Even Margin Normalized Total Weekly amp Weekly Project Cost Cost 1 2 040 00 8 750 430 77 11 220 77 2 244 15 3 746 77 13 464 92 2 2 772 86 430 77 3 203 63 640 73 3 746 77 3 844 35 3 3 420 00 430 77 3 850 77 770 15 3 746 77 4 620 92 4 3 600 00 430 77 4 030 77 806 15 3 746 77 4 836 92 5 2 886 43 430 77 3 317 20 663 44 3 746 77 3 980 64 6 1 322 86 1 120 00 430 77 2 873 63 574 73 3 746 77 3 448 35 7 177 86 430 77 608 63 121 73 3 746 77 730 35 8 1 200 00 430 77 2 750 77 550 15 3 746 77 3 300 92 9 1 200 00 1 120 00 430 77 1 630 77 326 15
39. cing HD quality video and refresh rate Network Interface On Board Ethernet IEEE 802 3 Access port Aitne Confidential Page 16 Wireless IEEE 802 11 Access Availability Footprint Mobile Small footprint Rugged Frame Power Wall Outlet power Battery Power Option Performance Requirements Device status amp control I O s Mute button to disable audio input to on board microphone Reset button to restore Aureole to POR state Power Button to power on Aureole and begin POR LED lights fo indicate power state system states and Wi Fi status Footprint Small enough to fit in a laptop case lt 10 X 10 X 3 Very lightweight lt 11b Must be able to view entire body of conference members from table top height Drop shock proof up to 4 feet Network Interface 802 11 USB Wi Fi support 802 3 RJ 45 port located at base of the device Power TIOVAC wall outlet jack Located at the bottom of the device oV DC Lithium Ion battery Lasts a minimum 1 hours when processor is utilizing all threads Non removable charging port on bottom of device Aitne Confidential Page 17 Power management features Automatic switch to battery power when wall outlet power is removed from device Configurable sleep and idle modes when running on battery power Software Scope The software aspect of Aureole will deal not only with the video and audio capture and processing but the transmission of that stream as well as the
40. cipating in the process by making sure every piece of code is coherent and is built solid The sponsor will be reviewing the Android duties because of his expertise in the subject Other than that the Aitne Confidential Page 96 sponsor will be mostly providing input while the advisor will be doing most of the reviewing Aitne Confidential Page 97 Table 16 RAM Hardware Wall Power Connection Plug Battery Power Connection Plug Charging Circuit Battery Selection Design Voltage Regulator Input Voltage Output Voltage rT Ff FP Pref Fr Fr D OO 0 0 VV DU D A k H U HP HP k U H HR UJ UJ UJ WON LA WONN Ul Camera Design Selection Procurement Assembly Implementation 802 11x Wireless Module Design Selection Power Management Implementation Ethernet Module Design Selection Power Management Implementation Audio Design Selection Power Management Implementation 2 3 Beagle Board Power Management Power On Off Switch Communication Camera CMOS Sensor USB GPIO Switches Wi Fi Enable Button Local Mute Button GPIO Status LEDs Wi Fi Enable LED Local Mute LED Power On Off LED Design Initial Schematic Initial PCB Final Schematic Final PCB Ul Ul Ul Tr rrr TD TT VV OO OO OO D VU VU PE CPP V rrr r 4 04 04 04 9 UU CO CU CU CU CO C9 om om onm eS AAADADAADAAAAAA aA rnrnrnrr re er em e rem ER ee EF aO P HP NN UI H LP N Ul H rm NJ Ul NJ H E NJ UI LULU Bra AAW Bra N NJ NJ UJ
41. could stream 3609 degree field of view high definition video to the web that is comparable to the Cisco TelePresence conference system However the device would be much smaller and cheaper than the Cisco TelePresence system Both the catadioptric lens and web camera are very small in size So small in fact that adding network connectivity modules power modules and a battery to the device would not hinder its mobility whatsoever The outcome is a device that is so highly mobile that it could be deployed just about anywhere By creating multiple client applications users could connect to the mobile device from a desktop computer a laptop a tablet PC and even a cell phone By the time lunch finished a killer app in the mobile conferencing industry was born A few days later Aitne Incorporated was born and was appointed to developing the revolutionary new video conferencing device Since this was a right of passage for the newly formed company the project was named Aureole which signifies that the device being created was a representation of Aitne Incorporated s personage With the Sponsorship and guidance of Dr Song and Prof Wright Aitne has come up with a battle plan that will overcome the massively complex technical tasks that are required for the completion of project Aureole There are nine factors of technical merit that must be satisfied in order for the project to be considered technically challenging From researching t
42. ct goes over budget Aitne Confidential Page 113 Priority of other projects Aitne Confidential Page 114 Breaking Malfunction of hardware components Aitne Confidential Page 115 High latency between Aureole and mobile client Aitne Confidential Page 116 PCB component vendor takes too long to ship parts Aitne Confidential Page 117 DSP Linux drivers are of low quality Aitne Confidential Page 118 Poor video quality from camera catadioptric reflector lens Aitne Confidential Page 119 Possible scope creep Lo x Aitne Confidential Page 120 Flaws in final PCB Aitne Confidential Page 121 Communication interfaces don t meet protocol during testing Appendix L Resumes Aitne Confidential Page 122 WILLIAM READING Local 3900 Old College Rd Apt 17 Bryan Texas 77801 Mailing 93 S Jackson St 9202 Seattle Washington 98104 1 979 814 4710 billGaggienerds org Education Texas A amp M University B S in Telecommunications Engineering expected Spring 2011 Senior design project focuses around 360 mobile videoconferencing using custom hardware Relevant Skills C C C Objective C COM ATL Perl Unix Shell Scripting SQL Linux Mac OS X Windows Systems Programming iPhone Development Recent Urban Search amp Rescue US amp R February 2010 present Experience Texas Engineering Extension Service TEEX Position Mobile Application Develope
43. cumentation portion of the project where each engineer will describe and point out every detail of the implementation process and charactistics of the final product The advisor will be doing all of the reviewing and the sponsor will solely be giving input to the final documentation Aitne Confidential Page 100 Appendix I Network Logic Diagram NLD Aitne Confidential Page 101 Appendix J Gantt Chart Figure 11 Gantt Page 1 Aitne Confidential Page 102 ID WBS Task Name Work Start Finish LC Jan 9 11 Jan 23 11 Feb 6 11 Feb 20 11 Mar 6 11 Mar 20 1 Apr 3 F risiwis riMiri risiwis r Mir vis iwis riM r T s 1 1 Research 116 hrs Tue 1 11 11 Fri 2 25 11 2 141 Software 20hrs Tue 1 11 11 Wed 1 12 11 3 11 1 1 Operating System 4hrs Tue 1 11 11 Tue 1 11 11 4 112 Ti USB Bridge 4 hrs Tue 1 11 11 Tue 1 11 11 Lk 5 11 1 3 WebUI Software 2 hrs Wed 1 12 11 Wed 1 12 11 i 6 1 14 RTP Software 2 hrs Wed 1 12 11 Wed 1 12 11 7 1 1 iOS 2 hrs Tue 1 11 11 Tue 1 11 11 8 1 16 Android 2 hrs Tue 1 11 11 Tue 1 11 11 9 1 17 Browser Plugin 2 hrs Wed 1 12 11 Wed 1 12 11 I 10 1 1 8 Software Design 2 hrs Wed 1 12 11 Wed 1 12 11 i 11 1 2 Hardware 48hrs Tue 1 11 11 Tue 1 18 11 12 1 2 1 Processors 8hrs Wed 1 12 11 Wed 1 12 11 13 1 2 1 1 Ti OMAP Processor 4 hrs Wed 1 12 11 Wed 1 12 11 L 14 1 2 12 C644 DSP 4 hrs W
44. current Aitne Confidential Page 82 state of conferencing systems we at Aitne have come up with the following problem statement There is a need for a low cost highly mobile video conferencing platform that provides Virtual Presence for multiple users Aitne Incorporated has decided to invest its time and effort in the development of this technology and transferring the new system to the ever expanding video conferencing market Either over Ethernet or Wi Fi the fully functional prototype will be able to deliver the experience of Virtual Presence to users via mobile and desktop peripherals This revolutionary product known as Aureole will forever change the way businesses students private owners and other consumers connect with each other It will also launch a new technology into the video conferencing market that will bring about new improvements and applications for future devices just like Aureole Appendix E Conceptual Design Memo Memorandum TO Dr Joseph A Morgan D E P E FROM Kyle Mays THROUGH Dr Sejun Song Prof George Wright DATE November 03 2010 REF Conceptual Block Diagram Memo Aitne Confidential Page 83 The concept of Project Aureole is fo provide end users with virtual presence where video conferencing is less available Such a device would be beneficial in many different cases including off site video conferencing remote education and video surveillance In order to accompl
45. e Aureole provides a 360 video streaming portal into a room accessible over standard TCP IP networks Once configured it can be accessed remotely with no interaction required from the remote end Personas Jay Morgan Jay is a sales representative at a hardware company in a role that requires him to travel to meet with customers frequently He frequently defers to sales engineers in other parts of the company for technical backup Joseph Porter Joseph is a tenured professor at a major Texas Research University He is collaborating with colleagues at a Boston Technology University Aitne Confidential Page 53 George Song George is a people manager and engineering lead at a major software company He manages an offshore team located in India Sejun Wright Sejun is a software engineer that works remotely for a major networking devices company Use Cases Aureole in Multiple Conference Rooms George is having his weekly team meeting with both onshore and offshore teams George ships an Aureole to the offshore team but before doing so he plugs the Aureole into his local switch opens up the Computer Window to discover local devices on his computer finds the Aureole and double clicks on it TO open the web interface From the web interface he logs in using the default username and password of admin admin and configures the device to use the SSID of the offshore team offshore and to join it with the key of offshore
46. e Confidential Page 20 Auto Recognition Universal Plug and Play UPnP to automatically generate a list of all network devices connected to Aureole Power Management Features Automatic switch to battery power when wall outlet power is removed from device Configurable sleep and idle modes when running on battery power Data Streaming Buffers and Streams H264 MPEG 4 AVC video Hosts multiple sessions Streams both video and audio synchronously Limitations With all of the requirements of Aureole there will be limitations held strongly by Aitne Incorporated In order to protect Aitne Incorporated from scope creep these limitations are defined as follows Not a two way videoconferencing system Does not emit audio on the local side e g no speakers No built in recording capability No explicit tethering support No support for Bluetooth No support for connecting to a phone over USB Conceptual Diagram The Aureole device will have the ability fo stream live audio and video to the end user through one way communication in high definition The end user then will have the ability to manipulate the video stream by scrolling through the strip Aitne Confidential Page 21 and zooming in on a desired frame using one of the three determined operating systems When the Aureole device is in use the camera will capture a 3602 panoramic video through the use of the catadioptric lens Within the device the video and audio wil
47. e Confidential Page 72 Technology Survey Assessment Ti OMAP3530 V 4 C64x DSP Ti OMAP3530 C64x DSP Aitne Confidential Page 73 Freescale i MX51 Ti OMAP3530 C64x DSP Marvell Kirkwood 6281 360 Camera Technology Fabrication Software Low Cost Complexity Complexity GGetslslieleite Lens L Bex Multiple Camera V 4 Stitching Fisheye Lens Video Codecs aielte el Bandwidth l CPU Intensive High Quality Encoding Intensive We Aitne Confidential Page 74 Camera Interface Simplicity of Simplicity of High Hardware Software Bandwidth OR Wire e etre Streaming Protocol Browser maaler io o 10 Standard Support By Libraries B telfi Available Aitne Confidential Page 75 Network Interfaces Low Cost Software High Hardware Complexity BOIRO ele Wireless 4 Ethernet Bluetooth 3 0 Aitne Confidential Page 76 Functional Block Diagram B Bo ALSA Audio Driver Sensor Characterization Aitne Confidential Page 77 TRIGGER SCLK Serial gt pid Pixel Array z lt gt Interface da d o 2752H x 2004V gt A E E PIXCLK EXTCLK RESET BAR 8 Dour 11 0 STANDBY BAR e LV OE N FV Analog Signal Chain Data Path STROBE s Aptina Imaging MI9PAOTIT2STC e 5 Megapixel e 15 frames per second e Capable of 720p Protocols Communciations Software e Real Time Protocol RTP e Real Time Streaming Pro
48. e Ke Start Finish 1CJan 9 11 Jan 23 11 Feb 6 11 Feb 20 11 Mar 6 11 Mar 20 1 Apr 3 FirisiwisiriMiriris iwis riMiririsiwisiriMiriris On Board Communication 3 hrs Mon 3 28 11 Mon 3 28 11 I Off Board Communication 3 hrs Tue 3 29 11 Tue 3 29 11 I Stress Test 1 hr Wed 3 30 11 Wed 3 30 11 Operating System 2hrs Wed 1 26 11 Wed 1 26 11 T Unit Test 2 hrs Wed 1 26 11 Wed 1 26 11 l Daemons 10hrs Fri 2 11 11 Tue 2 15 11 km FFLFLAZLzZLLABALX Watchdog Unit Test 2 hrs Mon 2 14 11 Mon 2 14 11 Discovery Unit Test 2 hrs Mon 2 14 11 Mon2 14 11 LI Web Unit Test 2 hrs Fri 2 11 11 Fri 2 11 11 I Streaming Unit Test 2 hrs Mon 2 14 11 Tue 2 15 11 L LED Button Unit Test 2 hrs Mon 2 14 11 Mon 2 14 11 Unit Test 2 hrs Tue 1 25 11 Tue 1 25 11 Unit Test 2 hrs Fri 2 11 11 Fri 2 11 11 Unit Test 2 hrs Tue 2 15 11 Tue 2 15 11 i Unit Test 2 hrs Tue 2 15 11 Tue 2 15 11 i System Prototype 22hrs Fri 2 11 11 Thu 3 31 11 Q Hardware Test Pass 4 hrs Thu 3 31 11 Thu 3 31 11 i Task ES Inactive Task Start only L Split saaaaaaaarasisisissss Inactive Milestone Finish only d Milestone k Inactive Summary e V Deadline A Project Aureole 5 print SC Kg kl en Date Tue 11 30 10 Summary Manual Task Critical Project Summary ym Duration only Critical Split TTT External Tasks c e Manual Summary Rollup s X Progress External Milestone Manual Summary Q Sack Page 6 Figure 16 Gantt Page 6 Aitne Confidential Page 107
49. e is remote it is difficult for him to jump into meetings Fortunately the networking company has put the Aureole device all of their conference rooms At the scheduled time for a meeting he connects to the Aureole but he sees that a meeting is running over He waits until he sees his colleagues enter the room and then dials the conference phone for that room over the company s VolP network so that they can hear his voice He mutes the plugin on his local browser so that there is no echo Security Camera Application Joseph is paranoid about his student workers misusing equipment in his flagship lab and would like to be able to monitor everything going on in the lab ar all times A limitation of traditional security cameras is that he needs multiple security cameras to capture all views of the lab room at all times Aitne Confidential Page 55 While on a trip to Belgium he opens up the lab camera using an HTC Evo device and notices something scribbled on the whiteboard He digitally zooms onto the whiteboard and sees writing indicating that some the student workers have snuck away to drink beer at a local bar with a guest visiting their Capstone class He rotates around the camera virtually fo see another student worker tired from his Capstone project sleeping nearby Device Reset Joseph has difficulty using a variety of software devices and somehow configured his Aureole to use the wrong network and can no longer reach the device
50. ed 1 12 11 Wed 1 12 11 LL 15 1 2 2 1 0 Protocols 8hrs Thu 1 13 11 Thu 1 13 11 VL 16 1 2 2 1 USB 4 hrs Thu 1 13 11 Thu 1 13 11 Le 17 1 2 22 GPIO 4 hrs Thu 1 13 11 Thu 1 13 11 LL 18 1 2 3 Power Circuit 12hrs Tue 1 11 11 Fri 1 14 11 19 1 2 3 1 Battery 8 hrs Tue 1 11 11 Tue 1 11 11 20 1 2 3 2 Wall Outlet 4 hrs Fri 1 14 11 Fri 1 14 11 21 1 2 4 Camera 8 hrs Fri 1 14 11 Mon 1 17 11 vu 22 1 2 4 1 CMOS Sensor 4 hrs Fri 1 14 11 Fri 1 14 11 Le 23 1 2 4 2 Catadioptric 4 hrs Mon 1 17 11 Mon 1 17 11 24 1 2 5 Ethernet 4 hrs Mon 1 17 11 Mon 1 17 11 L 25 1 2 6 USB Wi Fi Adapter 4 hrs Tue 1 18 11 Tue 1 18 11 L Task GE inactive Task Start only L Split araara Inactive Milestone Finish only J Milestone Inactive Summary V YV Deadline dpi ail Summary gg Manual Task A Critical Project Summary ee Duration only Critical Split TITTETPTPPTPITITIEET External Tasks Manual Summary Rollup ss Progress External Milestone Manual Summary Q Slack Page 1 I O Buttons amp Indicators Manufacturing Design Procurement Documentation Test Plan Hardware Power Wall Power Battery Power Voltage Regulator Peripherals Camera 802 11x Wireless Module Ethernet Module Audio Main Board Power Management Power On Off Switch Communication Camera CMOS Sensor USB 802 11x USB 802 3phy USB GPIO Switches 8 hrs 4 hrs 4 hrs 40 hrs 40 hrs 252 hrs 24 hrs 8 hrs 8 hrs 8 hrs 32 hrs 8 hrs 8 hrs 8 hrs 8 hrs
51. ee H Member Responsible Delivery Date Main PCB Demo Kyle Mays 2 12 11 Final PCB Demo Kyle Mays 5 3 11 Aitne Confidential Page 80 Gantt Chart 2011 Name Begin date Research 1 4 11 HW bring up 2 1 11 SW bring up 1 25 11 3 22 11 Test 3 11 4 25 11 Deploy 4 26 11 5 5 11 122n1 LE 3 18 11 Test Matrix End date 1 2 3 4 s le 7 8 lo 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 2 Network Connectivity test Device on Fire test Maximum Thread usage Multi Process Type test Table Drop test I O Spec Validation Network Spec Validation Data Stream test Resolution test RTSP Multi Session test User Confirmation message tests Network query list test User error message amp notification tests Video and Audio sync tests Hardware Periphrea Validation Auto Network recognition amp connection test RTSP to App amp UI connection test Connection Latency test Video frames per second fps test Device burn in test Power management tests Aitne Confidential Page 8 Linux OS x x Video pane virtual zoom amp scroll functionality test H264 Video Encoding Audio Encoding X 3G Wi Fi x x xx Ethernet Network Daemon RTSP Daemon xxx X X X x Conference Apps amp UI s x xX X X SS OX XX XX x Device Exception Handlers 5V Lithium Ion Battery 120 VAC Walloutlet Rugged Design x RTSP Server Universal Plug and Play XX Multitasking
52. eers until after they graduate from college For William Reading this wasn t quite the case William spent several years as a software engineer and project manager at Microsoft and it s counter parts When not working for Microsoft William interned at Hewlett Packard as a software engineer When William isn t working for top notch software companies he s developing custom software and consulting projects for professors and small private customers William was recently offered a position at Amazon com as a software engineer however he has vowed to Aitne Confidential Page 37 complete his duties at Aitne before joining another the Amazon team He knows many different programming languages and is an expert at Linux and telecommunication software design Kyle Mays Hardware Engineer When searching for a hardware engineer the first name that was referred to Aitne was Kyle Mays Kyle is known throughout the Texas A amp M University Engineering Technology department as hardware design force to be reckoned with He has experience with numerous hardware design software suites such as Multisim PSpice Ultiboard and LabVIEW Kyle has participated in numerous design and research projects for Texas A amp M that have taken him to engineering conferences and competitions across the country Kyle currently manages one of the more successful pubs in the Brazos county area which often shows in the quality and timeliness of his deliverables Kyle
53. end user manipulation of the stream Focusing on three primary applications Aitne Incorporated will develop the Aureole to be used with a web browser Android Froyo OS and Apple IOS Aitne Incorporated also defines the software scope of Aureole through functional and performance requirements Functional Requirements Device OS Drivers and Software Linux OS and Drivers Custom daemons Multitasking Conference Applications amp Web UI Dual video panes for user interfaces Video feed image navigation amp aspect adjustability for user interfaces Remote interface via user interfaces for Aureole platform RISP server configuring from user interfaces Conference session controls via user interface Multiple Ul availability Mobile device user interface Web user interface Video Audio Encoding Audio and H264 Encoding integration synchronization Aitne Confidential Page 18 Data Streaming RISP server for streaming of video and audio data Performance Requirements Operating System OS Debian Linux OS Configured for no GUI console UI only Bootstrapped to image stored in an onboard 2GB SD card Drivers Video driver for the C64 DSP core that encodes the video data Network driver for the Ethernet and Wi Fi protocols Audio driver for microphone input I O input driver for the onboard configuration peripherals Network Daemon Auto connects to best the available network or a preferred networks if available Re connec
54. eole aitne This presentation is a high level overview of the Project Aureole Capstone Design Document CDD It is not intended to cover every detail contained within the CDD S SRS Project Aureole aitne Note on Questions Even an overview of the Capstone Design Document is packed with information Please hold questions until the end Project Aureole Mt 299506 TS aitne Aitne Confidential Page 47 Problem Statement There is a need for a low cost highly mobile video conferencing platform that provides virtual presence for multiple remote users Ke NT 7 Project Aureole aitne What is Virtual Presence Virtual presence means that you never have to get someone to move the camera to see what you want Every remote user can independently zoom and turn the camera about without disturbing others watching S SRS Project Aureole aitne Aureole Form Concept Project Aureole aitne Aureole Panoramic Concept Project Aureole aitne Potential Applications Surveillance Video Conferencing Web based Remote Learning S 258 Project Aureole aitne Personas Tool for Modeling Customers Personas are used to have a subject in mind for use cases Fictional characters that bear no resemblance to any real persons living or dead Characterization of a custome
55. er to choose from The following interfaces have been created for users to access Aureole from e Internet Explorer 9 web interface e Android 2 2 Froyo conference application e iOS A conference application Application Features Aitne Confidential Page 62 The Aureole conference application and web UI has a wide range features that extends user control and functionality beyond just viewing video data Aureole can be configured and controlled from the user interfaces The following properties of Aureole can be manipulated remotely from any of the conference user interfaces e Network connection and selection e Initiation of video streaming e RISP server control and setup e Video conference access and security o Booting of users capability o Active user connections list o Limitations on amount of users e Aureole power control and monitoring Because the 360 degree video Is so large navigation of the video pane is available so that the user can virtually adjust what he or she Is looking at All the video view options available to the user are listed below e Dual video feed panes o Full 360 degree view o Magnified segment view e Vertical amp horizontal video image adjustment e Virtual video pane adjustment o Depth Zoom IN OUT o Vertical amp horizontal X and Y axis s Aitne Confidential Page 63 Error exceptions error handlers and conference notifications provide the user with messages of any issues
56. g options in both embedded Linux and Windows CE The OMAP3530 offers internal memory as well Complete with digital signal processor core camera image signal processor and embedded Linux support the OMAP3530 is ideal for Project Aureole Communication Modules The basis of Project Aureole is not only the ability to record high definition video but to transmit that high definition video and audio stream over a network to the remote user After processing the audio and video the device will then transmit the stream through either a wired Ethernet IEEE 802 3 network or a specified Wi Fi IEEE 802 11 network to the remote user s Following the capobilities of the Beagle board these modules will be connected via USB 2 0 Aitne Confidential Page 25 Catadioptric Reflector Lens Beagle Board Wall Power 3 Dev Kit T JB y ALSA Audio Driver Figure 2 Functional Block Diagram Camera amp Lens One of the most important peripherals of Project Aureole is the camera and lens The camera selected for the device must be capable of delivering a minimum 480p high definition video at a frame rate of 24 frames per second or greater Utilizing the Beagle board USB connection capabilities the camera will communicate with the camera image signal processor and the OMAP3530 via USB 2 0 In order to record the live video in a 360 panoramic shot a specialized catadioptric lens will be used in conjunction with the camera Aitne
57. ill be implemented on a Beagle Development Kit before moving on to a prototype Once full operation has been demonstrated on the Beagle Development board a circuit and PCB design will be created The final schematic of hardware will be able to fit within a small enclosure and will be tested as required Project Aureole receives 0 2 points for this factor Aitne Confidential Page 12 7 Contains a requirement for documentation other than the project report The documentation for project Aureole does not stop at the final project report A user manual will need to be created so users will be aware of how to correctly and effectively use the Aureole device and its client applications Project Aureole receives 0 2 points for this factor Benefits The benefits of the Aureole conferencing device extend far beyond monetary terms Not only will the Aureole device save yourself or your company thousands of dollars a year in travel expenses if will also save thousands of tons of carbon emissions from the earth s atmosphere A single flight from Bush International Airport in Houston TX to Heathrow International Airport in London England adds over 1 3 tons of carbon dioxide to the earth s carbon footprint Eliminating any unnecessary flights with a conferencing system such as Aureole will greatly improve the environment we all live in Aureole wil have a 100 price tag which is perfect for any budget The amount of conferencing equipment of a compan
58. inning Team Metaphysical Plant 2010 MIT Mystery Hunt President Texas A amp M IEEE COMSOC Student Chapter 2010 2011 Student Representative Texas A amp M Concessions Committee 2010 2011 Aitne Confidential Page 123 TROY C KENSINGER 15877 Post Oak Bend College Station Texas 77845 979 571 6362 troykensinger tamu edu Objective Seeking a position as a Hardware Technician or Hardware Test Engineer Education Texas A amp M University January 2008 Present B S in Electronics Engineering expected Spring 2011 3 0 Overall GPA 3 2 in major GPA Lindenwood University amp Blinn College August 2006 December 2007 3 2 Combined GPA 50 hours of course work between the two schools Experience Cisco R amp D Laboratory Texas A amp M University September 2010 Present Position Electronic Systems Developer Currently implementing a storage virtualization system utilizing an Adruino development board with two SD card shields The goal of the project is to create a directory that is limitless in storage capacity Systems amp Technology Group IBM January 2010 August 2010 Position Hardware Test Engineering co op Logged hundreds of R amp D System and I O testing hours on Automated Test Equipment I O protocols tested include SGMII DDR3 XAUI PCI e and EI3 and wrote executed numerous test plans Developed and deployed a datalog information system that parsed exported stored queried and formatted data in a series of
59. ions that detail why they are being accounted for in Project Aureole 1 Contains a clearly described and completely understood technical challenge Aitne Inc recognizes three different challenges that must be overcome in order for the device to be considered functionally complete The first challenge is that the Aureole device must be able to stream 3609 un wrapped panorama video streams The second challenge is that the client applications must be able to receive video streams from an RTP server The third and final challenge is that both the Aureole device and the Aureole conference client software are able to connect to each other and deliver the Virtual Presence experience to the user Project Aureole receives 0 1 points for this factor 2 Contains a requirement for system integration The Aureole conferencing device and client software must be able to demonstrate full integration with the hardware software and network systems to which they are deployed on They also must integrate into various mobile environments and situations in order to prove that the device and client software is in fact the ultimate mobile conferencing system Project Aureole receives 0 2 points for this factor 3 Contains a requirement for system testing Before the Aureole device and client software can be demonstrated to stake holders both the hardware and software systems must pass an array of functional validation and characterization tests This will ens
60. is also a great communicator and collaborator which is critical when debugging hardware issues and anomalies Troy Kensinger Software Engineer Even with an expert software engineer like William Aitne needed second software engineer who could compliment and critique the software development process as well as some of the hardware development process Troy Kensinger is a former United States Olympic Shooting team member turned engineer He has years of applied software and hardware development under the wing of companies and institutions like IBM Reynolds amp Reynolds and Texas A amp M University He too is experienced in various programming languages as well as circuit design and implementation Some of his former projects were for clients such as Microsoft Juniper Sony DARPA Nintendo Texas A amp M University and Cisco Aitne Confidential Page 38 Section VI Project Costs In order to bring the Aureole Conferencing system to life various monetary costs must be dumpedi in to the project Aitne has come up with some accurate costing data that reflects the estimated budget of Project Aureole All data was created with respect to the amount of direct and indirect costs that are required to complete the project Direct Costs The majority of Project Aureole s budget is allocated towards direct costs Direct costs are mainly associated with the Aureole device development phase itself These costs cover labor wages amp
61. ish these usages Project Aureole will meet the following requirements e Small scale mobile footprint e 360 panoramic streaming video e High Definition video 480i e Web Browser iOS amp Android OS compatible e Ethernet IEEE 802 3 amp Wireless IEEE 802 11 compliant e Wall Plug in or Battery Powered The device will have the ability to stream live audio and video to the end user through one way communication in high definition The end user then will have the ability to manipulate the video stream by scrolling through the strip and zooming in on a desired frame using one of the three determined operating systems When the device is in use the camera will capture a 3609 panoramic video through the use of the catadioptric lens Within the device the video and audio will be matched processed and transmitted through Ethernet IEEE 802 3 or Wireless IEEE 802 11 medium to the end user The remote user receives the stream through one of the three pre determined clients Web Browser Apple iOS or Android OS Once the stream has Aitne Confidential Page 84 been received the user will then have the ability to manipulate that video in a number of ways 802 3phy 802 3phy Android OS 802 3phy 802 11 Web Browser Apple iOS In order for Project Aureole to deliver high definition video the camera housed within the device must be capable of a mi
62. ive 4 hrs 81 3 47 Web Service 8 hrs 82 3 5 Android UI 70 hrs 83 3 5 1 Application Base 20 hrs 84 3 5 Application Layer 10 hrs 85 3 5 3 Login Screen 10 hrs 86 3 5 4 Options Screen 10 hrs 87 3 5 5 Network Screen 10 hrs 88 3 5 6 Video Screen 10 hrs 89 3 6 iOS UI 70 hrs 90 3 6 1 Application Base 20 hrs 91 3 62 Application Layer 10 hrs 92 13 6 3 Login Screen 10 hrs 93 13 6 4 Options Screen 10 hrs 94 13 6 5 Network Screen 10 hrs 95 3 6 6 Video Screen 10 hrs 96 3 7 WebUI Plugin 20 hrs 97 3 7 1 Video Screen 20 hrs 98 3 8 Software Packaging 12 hrs 99 3 8 1 Initial Software Package 8 hrs Task Split Milestone Project Aureole 5 print Sonia Date Tue 11 30 10 Project Summary External Tasks External Milestone Figure 14 Gantt Page 4 Aitne Confidential Page 105 J7 Inactive Task Inactive Milestone Inactive Summary Manual Task Duration only Manual Summary Rollup Manual Summary Page 4 mg Start only Finish only Deadline Critical Critical Split Progress Slack a D WAS Task Name Wok ar Fish Lane lan 25 Fb 612 Feb 20 4 Mar 6 2 ar 20 a3 100 3 8 2 Final Software Package 4 hrs Tue 2 15 11 Tue 2 15 11 101 4 Testing 70hrs Tue 1 25 11 Thu 3 31 11 102 4 1 Hardware 28hrs Fri 3 25 11 Wed 3 30 11 103 4 1 1 Full System 4 hrs Mon 3 28 11 Wed 3 30 11 104 4 1 1 1 Connectivity 1hr Mon 3 28 11 Tue 3 29 11 105 4 1 1 2 Power Management 1hr Tue 3 29 11
63. l Draft 4hrs Fri 4 1 11 Fri 4 1 11 168 5 2 2 Bill of Materials 2 hrs Wed 3 30 11 Wed 3 30 11 L Task ES Inactive Task Start only L Split tirtotrresttttieer Inactive Milestone Finish only J Milestone Inactive Summary Vv V Deadline A E Summary Wiem Manual Task ET Critical ns Project Summary V 7 Duration only Critical Split TY LT External Tasks SN Manual Summary Rollup ss Progress N External Milestone Manual Summary Wir Slack Page 7 Figure 17 Gantt Page 7 Aitne Confidential Page 108 Task Name Start ini a CH 11 Feb 6 11 Feb 20 11 Mar 6 11 SITIM Final Documentation Thu 3 31 11 Fri 4 1 11 Prototype 26hrs Mon 4 4 11 Tue 4 5 11 Final Demonstration 2 hrs Mon 4 4 11 Mon 4 4 11 Functional Prototype 24hrs Mon 4 4 11 Tue 4 5 11 Task D Inactive Task Start only Split tittttrestisttrant Inactive Milestone K Finish only Milestone Inactive Summary Deadline Project Aureole 5 print M Task Critical Date Tue 11 30 10 Sch Se Project Summary Duration only o Critical Split External Tasks Manual Summary Rollup Progress External Milestone Manual Summary Slack Figure 18 Gantt Page 8 Appendix K Risk Cards Aitne Confidential Page 109 Loss of team member Aitne Confidential Page 110 Incompletion of Project Eo ox Aitne Confidential Page 111 Loss of Advisor Sponsor Aitne Confidential Page 112 Proje
64. l be matched processed and transmitted through Ethernet IEEE 802 3 or Wireless IEEE 802 11 medium to the end user The remote user receives the stream through one of the three pre determined clients Web Browser Apple iOS or Android OS Once the stream has been received the user will then have the ability to manipulate that video in a number of ways 802 3phy 802 3phy 802 3phy 802 11 802 3phy Apple iOS Figure 1 Conceptual Diagram Aitne Confidential Page 22 In order for Project Aureole to deliver high definition video the camera housed within the device must be capable of a minimum 480i resolution at 15 frames per second Using H 264 encoding the high definition video will be synchronized with the local audio and transmitted over one of the two network mediums to the remote device he software at the remote end device will present the user with the live video and audio stream and allow the video to be manipulated locally Because Project Aureole will be designed to allow for multiple remote users to access the device the camera itself will not move To allow each individual user to adjust the video as they see fit all of the video manipulation will be done on the user end local to the device Testing amp Test Matrix Prior to delivering the final prototype of Aureole Aitne Incorporated will systematically test and debug the prototype to ensure
65. lliam Reading 2 5 2011 Milestones Final Hardware Block Diagrams Kyle Mays 2 7 2011 Final Software Architecture William Reading 2 7 2011 Test Matrix Test Cover age Android Streaming Demo Troy Kensinger 3 5 2011 Gantt Chart E eto etn LL LL LG Project Aureole aitne Project Aureole aitne Project Aureole aitne 46 47 48 Deliverables Milestones Milestones Software Hardware Deliverable Member Responsible Delivery Date iOS Streaming Demo William Reading 3 5 2011 Milestone Member Responsible Delivery Date Milestone Member Responsible Delivery Date Board Final Schematic Kyle Mays 3 11 2011 RTSP RTP Technical Demo William Reading 2 5 2011 Main PCB Demo Kyle Mays 2 12 2011 Board Final PCB Kyle Mays 3 11 2011 WebUI Demo Troy Kensinger 2 5 2011 Final PCB Demo Kyle Mays 3 5 2011 WebUI Streaming Demo William Reading 3 15 2011 Android Streaming Demo Troy Kensinger 3 5 2011 Critical Design Review William Reading 3 15 2011 iOS Streaming Demo William Reading 3 5 2011 Bill of Materials Kyle Mays 3 20 2011 WebUI Streaming Demo William Reading 3 15 2011 Test Results Troy Kensinger 4 9 2011 Main PCB Demo Kyle Mays 2 12 2011 Working Prototype William Reading 4 23 2011 Final PCB Demo Kyle Mays 3 5 2011 Final Documentation William Reading 4 30 2011 Mt Mt st LL LL LG Project Aureole aitne Project Aureole aitne Project Aureole aitne 49 50 51 Test Matrix RE i d i E Hi 2011 i P2225 af d ME 85282858822 eg Name Begin date Enddate 1 2 3 4 s Je z 8 9 10 11 1
66. ment features EE 18 ENEE SCOPO iere EE 18 FU IC OMG RECON SIS CN 18 Device OS Drivers and en TEE 18 Conference Applications amp Web Ul rss rss serres 18 VA O FAIS INC OGIO ee ue 18 OO SR 19 Performance Requirements enee ees 19 Operating System OS sccccssscccsssccensscceesscesescccsscccnesceeesceesscesescesseseccnsscsenesenenssenees 19 bu 19 KIK DOCIO EE 19 RTSP Server Daemon csccossccscnssconsscscsssconsscsccuscostsasccatscsrsasccatscsrsesccsrecsssesss ii 19 colle geese Ble RO T nee TUE as dd 19 BEDS nares ee ee ee ORO EP 19 Conference Applications amp Web Ul fff D 19 Application Features NNN KRANKER RAR RANNER Re 20 Video Audio Encoding amp Quality eee A n nn Z 20 AUto Recognition EHNEN uU 21 Power Management F ES ae ee on a 21 Aitne Confidential Page 3 EAS STS OWN NEEN 21 MIONO NS Tome 21 CONC e Ee eil Le I na E EN saionsute sees de et at een 21 TESNO A Ce L D EE 23 Section lIl Statement of Work ccccssccssccssccssccesccesccesccsccesccesccesccescceceeescceseeecs 24 Wee DS Le In TET 24 dere SSS ON M 25 Communication MOMUIES ccccceccesccescncecusccescesceesccessecceesccsssesceesecsstesceessecsescessseseaess 25 Sel re EN NR 26 SOS CIO OMI Os SO ND
67. more likely to happen The x axis of the matrix is the expected impact of the risk while the y axis is the expected probability Table 3 Risk Evaluation Table Probability High Low Aitne Confidential Page 33 Low Risk Prioritization Matrix Impact High The Risk Prioritization Matrix uses a similar concept to the Risk Evaluation Matrix Instead of placing each risk in categories of probability or impact each risk is compared to each other in order to determine which risks is more severe than the others The numbers in red designate the more severe risk Table 4 Risk Evaluation Matrix Priority Tota 7 3 8 2 9 10 O 1 12 T3 9 Risk 1 Loss of team member 2 Incompletion of project 3 Loss of advisor sponsor 4 Project goes over budget 5 Priority of other projects 6 Breaking Malfunction of hardware components Aitne Confidential Page 34 Comparative Numbers 12 33 123 AAA 1234 5555 12345 66666 T5 T4 T5 T4 T3 7 High latency between Aureole and mobile client 8 PCB component vendor takes too long fo ship parts 9 DSP Linux drivers are of low quality 10 Poor video quality from camera catadioptric reflector lens 11 Possible scope creep 12 Flaws in final PCB 13 Communication interfaces don t meet protocol during testing 123456 IS 1234567 89000980 12345678 277977777 1302229529 eS 005 REO 7 TIBI HE TOTON O TOTORO 12 3 4 56
68. n of custom libraries and daemons make Aureole a faster and more efficient machine The following list of software features guarantee a smooth and efficient system Network Daemon e Auto connects to best the available network or a preferred networks if available e Re connects to network if connection is lost RTSP server Daemon e Prompts a message to user to launch RTSP server when Aureole is connected fo a network e Restarts RTSP server if network connection is lost Watchdog Daemon e Monitors and supports processes being run by the Linux OS DSP Daemon e Monitors and supports the operation of the C64 DSP module e f the C64 ceases to work then the daemon will initiate a restart of the DSP Aitne Confidential Page 61 Device status amp control I O s Aureole will have the necessary hardware components to monitor the connection status and control the devices Power On Reset POR state The following peripherals and I O devices are available to user Mute button to disable audio input to on board mic Reset button fo restore Aureole to POR state Power Button to power on Aureole and begin POR e LED lights to indicate power state system states and Wi Fi status Conference Applications amp Web UI Users of the Aureole device have the freedom of choice as to what type of terminal they wish to utilize Aureole from Whether the viewing platform is mobile or stationary several options are available for the us
69. nd Input giver Once there are available labor hours and assignment owners a Network Logic Diagram or NLD can be created The NLD reveals a critical path of assignments that are highly dependent and take precedence in the implementation phase of the project Now that both the lengths and priorities of project Aureole have been determined Gantt charts can be created fo reveal accurate timelines for Aitne Incorporated to follow After completing the Statement of Work section the Risk Assessment section begins Managing the potential risks in project Aureole is key to finishing the product on time The Risk Assessment evaluates every personal and work related risk that could have direct impact to the project s forward progress Risk cards and management strategies are used to determine each risk The next section covers the Team Organization amp Qualifications of project Aureole This unique device cannot make itself It is also accurate to say that this unique device cannot be made by just any engineering team The resumes of all the engineers behind Project Aureole are available for review in this section Now that all parts labor hours tasks assignments risks timelines and all other project aspects have been determined a bill of costs can be created The Project Cost section details all direct costs indirect costs profits and other funding that impact the financial state of Project Aureole The final portion of the Project A
70. nimum 480i resolution at 15 frames per second Using H 264 encoding the high definition video will be synchronized with the local audio and transmitted over one of the two network mediums to The remote device The software at the remote end device will present the user with the live video and audio stream and allow the video to be manipulated locally Aitne Confidential Page 85 Because Project Aureole will be designed to allow for multiple remote Users to access the device the camera itself will not move To allow each individual user to adjust the video as they see fit all of the video manipulation will be done on the user end local to the device With high definition video generated from a low cost small scale device Project Aureole will give multiple end users a sense of virtual presence in a live video scenario Appendix F Functional Design Memo Memorandum TO Dr Joseph A Morgan D E P E FROM Kyle Mays THROUGH Dr Sejun Song Prof George Wright DATE November 10 2010 REF Functional Block Diagram Memo One of the focus points of Project Aureole is fo create a small mobile device while maintaining a low overall cost Because the single device will house the camera video processor battery and the communication modules as well as support devices maintaining a small footprint will be difficult but necessary Fortunately Texas Instruments has created the Aitne Confidential Page 86 Beagle developme
71. nt board with many useable components Aitne Inc will be using T l s Beagle development board for proof of concept as well as a reference design for Project Aureole s main printed circuit board The following is segmented into the major components of Project Aureole device Processor The Beagle development board centers on DaVinci s OMAP3530 processor a high performance applications processor based off the OMAP 3 architecture This processor is designed for high definition video image and graphics processing applications The processor offers multiple programming options in both embedded Linux and Windows CE The OMAP3530 offers internal memory as well Complete with digital signal processor core camera image signal processor and embedded Linux support the OMAP3530 is ideal for Project Aureole Communication Modules The basis of Project Aureole is not only the ability to record high definition video but to transmit that high definition video and audio stream over a network to the remote user After processing the audio and video the device will then transmit the stream through either a wired Ethernet IEEE 802 3 network or a specified Wi Fi IEEE 802 11 network to the remote user s Following the capabilities of the Beagle board these modules will be connected via USB 2 0 Aitne Confidential Page 87 External Buttons LEDs Catadioptric Reflector Lens bd USB LLLI eno Power Switch Wall Powe
72. o fabrication and testing Aitne Confidential Page 9 to documentation the Aureole project must meet the technical merit score of 1 0 points out of the maximum 1 8 points Table 1 Technical Merit Factor Maximum Estimated Contains a clearly described and completely 0 1 0 1 understood technical challenge Contains a requirement for system integration 0 2 0 2 Contains a requirement for system testing 0 2 0 2 Contains a requirement for analysis 0 2 0 2 Contains hardware design development and test 0 3 0 0 Contains software design development and test 0 3 0 3 Contains a hardware fabrication requirement 0 2 0 2 typically a prototype Contains a requirement for documentation other 0 2 0 2 than the project report Contains a requirement for intellectual property 0 1 0 0 protection Total 1 8 1 4 The technical merit for the project Aureole is estimated to be around 1 4 out of the maximum 1 8 which exceeds the minimum 1 0 needed for technical Aitne Confidential Page 10 completeness The only two factors that Aitne Inc pledges fo not pursue are the factor for hardware design development and test and intellectual property protection Since the product is being developed for Aitne Inc itself the company has decided not to partake in IP protection The hardware of Aureole will be based on a reference design and does not quality as hardware design However the other factors of technical merit have specific reasons and explanat
73. ole are Project Aureole aitne Project Aureole aitne 31 32 33 Technology Comparison Technology Comparison Technology Comparison Microcontroller Technology Microcontroller Technology 360 Camera Technology DSP Hardware Low cost Hardware Built in Audio Hardware Fabrication Software h 264 h 264 development Reference Capture Matrix Low Cost Complexity Complexity Encoding Encoding platform Design Support Transforms Freescale Freescale Catadioptic Y Y Y i MX51 Y i MX51 Y Y Lens Ti OMAP3530 Ti OMAP3530 A Multiple Camera Ji C64x DSP C64x DSP Stitching Marvell Marvell Y Y Kirkwood 6281 Kirkwood 6281 y SEENEN Project Aureole aln e Project Aureole aitne Project Aureole aine 34 Aitne Confidential Page 50 35 36 Technology Comparison Technology Comparison Technology Comparison Video Codecs Camera Interface Streaming Protocol Hardware EEN TER f Browser Embedded Bandwidth CPU High Simplicity of Simplicity of High Ge Intensive Intensive Quality Hardware Software Bandwidth ENEE EEN de Support Default Available h 264 v Y Y IO Mapped Y Y RTP Y d h 263 d USB 2 0 d HTTP HTML5 d MJPEG d d GPIO d d HTTP Flash d d Project Aureole aine Project Aureole ane Project Aureole mine 37
74. or events that Aureole experiences Below are the types of network status hardware status and software application status messages that the Aureole software throws when occurred Footprint Disconnection amp connection alert Network timeout error Invalid password or username Unable to connect to Aureole Aureole low battery alert Action confirmation messages Aureole was designed and founded around on the concept of mobility To achieve maximum portability Aureole incorporates the following features e Small enough to fit in a laptop case lt 10 X 10 X 3 e Very lightweight lt 11b e Must be able to view entire body of conference members from table top height e Rugged design o Drop shock proof up fo 4 feet Aitne Confidential Page 64 Video Audio Encoding amp Quality The video data from the Aureoles 5 Megapixel camera is formatted to meet protocol for streaming over the web and at a high definition resolution The C 4 DSP core process data to the following specifications e H264 video encoding for streaming capability o Minimum 15 frames per second FPS at end user o Minimum 480p resolution at end user Network Interface Just how the Swiss army knife was modeled around having as tools as possible on a single device Aureole was modeled around having as much network connection options on a single device To eliminate the possibility of not being able to connect to the web Aureole comes
75. osition Engineering Intern With Summer Sabbaticals Development implementation and sustained engineering of various internal and external software used at Hewlett Packard including Linux kernel drivers BIOS test utilities bootable livecd creation tools embedded Linux distributions used for testing web based sizing applications and report generation utilities Unified Communications Group Microsoft Corporation May 2008 August 2008 Position Software Development Engineer Intern May 2007 August 2007 Implemented proof of concept multiple human interface device HID telephony support in Commu nicator 2007 R2 which allowed seamless switching of multiple handsets Developed a plugin to allow contacts in the Communicator 2007 Global Address List GAL cache to be found using Windows Desktop Search Windows Serviceability Microsoft Corporation May 2005 August 2005 Position Program Manager Intern Drafted a functional specification for an internal dashboard metrics tool by collecting requirements from various business owners facilitating cross group collaboration to align those measurements with other teams acting as project lead for a team of contactors and presenting the resulting tool to key executives in the Windows organization Honors Charles amp Beulah Hendrix Scholarship 2010 First Place 2004 ACM ICPC South Central Regional Programming Contest Honorable Mention 2005 ACM ICPC World Finals Programming Contest Member of W
76. owser and perform all necessary interaction to use the device At a minimum Firefox on Windows needs to be supported for video streaming Any reasonably last 2 4 years recent HTML 4 1 browser should be capable of configuring the device settings Accessible and configurable from a iOS Device The device should be configurable from an iOS 4 0 or better device It should be possible to automatically discover the camera joined to the same network using the iOS device and use UPnP or Bonjour technology for discovery It should be possible to see the entire panoramic strip taken by the device and scroll through and digitally zoom into any interesting part of the strip The video should be delivered at up to 30fps and be synchronized from any audio in the room if the device is not muted Accessible and configurable from an Android Device The device should be configurable from an Android Froyo or better device It should be possible to automatically discover the camera joined to the same network using the iOS device and use UPnP or Bonjour technology for discovery It should be possible to see the entire panoramic strip taken by the device and scroll through and digitally zoom into any interesting part of the strip The video should be delivered at up to 30fps and be synchronized from any audio in the room if the device is not muted Accessible via wired and wireless networks The device should be configurable from both wired and wireless net
77. pivot tables for hardware design review using a MySQL database Perl scripts and a VB macro Designed and implemented a fully automated DDR3 testing system that probes signals runs tests re runs failed tests and saves test data in HTML and CSV formats for hardware design review Provided support feedback for hardware design engineers both locally and remotely Engineering Technology Dept Texas A amp M University May 2009 December 2009 Position Student Researcher Continued research and experimentation on an FPGA x86 hybrid computing system that processes data more efficiently and at higher rates Chemistry Dept Texas A amp M University January 2009 December 2009 Position Electronics Technician Repaired and tested chemistry lab equpiment such as stir plates ion gun controllers and chemical ovens Aided in electronic design projects for chemistry graduate students such as signal amplification circuits and signal pulsing devices for research equipment Electronics Repair Center Reynolds amp Reynolds February 2007 December 2008 Position Technology Specialist Diagnosed various digital and analog circuit component issues on dot matrix printers Trained new employees kept track of repaired part inventories and upheld cleanliness and safety standards in the laboratory Skills Programming experience in C C Perl VHDL PowerPC Assembly Java VB Efficient with R amp D tools such as DC power supplies function gene
78. r z E V H ALSA Audio Driver Camera amp Lens One of the most important peripherals of Project Aureole is the camera and lens The camera selected for the device must be capable of delivering a minimum 480p high definition video at a frame rate of 24 frames per second or greater Utilizing the Beagle board USB connection capabilities the camera will communicate with the camera image signal processor and the OMAP3530 via USB 2 0 In order to record the live video in a 360 panoramic shot a specialized catadioptric lens will be used in conjunction with the camera Special Purpose Buttons LEDs Aitne Confidential Page 88 Two buttons will be added to the design of Project Aureole with various different purposes A Power ONT switch will also be added to the design Of the special purpose buttons a Wi Fi Enable button and a Local Mute button will both be incorporated in the design These two buttons will serve device end purposes for the user The Wi Fi Enable button will alert the processor and communication modules to present the device available through wireless access IEEE 802 11 rather than wired Ethernet IEEE 802 3 The Local Mute button will signal to the processor fo silence the microphones on the device and thus eliminate all sound sent to the remote users Both the Wi Fi Enable and Local Mute buttons will be connected to the OMAP 3530 processor through the many available general purpose input output pins
79. r Student Worker IV Designed implemented and shipped several iPhone applications for use by first responders includ ing field operations manuals and a swiftwater rescue calculator Created the mobile applications development group and instituted a specification code management and code review process Texas Engineering Experiment Station TEES January 2010 present Position Hardware Tester Student Technician Participated in the partnership between Texas A amp M and Cisco Systems as a tester for new embed ded hardware including cameras network attached storage and internet telephony devices Wrote automated testing scripts in Perl for an embedded Linux platform Configured and administered the lab network for these activities at Texas A amp M Profiled applications written in C for scalability Aditi Technologies December 2008 December 2009 Position Software Development Engineer II On assignment at Microsoft in Redmond Washington working remotely out of Texas while pursuing my undergraduate degree Implemented approximately thirty work items related to collaboration for Communicator 2010 In the process of being rebranded as Lync in several feature areas Designed and implemented a browser plugin for Internet Explorer to recognize and dial phone numbers in Communicator 2010 Assisted with recruiting activities around the Microsoft Intern Game Industry Standard Servers Hewlett Packard Co January 2005 December 2008 P
80. r type St d Project Aureole aitne Personas for Use Cases Jay Morgan Sales Representative Travels Frequently Defers to technical engineers remotely NT fe Project Aureole aitne Use Cases Bringing an Engineer s Presence Jay is making a site visit without his sales engineer and needs to make sure that the engineer can listen and understand the customer requirements Jay brings an Aureole and configures it to join the customer network using his smartphone over WiFi Jay e mails the remote engineer the IP address of the device and the engineer is able to view the people in the meeting while on conference call e St LIN S Project Aureole aitne Aitne Confidential Page 48 17 Personas for Use Cases Sejun Wright Software Engineer Works remotely for a far away company Makes site visits monthly Project Aureole aitne Use Cases Remotely Initiated Call Sejun connects to the stream for a remote meeting at the Aureole device in the remote conference room and sees that the meeting has not yet begun Sejun calls the phone in the room when he sees the organizer enter the room The organizer answers the phone and presses the soft mute button on Aureole to prevent audio Design Outline Design Conceptual Block Diagram Functional Requirements Performance Requirements Software Architecture
81. rators oscilloscopes soldering irons DMMs LabVIEW Multisim Teradyne FLEX UItraFLEX ATEs various shop machinery Other relative experience 4 3 years of R amp D lab experience excellent at schematic reading extensive knowledge of electronic circuitry and real world electronic applications proficent at debugging signal integrity issues familiar with Linux platforms in an R amp D enviornment excellent documentation skills expert at soldering small package devices References Edward Doan 512 788 2484 Google Inc Deployment Manager Google Apps edoan google com Mathew Mehalic 512 286 7540 IBM Senior Engineering Manager mehalicQus ibm com Aitne Confidential Page 124 Brandon Kyle Mays 310 Fairway Drive Bryan TX 77801 281 744 8618 kyle mays10 gmail com Education Texas A amp M University College Station TX Studying Electronics Engineering Technology amp Telecommunications Engineering Technology Degree GPR 2 74 Overall GPR 2 55 Expected Graduation May 2011 Embry Riddle Aeronautical University Prescott AZ Studied Electrical Engineering Military Science Attended August 2004 December 2005 Technical Employment History Student Technician Texas A amp M University College Station TX May 2008 June 2009 Worked under Dr Ana Goulart and Dr Walt Magnussen at iTEC Assisted in research on the NSF s Next Generation 9 1 1 Project Conducted background research through IETF Work Groups
82. reole wrap up will complete by May 12th 2011 Costing for labor parts and other expenses will be approximately 48 706 30 as the final cost for the project All team members have equal ownership of the intellectual property pertaining to Aureole Aitne Inc commits fo have the Aureole prototype available for public demonstration on time and within budget Together their knowledge and dedication is more than sufficient To successfully complete this endeavor Regards William Reading Project Manager amp Software Engineer Aitne Inc Aitne Confidential Page 2 Table of Contents SECON ELT Ia te e LE Ton 110 11 PRE iiie e iii e i e Eas 6 OSS e EE 8 elei COIN e RE E E T E E E E E E EEEE E EEE 8 Tec cnnic e Reg Lo UE re TE 9 SIBI RR Em 13 Proposed SITUCIUTG eiii boues ra a suesnsucessewseusaescoeacsuwwsaveaseiossasiaeuecesesencasecianeeceuescnesee 14 SecHon II POI eCT SCODB ane a 16 TRA PRU 16 lege VIC d 0 MNT T TE TE T TUE 16 Wl elle RE DT an 0 CN 16 Device Status cce uei 16 dee elle A e wnatautesees 16 Knell we Le 16 OO BONA ses T 17 397 X O0O 17 Performance e OTT CN 17 Device status amp control He KEE 17 OO OR a a a a a hic 17 Weiser Are 17 OW EE 17 Power manage
83. rogress culminates into a critical design review for the sponsor advisor and stakeholders This review will cover all details of progress Aitne Confidential Page 30 since the start of development Questions can be answered by both a presentation of work completed and by the Aureole team itself A demonstration of the WebUI streaming client will be done during this review as well to give future users a taste of what is to come Bill of Materials The Bill of Materials will be the comprehensive breakdown of the total cost of materials used in the design testing debugging and implementation of Project Aureole Test Results All results from testing will be documented and published by this date for the parties interested in Aureole s success Testing data will be from multiple functionality and characterization tests of the final hardware and software Working Prototype This date signifies that the device has been successfully implemented and is ready to be demonstrated to the project sponsor advisor and interested parties The final prototype will be working to specification 10076 and that all client applications are able to when communicating with the RTSP server within Aureole Final Documentation All progress findings demonstrations results schematics and comments are documented so the entire project can be reviewed This also includes a user manual so that new users can get up fo speed Aitne Confidential Page 3
84. stortion DSP Glue 10 hrs WebUI 32 hrs Task Split Milestone Summary Project Summary External Tasks External Milestone Jee Ke a 9 Fri 2 4 11 a Inactive Task Start only L Inactive Milestone Finish only J Inactive Summary V Deadline A Manual Task EJ Critical a Duration only Critical Split Kmera Manual Summary Rollup Progress Manual Summary Q Slack Page 3 Figure 13 Gantt Page 3 Aitne Confidential Page 104 Start Fri 1 28 11 Fri 1 28 11 Tue 2 1 11 Mon 1 31 11 Thu 2 3 11 Wed 2 2 11 Mon 1 31 11 Wed 1 19 11 Wed 1 19 11 Wed 2 2 11 Fri 2 4 11 Mon 2 7 11 Tue 2 8 11 Thu 2 10 11 Thu 1 13 11 Thu 1 13 11 Wed 2 2 11 Wed 2 9 11 Thu 2 10 11 Mon 1 17 11 Tue 1 18 11 Mon 2 7 11 Mon 2 7 11 Mon 2 14 11 Mon 2 14 11 Finish Jan 9 11 Jan 23 11 Feb 6 11 Feb 20 11 Mar 6 11 Mar 20 1 Apr 3 FirTisiwisiTMiriTisiwis TiMIiriTIsiwisiT MIriITISI I Fri 1 28 11 Mon 1 31 11 Wed 2 2 11 Mon 1 31 11 Fri 2 4 11 Thu 2 3 11 Tue 2 1 11 Fri 2 11 11 Mon 1 24 11 Thu 2 3 11 Mon 2 7 11 Tue 2 8 11 Thu 2 10 11 Fri 2 11 11 Mon 2 14 11 Mon 1 17 11 Thu 2 3 11 Thu 2 10 11 Mon 2 14 11 Tue 1 18 11 Mon 2 7 11 Wed 2 9 11 Wed 2 9 11 Tue 2 15 11 Tue 2 15 11 a ID WBS Task Name Work 75 3 4 1 Login 4 hrs 76 3 42 Navigation 4 hrs 77 3 4 3 Information 4 hrs 78 3 4 4 Network Config 4 hrs 79 3 4 5 Plugin Host 4 hrs 80 3 4 6 Administrat
85. that the product will meet each and every functional and performance requirement as defined by Aitne Incorporated Testing both hardware and software Aitne Incorporated will be testing the Aureole device throughout its creation Whether by simple connectivity testing or full scale functionality tests the Aureole device will be debugged so that the final prototype delivered will meet each and every requirement specified by Aitne Incorporated Based off the Test Matrix Aitne Incorporated will create a Test Plan to further describe each test and the limits or constraints involved with each Once a test has been completed the report will be generated detailing the outcome of the specific Test aswell as any limits discovered through testing Aitne Confidential Page 23 Table 2 Test Matrix Device Exception Handlers 5V Lithium Ion Battery Conference Apps amp UI s 120 VAC Walloutlet Linux OS Audio Encoding H264 Video Encoding 3G X Wi Fi Ethernet Network Daemon RTSP Daemon Rugged Design RTSP Server Universal Plug and Play Multitasking 1 0 perphrials X Tethering Watchdog Daemon Network Connectivity test Device on Fire test Maximum Thread usage Multi Process Type test X X x Table Drop test x x x x x x I O Spec Validation x Network Spec Validation X X X X Data Stream test X Resolution test RTSP Multi Session test User Confirmation message tests x Network q
86. the local side e g no speakers e No built in recording capability No explicit tethering support e No support for Bluetooth e No support for connecting to a phone over USB Aitne Confidential Page 67 Conceptual Block Diagram 802 3phy 802 11 gt 802 3phy Android OS 802 3phy 802 11 Web Browser 802 3phy 802 11 Apple iOS Aitne Confidential Page 68 Software Architecture Web Server Streaming DSP UVC Configuration Watchdog Server Daemon Daemon Launch Daemon GNU Userland Linux Kernel Operating System USB Subsystem Advanced GPIO Texas UVC S Linux Sound Subsystem Instruments ubsystem Architecture Ti DSP USB Network Subsystem Subsystem Bridge Aitne Confidential Page 69 UI Layer Application Layer Cocoa Touch AV Foundation Core Media OpenGL ES BSD Subsystem iOS Operating System H 264 Audio Driver Network Driver Touchscreen BELONE Driver Decoding Driver Aitne Confidential Page 70 UI Layer Application Layer Application Framework Layer Surface Manager Dalvik Virtual Android Core Machine Libraries Linux Operating System Display driver Audio Driver Network Driver Aitne Confidential Page 71 UI Layer Application Layer IE9 COM ActivexX DirectDraw 2D Windows Sockets Interface Windows Operating System Display driver Audio Driver Network Driver Technological Overview Aitn
87. tocol RTSP e Hypertext Transfer Protocol HTTP e H 264 Video Encoding Hardware e General Purpose I O GPIO Aitne Confidential Page 78 Universal Serial Bus v2 0 USB Planning Timeline TBD Deliverables Schedule Deliverable Member Responsible Delivery Date Initial Hardware Block Kyle Mays 1 22 11 Diagrams Initial Software Architecture Wiliam Reading 1 22 11 Initial PCB Layouts Kyle Mays 1 29 11 System Hierarchy Flow Wiliam Reading 1 29 11 Charts Test Plan Troy Kensinger AS WebUI Demo Troy Kensinger 2 5 11 RTSP RIP Technical Demo Wiliam Reading Gel Final Hardware Block Kyle Mays 2 7 DICCON Final Software Architecture Wiliam Reading 2 7 11 Android Streaming Demo Troy Kensinger 3 5 11 LON iro eal RDS ante Wiliam Reading 5 552 Board Final Schematic Kyle Mays 3 11 11 Board Final PCB Kyle Mays 3 11 11 WebUI Streaming Demo Wiliam Reading SM Critical Design Review Wiliam Reading Sas MT Bill of Materials Kyle Mays 3 20 11 Aitne Confidential Page 79 Test Results Troy Kensinger 4 9 11 Working Prototype Wiliam Reading 4 23 11 Final Documentation Wiliam Reading 4 30 11 Milestones Schedule Software Member Responsible Delivery Date RTSP RIP Technical Demo Wiliam Reading 2 5 11 WebUI Demo Troy Kensinger 2 5 11 Android Streaming Demo Troy Kensinger LON Siero aallalem DI Tee o Wiliam Reading WebUl Streaming Demo Wiliam Reading Sy USUAL Milestones Schedule Hardware
88. ts to network if connection is lost RTSP Server Daemon Prompts a message to user to launch RTSP server when Aureole is connected to a network Restarts RTSP server if network connection is lost Watchdog Daemon Monitors and supports processes being run by the Linux OS DSP Daemon Monitors and supports the operation of the C64 DSP module If the C64 ceases fo work Then the daemon will initiate a restart of the DSP Conference Applications amp Web UI Internet Explorer 9 web interface Android 2 2 Froyo conference application Aitne Confidential Page 19 IOS 4 conference application Application Features Network connection and selection Initiation of video streaming RISP server control and setup Video conference access and security Booting of users capability Active user connections list Limitations on amount of users Aureole power control and monitoring Dual video feed panes Full 360 degree view Magnified segment view Vertical amp horizontal video image adjustment Virtual video pane adjustment Depth Zoom IN OUT Vertical amp horizontal X and Y axis s Disconnection amp connection alert Network timeout error Invalid password or username Unable to connect to Aureole Aureole low battery alert Action confirmation messages Video Audio Encoding amp Quality H264 video encoding for streaming capability Minimum 15 frames per second FPS at end user Minimum 480p resolution at end user Aitn
89. uery list test User error message amp notification tests X Video and Audio sync tests X X Hardware Periphreal Validation Video pane virtual zoom amp scroll functionality test Auto Network recognition amp connection test X RTSP to App amp UI connection test Connection Latency test X X X Video frames per second fps test Device burn in test X Power management tests X x x x x xXx XxXxX x xX X X SS SS XX X x Section Ill Statement of Work Project Design The main focus of Project Aureole is to create a small mobile device while maintaining a low overall cost The single device will house the camera video processor battery and the communication modules as well as support devices therefore maintaining a small footprint will be difficult but necessary Fortunately Texas Instruments has created the Beagle development board with many useable components Aitne Inc will be using Ti s Beagle development board for developing the software component of Aureole as well as a reference design for its main printed circuit board The following is segmented into the major components of Project Aureole device Aitne Confidential Page 24 Processor The Beagle development board centers on DaVinci s OMAP3530 processor a high performance applications processor based off the OMAP 3 architecture This processor is designed for high definition video image and graphics processing applications The processor offers multiple programmin
90. ure that every Aitne Confidential Page 11 portion of the device meets protocol reliable operation and a high quality experience for the user Project Aureole receives 0 2 points for this factor 4 Contains a requirement for analysis Aureole must meet video quality specifications when streaming H 264 data streams to a client application The video streams will need to be analyzed in order to determine that the video quality is worthy of the title Virtual Presence This verification will be done using third party software to examine video properties such as frames per second and resolution Project Aureole receives 0 2 points for this factor 5 Contains software design development and test he software of Aureole and its client applications are considered to be the major components of the entire project Most of the software will be custom designed for Aureole s various hardware modules and client peripherals The reliable and smooth operating software will be implemented on both the Beagle Development Kit and iOS Android Emulators before being deployed on the final prototype and the cell phone devices Project Aureole receives 0 3 points for this factor 6 Contains a hardware fabrication requirement typically a prototype With the help of a reference design Aitne Incorporated s expert hardware engineer will be designing a fully functional and enclosed device that meets operational and mobility requirements The Aureole system w
91. ureole Formal Technical Proposal is the Appendices section This section contains all of the documents developed during the project management phases of the Aureole conferencing device These documents include various memorandums capstone design document various deliverables and project management exercises Aitne Confidential Page 15 Section Il Project Scope Overview The overall scope of Project Aureole will be to deliver a fully functional prototype device capable of streaming live high definition video to the specified end user device In order for Aitne Incorporated to meet this demand the project will be divided into two major components each with several sub tasks These two components are the physical Aureole device itselt complete with camera lens communication modules and processor and the end user device specific software required to receive and manipulate the video stream Combining these two focuses Aitne Incorporated will deliver the Aureole prototype as a fully functional device coupled with the accompanying end User software Hardware Scope Focusing primarily on the physical hardware of the Aureole device the end prototype will be guided by the functional and performance requirements defined by Aitne Incorporated and their sponsor Functional Requirements Device Status amp Control I O s Manual Device I O peripherals Indicator Lights Buttons Video Audio Quality 360 degree panoramic video conferen
92. works using the web interface or smartphone clients It should be capable of configuration to use DHCP or Static IP settings It will support at least WPA2 AES for joining a Aitne Confidential Page 58 wireless network For legacy networks and connecting remote sites together especially behind NAT if will support the ability to join Cisco IPSec based VPNs Provides a 360 strip of the room with Audio in Realtime The device will show a 360 strip of the room through the use of a catadioptic lens Because the output of the lens is distorted the device will un distort the output of the lens and expose it as a panoramic strip of ifs view at a minimum resolution of 1280x196 The framerate of the video should be a minimum of 15fps Mutable from a hardware button The device must be mutable from a hardware button externally such as via GPIO pins Resettable from a hardware button The device must be resettable from a hardware only button that triggers the functionality after the button is held down for a minimum of 15 seconds The hardware reset will not take place until the button is released Local Wireless Configuration only Network available from a button The device must be able to expose a secondary local network so that when a button is pressed a network appears where the device can be configured from a PC or smartphone joined to that local network The network must disappear when the button is pressed again Able to run off
93. y office or personal household will be dramatically reduced in size when using the Aureole conferencing device The Aureole device could easily be set up on top of a kitchen table or on any size office desk Since Aureole can be powered by battery the device can be deployed in tight or high places such as an attic a rooftop a warehouse or a university sponsored capstone suite Because of the size of the Aureole devices theycan be carried in a small bag or protective case to just about anywhere Aureole introduces vast improvements to the conferencing technology and experience that have nnot yet been seen The highly personal and face to face communication that is experienced when using Aureole will be convincing enough for veteran users of other conferencing systems to switch to our newly developed product Aitne Confidential Page 13 Proposed Structure The remaining portions of this proposal break down the product management development and implementation strategies for the Aureole project In more specific detail the remaining sections covered are Project Scope Statement of Work Risk Assessment Team Organization amp Qualifications Project Costs and Appendices Aureole s Project Scope is one of the most critical aspects in the project planning phases The entire Aureole conferencing system consists of only two main components the Aureole Conferencing Device which is the camera streaming server and the Aureole Client Applic

Download Pdf Manuals

image

Related Search

Related Contents

簡単操作マニュアル  Mode d`emploi Forum Phone 310  User Manual - Aldous Systems  Gyration Mobile RF - Steve`s Home Theater  DC-24 and DC-25    TRAC Fisherman 25 User Manual  Denver MPS-205C  Emerson FP-40R Brochures and Data Sheets  Manuale  

Copyright © All rights reserved.
Failed to retrieve file