Tethered digital butler consumer electronic device and method
Contents
1. 3 3 V supply The ZV4301 is manufactured in an 8 6x8 6x1 65 mm LTCC BGA package with 100 balls 0144 The ZV4301 is supplied with a link library for a complete lower layer protocol stack and source code to the blueOS operating system target manager and link manager API Upper layers are supported through the Zeevo partner program with firmware Bluetooth protocol stack software and Bluetooth profiles available from Zeevo s extensive part ner list 0145 The Zeevo4301 typical application supports AV equipment smart phones personal digital assistants printers cellular peripherals access points and industry controls Fea tures include 0146 Bluetooth 1 2 compliant 0147 High bandwidth ARM7TDM1 processor sub system 0148 12 24 and 48 MHz CPU clocks selectable on chip PLL from single 12 MHz input 0149 Highly integrated low cost solution Radio link control and CPU are integrated 0150 High throughput 0151 Tested qualified software stack available 0152 Support for very low power modes sleep and deep sleep 0153 Audio capability on an SCO channel 0154 On chip crystal tuning and power calibration 0155 Complete co location and co existence solutions with 802 11 supported through AWMA AFH and SFH 0156 The CPU and memory support include 0157 ARMT7TDMI processor core 0158 12 24 and 48 MHz operation 0159 32 16 bit RISC architecture 32 bit ARM instruc tion 0160 16 bit Thumb2. Games Productivity apps such as a personal information manager PIM contacts calendar editor SOME PARTICULAR EMBODIMENTS 0269 The present invention may be practiced as a method or device adapted to practice the method The same method can be viewed from the perspective of a console adapted for use with a remote a remote adapted to control a console or a combination of console and remote 0270 While the present invention is disclosed by refer ence to the preferred embodiments and examples detailed above it is understood that these examples are intended in an US 2009 0009356 Al illustrative rather than in a limiting sense It is contemplated that modifications and combinations will readily occur to those skilled in the art which modifications and combinations will be within the spirit of the invention and the scope of the following claims We claim as follows 1 hand held remote control device with slaved audio and video reproduction the device including a radio a plurality of slaved inputs and outputs built into the hand held remote control including at least a slaved micro phone a slaved display and a slaved audio output a keyboard and navigation control built into the hand held remote control hardware resources coupled between the radio and the slaved inputs the slaved outputs the keyboard and the navigation control a stack running on the hardware resources and exchanging packets with a master device
3. I O Jan 8 2009 0208 Configurable for UART wake up hand shaking 0209 Base band and CPU activity indication 0210 USB UART mode select 0211 Each GPIO can be used as interrupt 0212 The pulse code modulator support includes 0213 PCM interface for audio applications PCM OUT PCM_IN PCM_CLK and 0214 PCM SYNC 0215 Linear u Law and A Law codes supported 0216 Interface to OKI MSM 7732 01 and OKI 7716 codec 0217 Direct Memory Access DMA for low overhead PCM control 0218 A 12 MHZ crystal serves as the primary clock crys tal 0219 FIG 5 shows the ZV4301 to other CPU and periph eral interfaces The ZV4301 is interfaced with the main pro cessor LPC2132 100 through the UART port The 8 Mb Flash memory AT49BV802A 501 is interfaced with ZV4301 through the external bus interface The single rail linear codec 141 is interfaced with the ZV4301 through the PCM interface 0220 Debugging of the remote is supported by JTAG header and BDM header is used in the board for the debug ging purposes This section gives the details of the JTAG header and BDM header 0221 The processor complies with the IEEE 1149 1A JTAG testing standard The JTAG test pins are multiplexed with background debug pins 0222 Thesystem is fed with 5 volts input power The input power is passed through a diode to provide the protection against reverse polarity The power to the digital butler remote comes from an extern
4. The keyboard module of the remote is implemented using an 8051 The key press data is sent to the main micro controller through an I2C interface for further processing The keyboard is a matrix keyboard including 13 scan lines and eight return lines A key press causes the 8051 to generate make and break codes along with key press values This data is given to the main micro controller which operates in an interrupt mode Here the 8051 acts as a master and the LPC2132 acts as a slave 0237 Fingerprint sensor software uses SPI code on the main controller The fingerprint data will be sent in a particu lar packet format over the wireless link to be processed on the host side Authentec provides a useable appropriate library of routines for fingerprint authentication 0238 Coupled to the fingerprint sensor software is a per sonalization module If a user does not identify himself by swiping the fingerprint sensor then a generic profile is applied to personalization of music movies photos videos files and telephone access If the user swipes the fingerprint sensor then personalization can be applied analogous to switching users in current Windows XP implementations This degree of context shifting based on a single action at a remote control is new in this disclosure The personalization may include favorite channels movies shows in a streaming video environment favorite music photos or video in an on demand environment approved acc
5. VoIP and or video phone operation such as a microphone can be used for other purposes such as dictation note taking voice messaging listening to music or remote viewing video To support the high demands of streaming video a broader communications channel such as Bluetooth version 2 or later or 802 11n and a more powerful processor are included The Jan 8 2009 remote may function in tandem with a console PC or set top cable or satellite box It also could be configured to control other consumer electronics device such as a TV IP TV home theater system component stereo digital video recorder DVD player or recorder VCR etc It can receive streaming media directly from a server The palm held remote may be combined with a glue logic application that enables a console PC set top box or other consumer electronics device to utilize the special purpose controls ofthe remote The remote may be adapted to invoke a glue logic application supplied for or native to a communications and or multi media console such as one running under Windows OS X or Linux 0022 Ina sixth embodiment a remote control for a gate way device t is coupled to multimedia and communication resources The gateway device including logic and resources to process wireless input and provide access to the multime dia and communication resources The remote control includes a palm held remote adapted to invoke glue logic running on the gateway device by wireles
6. decoder option ally an MPEG 4 decoder for video a memory socket such as al DDR266 SODIMM socket a PCI slot two UltraDMA 66 100 133 connectors SATA connectors can be used a 10 100 Base T Ethernet physical connection PS2 mouse and keyboard ports a parallel port an RJ 45 LAN port a serial port two USB 2 0 ports and a VGA port 0246 A socket modem module 634 is one component usedto connect the motherboard to a POTS telephone system Alternatively modules can interface the motherboard to a cellular or similar telephone system or to a voice over IP VoIP system One suitable module is a WMV34 0 TSM 100 from Analog Devices This serial socket modem provides complete worldwide support An Analog Devices serial socket modem features a solid state DAA that supports inter national operation with compliance to international tele phone standards The modem module can be plugged on the carrier board by means of board to board connectors and will be interfaced to the additional serial port available on the motherboard header The socket modem module is powered by 3 3V DC supply and the interfacing signals are in the 3 3 V US 2009 0009356 Al LVTTL level The socket modem module has the connections for a telephone line This connection will be terminated to a RJ11 jack 635 on the carrier board for this purpose The serial port signals in the motherboard are terminated to header COM2 which is in RS232 level A RS232 transceiver inter
7. instruction set for increased code density 0161 32 bit ALU and high performance multiplier 0162 Extensive debug facilities JTAG 0163 8K bytes of boot ROM 0164 64K bytes of SRAM 0165 The radio features include 0166 Integrated RF interface connects directly to antenna 0167 Integrated power amplifier supports up to 4dBm output power for class 2 amp 3 operation US 2009 0009356 Al 0168 High sensitive design 86 dBm typically 0169 Class 1 operation is supported with an external power amplifier LNA interface 0170 IF enhanced direct conversion receiver archi tecture 0171 Integrated TX Rx switch balun and matching network in an LTCC package 0172 Low power consumption receiver design 0173 Multiplexed RX TX antenna interface 0174 Fully integrated PLL synthesizer and loop fil ter requires external 12 MHZ crystal 0175 The baseband and software features include 0176 Required and optional Bluetooth 1 2 features faster connection extended SCO link adaptive fre quency hopping AFH QOS flow control 0177 Direct memory access DMA for low overhead UART control 0178 Standard Bluetooth HCI interface over UART and USB 0179 Support for a range of Bluetooth data rates 57 6 723 Kb sec 0180 Support for multiple ACL and HC SCO packet types 0181 Park sniff and hold modes 0182 Point to point point to multipoint and scatter net 0183 Up to 7
8. playback control and digitally stored music access and playback In this embodiment the palm held remote integrates at least a fingerprint reader a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console a compact keypad including numeric keys usable for telephone dialing the compact key pad further including alphabetic keys usable for web brows ing The bread box or smaller sized console integrates at least a DVD CD player a network port and logic and resources adapted to authenticate users of the palm held remote and personalize their telephone network connection and their Internet browsing based on fingerprints received from the palm held remote connect telephone features of the palm held remote to the telephone network respond to Internet browsing commands from the palm held remote and display web pages on a monitor or television control channels accessed by a video receiver drive speakers and provide volume control provide playback control for the DVD CD player and access and playback digitally stored music 0018 Ina second embodiment of the tethered digital but ler the palm held remote has fewer components the console supports fewer features thus the combination will be less expensive and more attractive in many markets Remote com ponents then include a speaker micr
9. the GPIO registers Pins may be dynamically configured as inputs or outputs Separate registers allow setting or clearing any number of outputs simultaneously The value of the out put register may be read back as well as the current state of the port pins The GPIO lines have the following features 0058 Direction control of individual bits 0059 Separate control of output set and clear 0060 All I O default to inputs after reset 0061 TheLPC 2132 memory maps shown in FIG 3 incor porate several distinct regions In addition the CPU interrupt US 2009 0009356 Al vectors may be re mapped to allow them to reside in either Flash memory by default or on chip static RAM 0062 The vectored interrupt controller VIC accepts all of the interrupt request inputs and categorizes them as FIQ vectored IRQ and non vectored IRQ as defined by program mable setting The programmable assignment scheme means that priorities of interrupts from the various peripherals can be dynamically assigned and adjusted Fast interrupt request FIQ has the highest priority If more than one request is assigned to FIQ the VIC combines the requests to produce the FIQ signal to the ARM processor The fastest possible FIQ latency is achieved when only one request is classified as FIQ because then the FIQ service routine can simply start dealing with that device But if more than one request is assigned to the FIQ class the FIQ services routine can read a
10. the decoder logic running on the hardware is implemented by a Bluetooth system on a chip 7 The device of claim 1 wherein the decoder logic handles pulse code modulation decoding 8 The device of claim 2 wherein the decoder logic relies on the master device handle decoding of IPTV and MPEG 2 and MPEG 4 9 The device of claim 2 wherein the decoder logic relies on the master device to handle DVD video decoding 10 The device of claim 1 wherein the remote control further includes memory coupled to the hardware resources that holds a DRM key and logic running on the hardware resources to automatically transmit the DRM key to a DRM enabled device Jan 8 2009 11 The device of claim 1 wherein the remote control further includes a camera coupled to the and logic running on hardware resources adapted to send camera signals to the master device 12 The device of claim 1 wherein the remote control further includes a USB port coupled to the hardware resources that the remote control makes accessible to the master device as a port local to the master device 13 The device of claim 1 wherein the remote control further includes a memory card reader coupled to the hard ware resources that the remote control makes accessible to the master device as a card reader local to the master device 14 The device of claim 1 further including in the packets received from the master device remote control menu information in the decod
11. wires a serial clock line SCL and a serial data line SDA Each device is recognized by a unique address and can operate as either a receiver only device or a transmitter with the capability both to receive and send infor mation 0071 Transmitters and or receivers can operate in either master or slave mode depending on whether the chip has to initiate a data transfer or is only addressed I2C is a multi master bus that can be controlled by more than one bus master connected to it 0072 DC implemented in LPC2132 support bit rate up to 400 kbit s Fast I2C The features of LPC2132 I2C bus is listed below 0073 0074 Easy to configure as master slave or line select master or slave 0075 0076 slaves Standard I2C compliant bus interface Programming clocks allow versatile rate control Bi directional data transfer between masters and Jan 8 2009 0077 Multi master bus no center master 0078 Arbitration between simultaneously transmitting masters without corruption of serial data on the bus 0079 Serial clock synchronization allows devices with different bit rates to communicate via one serial bus 0080 Serial clock synchronization can be used as a hand shack mechanism to suspend and resume serial transfer 0081 The I2C bus may be used for test diagnostics purposes 0082 The SPI 245 is a full duplex serial I O interface designed to be able to handle multiple masters and slaves connecte
12. 51 devices Many system level func tions have been incorporated into the P89LPC930 931 in order to reduce component count board space and system cost The P89LPC931 has the following enhanced features 0093 A high performance ARM processor 80C51 CPU provides instruction cycle times of 111 ns to 222 ns for instructions except multiply and divide when executing at 18 MHz This is six times the performance of the standard 80C51 running at the same clock frequency A lower clock frequency for the same performance results in power savings and reduced EMI 0094 2 4 V to 3 6 V VDD operating range I O pins are 5 V tolerant 0095 8 kB flash code memory with 1 kB sectors and 64 byte page size 0096 Byte erase allowing code memory to be used for data storage 0097 Flash program operation completes in 2 ms 0098 256 byte RAM data memory 0099 Real time clock that can also be used as a system timer US 2009 0009356 Al 0100 Enhanced UART with fractional baud rate gen erator break detect framing error detection automatic address detection and versatile interrupt capabilities 0101 400 kHz byte wide I2C bus communication port 0102 Eight keypad interrupt inputs plus two additional external interrupt inputs 0103 Four interrupt priority levels 0104 On chip power on reset allows operation without external reset components A reset counter and reset glitch suppression circuitry prevent spurious and incomplete rese
13. 712 The main processor also may couple to a camera module 750 a display 733 a keypad 711 and joy stick 723 The camera module may for instance be a 3 mega pixel CMOS component The memory card reader 760 can support one or more memory card formats Currently used memory card formats as of submission of this disclo sure include PC Card CompactFlash I and II SmartMedia Memory Stick Memory Stick Duo and Micro M2 Multime dia regular reduced size and micro Secure digital regular mini and micro xD Picture card and u card The main pro cessor 700 provides an array of ports for interfacing with these various components While currently available compo nents are generally identified such as by resolution or wire less standard one of skill in the art will recognize that these components will evolve over the 20 year life of a patent Remote Software 0228 Software components of the palm held remote include an LCD interface module a keyboard interface mod ule a fingerprint sensor module trackball or other directional device interface module and a Bluetooth module Other wire less protocols such as IEEE 802 1 x protocols can be substi tuted for Bluetooth Wireless protocols developed for cord less telephones also might be used Data is transmitted and received over Bluetooth or another wireless connection between the console and the palm held remote in a custom data format In this format a record may have fields including star
14. Aor tl AYATA LAIO uL tot ObCXOCE ace aol EEL 1804 Sea O3CIA Veldl fs 3 SOWO ans gt S PEE IIS d Ids f OSL 7 Ae 034025 OJN 9 2SX IZLLNI oa tr eem oed Apg JUS SHE ue A Johan pue Jebieud Alegeg INANI 2d HOSN3S INIdd H35NIJ tL ESL er Maur orgnv jy 03005 clany IB L Yade ISL zal DOLL 209 IHAA P4 ist HLOOLaNT8 TeL US 2009 0009356 Al TETHERED DIGITAL BUTLER CONSUMER ELECTRONIC DEVICE AND METHOD RELATED APPLICATIONS 0001 This application is a continuation of U S applica tion Ser No 11 465 749 filed Aug 18 2006 which is a continuation in part of and claims priority to U S application Ser No 11 350 980 filed Feb 8 2006 by inventor Robert Stepanian entitled TETHERED DIGITAL BUTLER CONSUMER ELECTRONIC DEVICE AND METHOD which claims the benefit of U S Provisional Application No 60 709 666 filed Aug 19 2005 it further claims the benefit of and priority to U S Provisional Application No 60 709 666 filed Aug 19 2005 0002 This application is related to US Design Pat Appli cation Nos 29 236 023 29 236 022 and 29 236 022 filed on Aug 10 2005 by inventors Phoebe Ng Robert Stepanian and Allison S Conner entitled NAVIGATION BUTTON ARRAY FOR REMOTE CONTROL HOUSING REMOTE CONTROL HOUSING and CONSOLE HOUSING The priority provisional and related design applications are incorporated by refer
15. S CPU 232 with real time emulation and embedded trace support together with 64 Kbytes KB of embedded high speed flash memory 223 A 128 bit wide memory interface 211 212 222 and accelerator architec ture enable 32 bit code execution at maximum clock rate For critical code size applications an alternate 16 bit thumb mode reduces code by more then 30 with minimal perfor mance penalty Due to their tiny size and low power consump tion these micro controllers are typically used for miniatur ized applications such as hand held equipment Most peripheral pins can also be remapped as General Purpose I O pins The system includes on chip SRAM of 16 KB 213 and is well suited for communication gateways and protocol con verters soft modems voice recognition and low end manag ing providing both large buffer size and high processing power Various 32 bit timers 247 248 10 bit 8 channel ADC s 226 10 bit DAC 227 PWM channels 225 and 47 GPIO lines 228 with up to nine edge or level sensitive external interrupt pins make these microcontrollers particu larly suitable for industrial control and hand held systems 0041 The integrated ARM microprocessor operates at 60 MHz and in one embodiment supports the following fea tures 0042 16 32 bit ARM7TDMI S microcontroller 232 in a tiny LQFP64 package 8 16 32 KB of on chip static RAM 213 and 64 512 KB of on chip Flash program memory 223 A 128 bit wide interface a
16. S core takes control the peripheral devices A dedicated software application running parses data received wirelessly such as over Bluetooth It also redirects the data to corresponding modules 0252 Modules 0253 The modem connected with the host system moth erboard is used to make the dial up connections This makes the socket modem module as a portable one 0254 On the console or host system processor side the serial driver initializes and configures the serial port baud rate equal to the modem baud rate An appropriate modem driver is loaded to manipulate the connected socket modem A WLAN module is a port of the Linux WLAN driver adapted to the host board The USB WLAN modules identified from Linksys and NetGear use the same driver Once the WLAN hardware is connected to the USB port it is logically con nected to the access point using the WLAN control utility 0255 A suitable Linux Bluetooth software stack is BlueZ Processing data from the stack involves developing parsing the data received from the remote The communication with the remote is established using the Bluez utilities from the host for remote headset and serial port functionalities Once the application knows the source of the data packet it redi rects the data to the appropriate module for the required functionality The software also provides a facility to send the data to the LCD available on the remote side The application developer can use the fingerprint
17. US 20090009356A1 as United States a2 Patent Application Publication o Pub No US 2009 0009356 A1 Stepanian 43 Pub Date Jan 8 2009 54 TETHERED DIGITAL BUTLER CONSUMER Publication Classification ELECTRONIC DEVICE AND METHOD 51 Int Cl G05B 19 04 2006 01 75 Inventor Robert Stepanian San Jose CA 52 US CT ser 340 825 24 US 57 ABSTRACT Correspondence Address The present invention relates to a tethered digital butler con HAYNES BEFFEL amp WOLFELD LLP sumer electronics product and method The tethered digital P O BOX 366 butler of a price and form factor suitable for consumer elec HALF MOON BAY CA 94019 US tronics markets of developed and developing countries includes a communications and multi media console and a wireless remote The remote may resemble a handheld per 73 Assignee Nexstep Inc San Jose CA US sonal computer HPC a palm held personal computer PPC or PDA or a smart phone but has a low cost and feature set 21 Appl No 12 210 782 supported by the console that is novel in the consumer elec tronics market In particular this disclosure relates to com 22 Filed Sep 15 2008 bining telephone service device control and optionally a fingerprint reader for easy user identification authorization By lig and personalization As another option a camera can be Related U S Application Data incorporated into the remote thereby enabling video confer 63 Continuation of applicati
18. a decoder logic running on the hardware resources logi cally coupled to the stack adapted to receive the packets processed by the master device into a remote control device format and to decode the remote control device format into signals to drive the slaved outputs wherein the remote control depends on the master device to process at least one audio stream from one or more source formats into the remote control device format depends on the master device to transcode input from and output to the slaved microphone and audio output between VoIP and the remote control device format and relies on the master device to respond to the control signals to change the audio stream delivered in the packets 2 The device of claim 1 wherein the slaved display is capable of at least showing a photograph or showing a caller ona video conference and the remote control further depends on the master device to process a video stream from one or more source formats into the remote control device format 3 The device of claim 1 wherein the slaved display is capable of at least displaying text both received from the master device and generated by the remote control 4 The device of claim 1 wherein the slaved display is capable of at least displaying text responsive to the packets received from the master device 5 The device of claim 1 wherein the remote control device format is compliant with a Bluetooth standard 6 The device of claim 1 wherein
19. age display or may be overlaid on top of the video image Optionally the device s on screen menu and controls can be supplied to the remote exclusively as a data stream and not as part of a rendered video stream to avoid confusing menus of different sizes Alternatively the on screen menus and controls may just appear on the remote s display as a consequence of being rendered to a TV or monitor that is reproduced on the remote s display 0233 One of skill in the art will recognize that a display in the palm of the hand will be useful to many people because it reduces demands for eye hand coordination and short term memory The form factor is convenient A single remote can control for many devices Depending on the features com bined into the remote varying complexity can be delivered at varying prices 0234 The on screen display module can be more or less stateful JavaScript for instance can be used to keep track of the user s intermediate selections until they are sent to the host Or a Java or similar application could replicate the states of the host More simply the display could be essen tially stateless and rerendered by the host after each data transfer from the remote to the host 0235 The form factor of the remote display could alterna tively bea full display with touch sensitive areas and rendered buttons that provide visual and or audio feedback as opposed to the tactile feedback of pressed buttons 0236
20. al power supply module The external power supply module will provide power to the remote and for charging the battery The input power is fed through a connector From the 5 volts input the following voltages are derived on the CPU card Processor core voltage The core supply for the processor is generated through a low dropout regulator that can support current up to 1 5A operating from a5V input The output 1 8V is fed to the core of the processor PLL voltage The core voltage is the input to the PLL through a ferrite bead which supplies power to clock generation and PLL circuits of the processor 0223 Data sheets publicly available for the major IC com ponents include 1 LPC213x Philips User manual Nov 22 2004 2 Zeevo ZV4301 Datasheet Jan 24 2005 3 P89LPC930 931 Data Sheet Rev 05 15 Dec 2004 0224 4 DDG128032AAD Data sheet Rev 1 0 Issue date 2004 10 06 5 ITT Cannon Miniature all direction scanning switch Data sheet 6 Authentec Fingerprint sensor AES 3400 Data sheet 7 MSM7716 OKI Datasheet Version August 1998 8 AT49BV802A Datasheet Document 3405D Flash March 2005 0225 In addition a camera can be incorporated into the remote thereby enabling video conferencing and other visual features The camera is complemented by a glue logic appli cation supplied for or native to a communications and or US 2009 0009356 Al multi media console such as one running under Windows OS X or Linux A CMOS
21. amera module can be incorporated into the remote thereby enabling video con ferencing and other visual features The camera is comple mented by a glue logic application supplied for or native to a communications and or multi media console such as one running under Windows OS X or Linux To support full motion video Bluetooth version 2 or later or a wireless Eth ernet protocol may be used to supply the required bandwidth 0026 As a further aspect of these embodiments the con sole may be equipped with a non volatile memory sized to time shift playback from the video receiver and its logic and resources are further adapted to provide a menu of upcoming video content schedule recording of the video content and replay the video content Alternatively the non volatile memory may be sized to hold a library of digital music 0027 The I O platform in the palm of our hand concept can be enhanced by adding a memory card reader to the remote One or more of the many memory card formats now in use or as may be developed in the future can be accommo dated 0028 Another form of I O is provided through a USB or Firewire port The remote may integrate a USB connector and port or similar Firewire support Glue logic running on the host device may be adapted to treat the USB or Firewire port as if it were local to a machine being accessed using the remote 0029 In another aspect of these embodiments the remote may hold a DRM key and automaticall
22. camera commercially available for incorporation in camera phones may be suitable for this appli cation This is illustrated in FIG 7 0226 FIG 7 depicts building the digital butler remote board as an XScale processor based solution with a camera module and or memory card reader This remote is built around the Intel XScale micro controller or a digital signal processor DSP The main processor provides interfaces for the Keypad Joystick 320 240 graphics LCD module fin gerprint sensor Bluetooth SOC WiFi 802 11b g module audio codec camera module and memory card reader The audio codec interfaces with a microphone speaker and head phone for voice utilities Alternatively the microphone speaker and headphone could interface through the Bluetooth module as described in the context of FIG 1 A general USB dongle interface not shown could be provided to allow the user to use the USB port as ifit resided on the host device The USB port of the remote would function as a remote USB connection for the host 0227 From FIG 7 the components include the main pro cessor 700 which couples to the Bluetooth module 732 WiFi module 751 and audio codec 741 The audio codec couples to speaker 752 microphone 751 audio jack 753 The main processor also may couple to a fingerprint sensor 721 and a battery pack 712 A battery charger and power management component 724 such as a cradle couples to a DC power input 713 and charges the battery
23. ccelerator 211 212 222 enables high speed 60 MHz operation 0043 In System In Application Programming ISP IAP via on chip boot loader software Single Flash sec tor or full chip erase in 400 ms and programming of 256 bytes in 1 Ms Embedded Trace interfaces 231 offer real time debugging with the on chip real monitor soft ware and high speed tracing of instruction execution One 8 channel 10 bit A D converters 226 provides a total of up to 16 analog inputs with conversion times as low as 244 us per channel 0044 Single 10 bit D A converter 227 provides vari able analog output 0045 Two 32 bit timers counters with four capture and four compare channels each 225 PWM unit six outputs 225 and watchdog 248 0046 Real time clock 247 equipped with indepen dent power and clock supply permitting extremely low power consumption in power save modes Multiple serial interfaces including two UART 16C550 246 Bluetooth SOC Flash 8 Mb Jan 8 2009 Fingertip sensor with SPI interfaces Bluetooth SOC with UART interface Micro power synchronous 600 ma Buck Boost De DC converter two Fast I2C bus 400 Kb s 244 SPI and SSP 245 with buffering and variable data length capabilities 0047 Vectored interrupt controller 253 with config urable priorities and vector addresses 0048 Up to 47 5 V tolerant general purpose V O pins 228 in tiny LQFP64 package 0049 Up to nine edge or level sensitive
24. d to a given bus A single master and a single slave communicate on the interface during a given data transfer During a data transfer the master always sends a byte of data to the slave and the slave always sends a byte of data to the master The features of the SPI controller is listed below 0083 Compliant with serial peripheral interface SPI specification 0084 Synchronous serial full duplex communication 0085 Combined SPI master and slave 0086 Maximum data bit rate of one eighth of the input clock rate 0087 The real time clock RTC 247 is designed to pro vide a set of counters to measure time when normal or ideal operating mode is selected The RTC uses little power mak ing it suitable for battery powered systems where the CPU is not running continuously idle mode The features of RTC are described below 0088 Measures the passage of time to maintain a cal endar and clock 0089 Ultra low power design to support battery pow ered systems 0090 Provides seconds minutes hours day month year day of week and the day of year 0091 Programmable reference clock divider allows adjustment of the RTC to match various crystal frequen cies 0092 The 8051 based Philips LPC89LPC931 controller in FIG 4 is suitable for keyboard interface The P89LPC930 931 404 is based on a high performance processor architec ture that executes instructions in two to four clocks six times the rate of standard 80C
25. e figures Preferred embodiments are described to illustrate the present invention not to limit its scope which is defined by the claims Those of ordinary skill in the art will recognize a variety of equivalent variations on the description that follows 0015 A tethered digital butler produces a low cost palm held remote with a novel combination of features that are implemented by logic and resources of the console con nected wirelessly to the palm held remote Tethering the palm held device so that it depends on logic and resources of the console runs against the trends and teachings of the consumer electronics industry and particularly against the trend toward more powerful smartphones 0016 Various novel combinations of features are empha sized in this application One will recognize that the features discussed can be combined in many ways while remaining faithful to the tethered digital butler concept 0017 Ina first embodiment of the tethered digital butler the palm held remote allows a user to select among and use US 2009 0009356 Al logic and resources of a bread box or smaller sized console to authenticate users from a fingerprint reader on the remote to personalize the user s telephone TV viewing media access and internet browsing experiences to connect the user to a telephone network consistent with the user s authentication and to control multi media features such as channel control volume control DVD CD
26. ed solution 0038 This remote is built around the Philips LPC2132 ARM controller The main processor provides interfaces for the Keypad Trackball or other pointing device 128 32 graphics LCD module fingerprint sensor and Bluetooth SOC The Bluetooth SOC and Zeevo ZV4301 interface with a microphone speaker and headphone for voice utilities The system may use a Philips 89LPC931 controller for the keypad interface through a I2C Bus Alternative hardware configura tions are illustrated in FIGS 7 and 8 0039 FIG 1 is a block diagram of the digital butler remote Embodiment Details Chip number Description LPC2132 Philips Main CPU 60 MHz 64 Kb flash 16 Kb SRAM 8051 MCU compatible with 8 KB flash 12C interface 128 32 graphics parallel serial LCD Module Miniature all directional scanning switch 89LPC931 Philips DDG128032AAD DDTL TBWB2A00 ITT Industries Cannon Omni or Vari Point or Omni or Vari Disk US 2009 0009356 Al continued Embodiment Details Chip Name Chip number Description devices ITT Industries Cannon Fingertip sensor 121 AES3400 Authentech Bluetooth SOC 132 ZV4301 Zeevo or equivalent by Broadcom or RSMD Flash Memory 131 AT49BV802A Atmel Codec IC 141 MSM7716 OKI Power Supply 113 LTC 3440EDD Linear Technology Single rail codec 0040 Additional details of the main processor are depicted in FIG 2 The LPC2132 100 is based on a 32 16 bit ARM7TDMI
27. ence BACKGROUND OF THE INVENTION 0003 The present invention relates to a tethered digital butler consumer electronics product and method The teth ered digital butler of a price and form factor suitable for consumer electronics markets of developed and developing countries includes a communications and multi media con sole and a wireless remote The remote may resemble a hand held personal computer HPC a palm held personal com puter PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the con sumer electronics market In particular this disclosure relates to combining telephone service device control and option ally a fingerprint reader for easy user identification authori zation and personalization The remote may be packaged separately from a console and sold to interact with capabili ties of a communications and multi media console from a different source such as one running on a Windows OS X or Linux platform 0004 Convergence of digital devices is not unbounded because it is guided by market realities Many concepts are floated as trial balloons that burst never to see an enabling development effort or a reduction to practice Some conver gence trends are strong and noteworthy Cellular smartphones or business phones such as Treo or Blackberry products are becoming powerful and supplanting separate PDAs These smartphones go with the user across a cellular net
28. er logic logic adapted to place the remote control menu information on the slave video display logic running on the hardware resources adapted to convert navigation of and selection from the remote control menu information on the slave video display into the control signals to send to the master device 15 A hand held remote control device with slaved audio reproduction the device including a radio a plurality of slaved inputs and outputs built into the hand held remote control including at least a slaved micro phone a slaved display and a slaved audio output hardware resources coupled between the radio and the slaved inputs and outputs a stack running on the hardware resources and exchanging packets with a master device wherein the remote control depends on the master device to process an audio stream from one or more source for mats into a remote control device format a decoder logic running on the hardware resources logi cally coupled to the light weight protocol stack adapted to receive the packets processed by the master device and adapted to decode the remote control device format into signals to drive the slaved outputs a encoder logic running on the hardware resources logi cally coupled to the light weight protocol stack adapted to encode signals from the microphone into a remote control audio format and adapted to send audio packets in the remote control audio format to the master device and further
29. ess to DRM controlled content using one or more keys linked to the fingerprint history of searches recent topics personal interest a la Google Sidebar or Claria PersonalWeb recently accessed files automatic authenticated access to communication chan nels linked to the fingerprint such as voice over IP instant messaging web conferencing and e mail electronic wallet access automatically looking up credit card information and other account authorization information and sharing of infor mation by person logged in 0239 The trackball or other pointing device interface module uses sampling techniques to read the ball movement and click button states The outputs of the trackball are con Jan 8 2009 nected to general purpose I O channels The modules sense the state of the general purpose I O s at a predetermined frequency such as 1 kHz 0240 A Bluetooth wireless interface module may be based on Zeevo ZV4301 Bluetooth SOC or a Broadcom or RFMD design with headset and serial port profile SPP firm ware This module is coupled to the main controller through a UART The module is adapted to convey wirelessly a mix of keyboard data trackball data fingerprint sensor data for authentication and data to be displayed on the remote mod ule s display Console Hardware 0241 Introduction 0242 The core component of the console or host system may be a standard mini ITX mother board with ports to add peripherals A USB Bluetoot
30. external inter rupt pins 224 available 0050 60 MHz maximum CPU clock available from programmable on chip PLL 241 0051 On chip crystal oscillator with an operating range of 1 MHz to 30 MHz 0052 Power saving modes include idle and Power down 0053 Individual enable disable of peripheral functions as well as peripheral clock scaling down for additional power optimization 0054 Processor wake up from Power down mode via external interrupt 224 0055 Single power supply chip with POR and BOD circuits 0056 CPU operating voltage range of 3 0 V to 36 V 33 V 10 with 5 V tolerant I O pads 0057 The LPC 2132 s 64 KB of flash memory 223 may be used for both code and data storage Programming of the flash memory may be accomplished in several ways It may be programmed in the system via the serial port 245 The application program may also erase and or program the flash while the application is running allowing flexibility for data storage field firm grade upgrades etc While the on chip boot loader is used 64 KB flash memory is available for user code The LPC2132 flash memory provides a minimum of 100 000 erase write cycles and 20 years of data retention On chip static RAM 213 may be used for code and or data storage The SRAM may be accessed as 8 bits 16 bits or 32 bits wide General purpose parallel I O is supported by device pins that are connected to a specific peripheral function are controlled by
31. faces 631 to the modem 634 0247 A standard off the shelf 802 11g WLAN module 632 is available module with USB interface The module can be connected to the USB port available on the mother board header An external antenna may be positioned at the rear panel of the host system for maximum sensitivity Some suitable modules include the Linksys WUSB54GP and Net Gear WG111 These modules are interoperable with 802 11 b A WLAN module may be an alternative to a Bluetooth module for communications with the remote or can provide a network interface for the console 0248 A standard off the shelf Bluetooth module 633 is available module with USB interface The module may be connected to the USB port available on the motherboard header The module will be connected to the host system by the USB port available on the motherboard header The mod ules built around CSR chipset may be suitable 0249 The power supply used may be a standard mini ITX power supply standard 12 volts DC power module also can be used for this purpose The power supply board includes DC DC converters to provide output voltages of 12V 12V 3 3V and 5V DC similar to an ATX power supply These power supply tapping is used in the carrier board to supply power to the add on modules such as socket modem WLAN and Bluetooth modules Console Software 0250 Introduction 0251 A Linux core runs on the VIA Eden processor The module drivers loaded on the O
32. h module and USB WLAN mod ule may be connected to the motherboard through USB ports A display is connected through VGA connector and the socket modem with RJ11 connector is connected through serial port 2 The remaining ports can be used for external interface The wireless remote communicates over Bluetooth with the USB Bluetooth module 0243 Features 0244 FIG 6 is a block diagram of the console 606 The host console of the system may be built on a standard Mini ITX motherboard and an additional add on board to support the features like WAP Bluetooth and a MODEM for PSTN and a PCI VGA Card A standard Mini ITX is available in a 17 cmx17 cm form factor The motherboard and or add on board may include two VGA connectors for example a VGA connector from motherboard 613 and a second VGA con nector using a PCI add on card 614 The design also may include a serial port for external interface 611A and another serial port for a modem 611B two USB ports 612B support for a USB hub an 802 11g WLAN module 632 preferably interoperable with 802 11b with a separately con nected antenna Other console components may include a USB to Bluetooth module 632 with chip antenna a standard PC hard disk drive 623 and DVD drive 624 and an ATX power supply or Mini ITX power module 0245 Motherboard support may include a VIA Eden C3 processor at operating at 1 0 1 5 GHz or another rate inte grated Castle Rock graphics with MPEG 2
33. hat would normally appear on a TV or monitor for reproduction on a display that is part of the remote To implement this capability a menu generating device can assemble on screen menus and controls as sepa rate data stream apart from any video image that the menus and controls overlay The data stream can be supplied both to the device s own on screen overlay generator and to a com munications module coupled to the remote The remote uses the data stream to render the on screen display in a legible format adapted to the reduced size of a screen on the remote Preferably the menu and control organization format on the remote mimics what the viewer can see on the screen to minimize confusion Technologies such as a subset of HTML and JavaScript allow a designer to specify a menu and control layout in terms that permit rendering to a variety of display sizes Remote display of the on screen menu and control data stream may preempt a video image display or may be overlaid on top of the video image Optionally the device s on screen menu and controls can be supplied to the remote exclusively as a data stream and not as part of a rendered video stream to avoid confusing menus of different sizes Alternatively the US 2009 0009356 Al on screen menus and controls may just appear on the remote s display as a consequence of being rendered to a TV or monitor that is reproduced on the remote s display 0025 In any of these embodiments a c
34. ial amp 8 bit parallel system interfaces 0134 6 or 12 MHz operation with crystal or supplied clock input 0135 USB selective suspend support 0136 Ultra hard surface coating 0137 1 million rubs w o degradation 0138 Highly scratch resistant 0139 IEC 61000 4 2 level 3 ESD capability 8 KV 0140 Built in low power finger detection w system interrupt capability 0141 Low power operation lt 6 mW imaging event Jan 8 2009 0142 The interface of these fingertip sensors is pin selectable choices The SPI interface finger chip sensor is selected so that the finger tip sensor is connected to the SPI port 245 of the main processor 0143 The Zeevo ZV4301 in FIG 5 used in one embodi ment is a Bluetooth SOC adapted to provide a high bandwidth CPU system to add wireless connectivity to their product The ZV 4301 502 incorporates the industry standard 32 bit ARMT7TDMI CPU core with high bandwidth processing capability sufficient to support a wide range of embedded applications The ZV4301 operates from 25C to 85C and comes in a lead free version The ZV4301 is implemented in a 0 18 micro meter CMOS process and includes the integra tion of all RF components and digital circuitry The only external components needed are an antenna crystal refer ence resister decoupling capacitors and flash memory The ZV4301 is designed for low power applications including sleep and deep sleep modes and operates from a single
35. including a keyboard and navigation control coupled to the hardware resources adapted to send con trol signals via the radio to the master device whereby the remote control relies on the master device to respond to the control signals to change the audio stream deliv ered in the packets and to direct the audio packets sent by the remote control for appropriate processing on the master device including transcoding input from and output to the slaved microphone and audio output between VoIP and the remote control device format 16 The device of claim 15 wherein the slaved display is capable of at least displaying text both originating from the master device and locally generated US 2009 0009356 Al Jan 8 2009 15 17 The device of claim 15 wherein the remote control in the decoder logic logic adapted to place the remote further includes a camera coupled to the and logic running on control menu information on the slave video display hardware resources adapted to send camera signals to the logic running on the hardware resources adapted to convert master device navigation of and selection from the remote control menu information on the slave video display into the 18 The device of claim 15 further including control signals to send to the master device in the packets received from the master device remote control menu information kok oko ok k
36. ler to Matrix Interface P89LPC93 Signal Signal Name key board Remarks K131 0 Keybd input 1 P0 0 RET LINE 1 Keybd Return line 1 KBI 1 Keybd input 2 PO 1 RET LINE 2 Keybd Return line 2 K13I 2 Keybd input 3 P0 2 RET LINE 3 Keybd Retum line 3 K131 3 Keybd input 4 P0 3 RET LINE 4 Keybd Retum line 4 KBIA Keybd input 5 P0 4 RETLINE5 Keybd Retum line 5 K131 5 Keybd input 6 P0 5 RET LINE 6 Keybd Return line 6 K131 6 Keybd input 7 P0 6 RET LINE 7 Keybd Return line 7 K131 7 Keybd input 8 P0 7 RET LINE 8 Keybd Retum line 8 Jan 8 2009 continued Keyboard Controller to Matrix Interface P89LPC93 Signal Signal Name key board Remarks K130 0 Keybd output 1 P2 0 SCAN LINE I Key bd Scan K130 1 Keybd output 2 P2 1 SCAN LINE 2 Key b Scan K130 2 Keybd output 3 P2 2 SCAN LINE 3 Key 3 Scan K130 3 Keybd output 4 P2 3 SCAN LINE 4 Key Y Scan KBOA Keybd output 5 P2 4 SCAN LINE 5 zu Scan K130 5 Keybd output 6 P2 5 SCAN LINE 6 Key Scan K130 6 Keybd output 7 P2 6 SCAN LINE 7 Key Y Scan K130 7 Keybd output 8 P2 7 SCAN LINE 8 Key 4 Scan K130 8 Keybd output 9 P1 0 SCAN LINE9 Key bi Scan K130 9 Keybd output 10 P1 1 SCAN LINE 10 Key Scan K130 10 Keybd output 11 P1 4 SCAN LINE 11 E Scan K130 11 Keybd output 12 P1 6 SCAN LINE 12 Keybd Scan K130 12 Keybd output 13 P1 7 SCAN LINE 13 E Scan ine 13 0109 The LCD display 133 DD12803AAD in one embodiment is a 128 32 dot matrix LCD module The LCD Module can be easily accessed via parallel micr
37. m t TU oluvn p vosnas 140d 137TvUwa E daads HOIH ldS SZ diH25 ysesans i BESSER FR SEN Land OO Patent Application Publication ARM Local But PWMO Jan 8 2009 Sheet 2 of 6 US 2009 0009356 A1 25 SEE is Ed LEE IL 25 as 252 ARMTTONI S KA d es 253 211 Vesta niet 2535 3 ABA AHE Coniratier Advenced Hiptrperfennanne Bus Decoster 249 System Gonti 1 1 i I LI H H t LU t D H DH 1 D eier Tema Flen 235 onbroler Gelder kk 222 236 237 aes 213 SRAM FLASH N Kage wiar 223 Tvem i 24 Peripheral Bus 244 1 I ENTIS Exlemal PO Serial sel i Interrupis Interfaces D and 1 SOM op 225 IL EMT 5 acum EL EN en aus sPlangsse MOSS A feat extemal doe erick nf aum la SEMAT d Serial Interfaces TIMER D amp 1 226 auc SAIL Cn 1 TOG f a 9 pl A Converters uatogi ER b r DE and 17 i dcs SRP ron ET aot 22 DR DERG jur i 24 a i i Au E 7 Real Time u Dig Gorwerter p Clock lot Viar 1 1228 EE 2 248 PL EE General Watchdo INN te 1 Purpose WO i Tiraz i 229 H 4 Li t FIG 2 Patent Application Publication Jan 8 2009 Sheet 3 of 6 US 2009 0009356 A1 42 GB D FFFF FFFF AHA Peripherals 78 GB Or DOOD PB Peripherais G EDOD 5908 2d GB Gyles DODD Reserved Address Space 28GB ena GxBDO0 COO remapped fram Cn crp Flash misce Re
38. mand environment approved access to DRM controlled content using one or more keys linked to the fingerprint history of searches recent topics personal interest a la Google Sidebar or Claria Per sonalWeb personal receptiveness to advertising content recently accessed files automatic authenticated access to communication channels linked to the fingerprint such as voice over IP instant messaging web conferencing and e mail electronic wallet access automatically looking up credit card information and other account authorization infor mation and sharing of information by person logged in 0031 The console may be equipped with a remote locator control button that causes the remote to emit a tone which makes it easier to locate 0032 The form factor of a palm held remote should be easily recognized 0033 The form factor of a bread box or smaller sized console can be judged by volume A smallish consumer elec tronics component uses an enclosure from which connectors and feet protrude that is 12 by 15 by 3 inches and has a volume of 540 cubic inches This is an approximately bread box sized enclosure although the shape differs from a loaf of bread Remote Hardware 0034 Introduction 0035 The digital butler remote is a gadget based on the Bluetooth or another wireless technology used for communi cations and remote control applications 0036 Features 0037 The digital butler remote board is an ARM proces sor bas
39. n screen display the remote can substantially duplicate the look and feel of the on screen display In this instance substan tially means to the extent allowed by the form factor of the remote display For instance the same HTML code may be differently rendered to the on screen display and the remote display given the different dimensions of the displays 0232 Anon screen menu and controls module can render a control interface translating a device menu and controls display that would normally appear on a TV or monitor for reproduction on a display that is part of the remote To imple ment this capability a menu generating device can assemble on screen menus and controls as a separate data stream apart from any video image that the menus and controls overlay The data stream can be supplied both to the device s own on screen overlay generator and to a communications module coupled to the remote The remote uses the data stream to render the on screen display ina legible format adapted to the reduced size of a screen on the remote Preferably the menu and control organization format on the remote mimics what the viewer can see on the screen to minimize confusion Technologies such as a subset of HTML and JavaScript allow a designer to specify a menu and control layout in terms that permit rendering to a variety of display sizes Remote display of the on screen menu and control data stream may preempt US 2009 0009356 Al a video im
40. ng contacts which generate by contact closing and opening the electrical pulses US 2009 0009356 Al 0122 To track the ball movements a simple electronic device tied to the direction contacts converts the vertical and horizontal displacements of the both perpendicular rollers in logical levels of X axis and Y axis displacements Some pull up resistors or respectively pull down resistors are tied to the axis direction contacts while the common contact is tied to the ground or respectively to the power supply potential The change in state interrupts the main LPC2132 processor 100 The output pulse frequency is directly proportional to the moving speed and the direction The pulse frequency is pro cessed by the main processor LPC2132 and the correspond ing PS2 data sent to the host system 0123 Alternatively the ITT Industries Cannon Omni or Vari Point joystick or the Omni or Vari Disk navigation disk can be used instead of a trackball 0124 The AuthenTec EntrePad AES3400 AuthenTec s 3rd generation low power small form factor fingerprint iden tification sensor IC 121 This product combines silicon based image capture with a proprietary sensor control and matching algorithms to deliver ability to acquire ATA fin gerprint images and authentication AuthenTec s EntrePad AES3400 utilizes TruePrint Technology allowing the sensor to look past the easily obscured outer surface of the skin to the living layer below whe
41. o controller GPIO interface Its features include 0110 Transflective display mode and positive type B W mode FSTN LCD 0111 Graphic 128 32 dot matrix display format 0112 Parallel input data from micro controller 0113 1 33 duty multiplexing ratio 0114 1 6 bias 0115 6 o clock viewing direction 0116 Dimension outline 35 W 28 9 H 1 75 D mm 0117 Resolution 128 32 dots 0118 Active area 29 66 W 8 45 W mm 0119 Dots pitch 0 232 W 0 265 H mm 0120 Dots size 0 202 W 0 235 H mm 0121 The ITT Industries Cannon TBWB2A00 trackball 123 is a miniature all directional scanning switch developed for mobile remote PDA notebook PC and hand held device applications It includes two perpendicular rollers actuated by friction on the ball and two spring contacts which generate by contact closing and opening the electrical pulses and a light tactile effect click at each pulse A switch called Select is integrated in the trackball Optimally two LEDs can be included with the trackball and driven according to the wishes of the user Several tactile effects can be obtained according to the number of tooth integrated in the gear axle the standard resolution is 12 pulses per ball rotation When the Trackball is activated its relative position changes are ana lyzed in two directions X and Y The two perpendicular rollers are actuated by friction on the ball During their revolution the rollers activate two spri
42. on No 11 465 749 filed on encing and other visual features Alternatively the remote Aug 18 2006 now Pat No 7 444 130 which is a may be packaged separately from a console and sold to inter continuation in part of application No 11 350 980 act with capabilities of a communications and console set filed on Feb 8 2006 now Pat No 7 389 103 top box multi media PC or other consumer electronics g Ro device from a different source such as one running on a Windows OS X or Linux platform with or without telephone 60 Provisional application No 60 709 666 filed on Aug capabilities The remote may include a media reader and ts 19 2005 100 3k SPUHIGH SPEED PARALLEL PORT FINGER jj CHIP Za SENSOR PB9LPC931 Pj KEYBOARD Le CONTROLLER Bd 12C TRACK BALL fet 33VREG H BUCK BOOST gt poy 26V MINN Los f BATTERY UARTO I LPC 2132 remote USB port Zu Flash Debug header Jan 8 2009 Sheet 1 of 6 US 2009 0009356 A1 Patent Application Publication L Old E E d i i e j AMSLiwa MAIN AGE FF messen dans i i P ENEE j bil Z1 woud i HAM Od Jepeeu lenia Od Indul josey Veen Drag men Old iNLIX3 I olde AVdAI EEN debe QNVOSASM fake mund TELT Id fee d 150d168d ouo Banu EE NX Ham S J gmu
43. ophone and volume con trol adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console and a compact keypad including numeric keys usable for telephone dialing The fingerprint reader is not included nor is the alphabetic keypad The logic and resources ofthe console are reduced accordingly Logic and resources ofthe console need not authenticate and personalize based on fingerprints or access and playback digitally stored music Internet browsing may be limited or may be supported by an on screen key board 0019 Ina third embodiment of the tethered digital butler the DVD CD player is omitted from the console The features of the palm held remote do not much change but the logic and resources required of the console are reduced 0020 In fourth embodiment the console is implemented on a PC which may be larger than bread box sized This typically would be less desirable as most PCs do not fit a media room d cor and are relatively loud dueto fans and hard disk rotation A new generation of PCs such as the Mac Mini presents a small form factor presently 6 5x6 5x2 inches and quiet operation while including enough computing power to function as PC 0021 In a fifth embodiment the remote is emphasized One aspect of the remote is to provide a complete I O plat form in the palm of the user s hand Features adaptable to
44. r electronics market In particular this disclosure relates to combining telephone service device control and option ally a fingerprint reader for easy user identification authori zation and personalization As another option a camera can be incorporated into the remote thereby enabling video con ferencing and other visual features Alternatively the remote may be packaged separately from a console and sold to inter act with capabilities of a communications and console set top box multi media PC or other consumer electronics device from a different source such as one running on a Windows OS X or Linux platform with or without telephone capabilities The remote may include a media reader and remote USB port Particular aspects of the present invention are described in the claims specification and drawings BRIEF DESCRIPTION OF THE DRAWINGS 0007 FIG 1 is a block diagram of the digital butler remote 0008 Details of the main processor are depicted in FIG 2 0009 The LPC 2132 memory maps are shown in FIG 3 0010 FIG 4 shows the 8051 based Philips LPC89LPC931 controller 0011 FIG 5 shows the ZV4301 to other CPU and periph eral interfaces 0012 FIG 6 is a block diagram of the console 0013 FIG 7 is an alternative block diagram of the digital butler remote with a CMOS camera module and or memory card reader DETAILED DESCRIPTION 0014 The following detailed description is made with ref erence to th
45. raw data received from the Bluetooth remote and the authentication code libraries pro vided by the vendor to achieve the matching operation Jan 8 2009 0256 0257 The console may support the following functions Bluetooth remote access 0258 WLAN enabled for network communication 0259 Socket modem module for dial up network con nection 0260 The following combinations of hardware and soft ware features are within the scope of this disclosure for pro viding services described Supported by the console one or any combination of the following General Purpose Computer 0261 PVR TV Set Top Box w optional personal video recorder Terrestrial Cable Satellite IP 0262 Messaging console one or any combo Text SMS Webpages Voice Landline cell IP Video Network Port 0263 TV and or Monitor Out Optionally Hard Drive 0264 Media Card Reader non volatile memory CD DVD Writable versions possible Wireless network router 0265 Supported by the hand held remote one or any com bination of the following Fingerprint Optional 0266 Speaker Mic Vol control Display Cursor Control Thumb board Alphanumeric Video Camera Media Reader 0267 USB port 0268 Applied to the following services Communication including Phone LL Cell IP Internet email and text voice video messenger Entertainment including Multimedia apps including TV PVR DVD Video Photo Music Radio and
46. re the unique ridge and valley patterns of the fingerprint originate Trueprint is AuthenTec s unique patented imaging technology During imaging a small near field signal is generated between the IC and the finger s living tissue layer 16 384 individual elements in the sensor matrix form a planar antenna array that receives this signal creating a digital pattern that accurately reproduces the fingerprint s underlying structure A powerful utility within TruePrint is Dynamic Optimization This tool analyzes each image con trolling up to 15 sensor parameters to optimize the fingerprint image regardless of unusual skin conditions or surface con tamination The TruePrint high quality fingerprint imaging technology enables reliable authentication 0125 The fingerprint sensor is small battery friendly and well suited to Bluetooth communications These sensors automatically generate interrupts and reduce system over head needed for finger detection 0126 Features of the fingerprint component in one embodiment include 0127 TruePrint technology for ability to acquire ATA 0128 Compact industry standard 100 Pin LQFP Pack age 0129 High definition 128x128 TruePrint technology based pixel array 0130 500 pixels per inch ppi 0131 Extended Range 2 7V to 3 6V single power sup ply 0132 0 C to 70 C operating temperature range 0133 Easy to integrate USB 2 0 full speed synchro nous amp asynchronous ser
47. served Address Space ere s 8 R v TE 32 Chip State RAM LPCZ2 138 32 kB On Chip Static 1 LPC2 138 GE 16 kB On Chip Static RAM LPC2132 T Ox4D0D 2029 KB On Chip State RAM LPC2131 DD EFF LE GB Ox D00 0000 Reserved Address Space GxDD08 2005 51235 On Ch p Non Volatile Memory tt Paz agy 10007 FFF DD OT gera Ox0000 FFFF 220000 BODY CxOD00 EST UxDDDD Ge amp 4 ke Qn C ip Non Volaile Memory LSC 23123 32 kB On Chip Non Volaille Memory LPG2124 FIG 3 Main Proc Keyboard Ctir Keyboard Matrix LPG 2132 P89LP931 8 return lines x 13 scan lines ise Hot joe s FIG 4 Patent Application Publication Jan 8 2009 Sheet 4 of 6 US 2009 0009356 A1 AT49 BV802A 8Mb Flash i LPC 2132 CPU I loo VART ZV4301 Bluetooth SOC 502 MSM 7716 OKI codec 28 Speaker JP FIG 5 Jan 8 2009 Sheet 5 of 6 US 2009 0009356 A1 Patent Application Publication 9 EL eu YS PEH uod Y hi9 J8HSAUON x gt CECSY D Z yog BUSS de S192 NYT Spr JOWIHILNI TYNHALXE A D I ainpoyy o SJopEeHl ZSd i l e SGD yoojenig SSN posee peog t vod Gen avena M NECEM ipti Sd gt TV NUSLLYS au Te HIM SSN GUYUVOEHUIHLON SN i KUCKE hio 3 anpayy wapo 24209 ES 7 HS vag he les wie Jan 8 2009 Sheet 6 of 6 US 2009 0009356 A1 Patent Application Publication 022 pee 1eydepy HOUS
48. slaves and up to 4 Pico nets supported 0184 u Law A Law and CVSD transcoders on SCO channel 0185 Full 8 to 128 bit encryption 0186 The baseband modem includes 0187 Demodulator modulator RX TX self calibra tion burst timing control and transmitter burst spectral shaping 0188 FEC encoder decoder data whitening encryp tion decryption and cyclic redundancy check 0189 Link controller for synchronization frequency hope control and receiver transmitter slot timing 0190 The external bus interface includes 0191 8 16 bit data bus 0192 23 bit address bus 0193 Support for 2 memory banks Each bank supports up to 16 Mbytes flash and SRAM with independent timing control for each bank 0194 GPIO can function as additional interrupts 0195 3 dedicated chip selects each with independent timing control 0196 3 indicated interrupt lines 0197 The UART includes 0198 16450 register set compatible UART 0199 9600 19 2K 38 4K 57 61K 115 2K 230 4K 460 8K and 921 6 Kbs UART baud rates 0200 RTS and CTS flow control signals for UART 0201 Direct Memory Access DMA for low overhead UART control 0202 The USB support includes 0203 USB version 2 0 compliant interface 0204 USB wakeup and detach sideband signals sup ported 0205 Direct Memory Access DMA for low overhead USB control 0206 The general purpose I O features 0207 Sixteen individually programmable general pur pose
49. sly directing input to the gateway device It integrates at least a speaker and volume control adapted for use as a remote speaker a fingerprint reader and a cursor control and trigger adapted to select and control resources of the console Glue logic invoked wire lessly by the remote control is adapted to connect the speaker to a sound reproduction module and connect the fingerprint reader to an authentication and personalization module that selects a user profile based on activation of the fingerprint reader and authentication of the user The personalization module adapted to present the user s personalized favorite media access present the user s personalized history lists automatically authenticate the user for digital rights manage ment automatically authenticate the user for communication access and automatically authenticate the user for electronic wallet reproduction of purchasing credentials 0023 An alternative to video operation of a camera is still operation of the camera The still camera may be wirelessly coupled to a photographic capture module running on another device which persists the pictures taken The persistence at theother device can simplify the remote and reduce its cost as only temporary buffering in the remote is needed 0024 An aspect of this disclosure that can be combined with any of the foregoing embodiments is remote on screen menu and controls display translating a device menu and controls display t
50. t of packet packet type links data and checksum Differ ent packet types are assigned to keyboard trackball finger print and LCD packets The start of packet field indicates that the packet starts here For instance Ox7C can be used as a start of packet flag A data field of just two bytes may be sufficient When the checksum contains an XOR ofall the data link and packet type fields the checksum field can be used to discard corrupted data packets 0229 Audio support enables the remote to act as a remote speaker and or microphone system for the host system Audio Jan 8 2009 support can be for mono stereo or other advanced sound reproduction modes The audio can function in an on the ear mode e g like a telephone headset with a headset or as a speaker phone These audio features can enable telephonic capabilities for voice place shifting audio from the host loca tion to another room or floor in a home private listening via a wired or wireless headset and multiple stream playback so that the audio reproduced at the remote is different from the audio reproduced on speakers wired to the host 0230 The LCD connected to the main controller uses the GPIO interface including data and control lines The LCD can be used to display data received over the wireless link The data could be received in an HTML or HTML subset format and rendered by a compact browser module Or a custom designed packet format could be used for LCD da
51. ta This format includes eight fields start of packet packet type link mode x position y position data and checksum The mode field indicates the mode in which the data is to be displayed This module operates in two modes a so called font mode and a byte mode Ina phone mode the given string is displayed on the LCD display in the predefined font shape and size In the byte mode the given date is displayed as raw data which allows the user to design their own shapes X and Y position coordinates indicate the row and column position on the LCD 0231 The remote control can duplicate the visual opera tion of an on screen display generated by a controlled device using a display on the remote The on screen display interface is designed to provide easy smooth seamless operation of the device However most remotes provide an array of buttons and much different interface than the on screen display Sometimes the array of buttons anticipates that no screen will be available for display Other times the manufacturer over builds the remote control They attempt to expose all of the functionality of the host device through individual keys on the remote The sheer number of keys sometimes pushes con trolled devices into states of operation that are surprising confusing and difficult to undo A high resolution display on the remote control can enhance the user interface For devices that accept keyboard or joystick mouse responses to an o
52. ts A software reset function is also available 0105 The keypad 8 13 matrix 406 is connected to the GPIO lines of P89LPC931 micro controller 404 The key pad has 8 return lines and 13 scan lines The return lines are connected to the keyboard port of the P89LPC931 micro controller The P89LPC931 is connected to the main proces sor LPC2132 through the I2C bus to minimize the number of pins on the main processor 0106 The custom software is loaded into the flash pro gram memory of the P89LPC931 micro controller which scans the keypad and generates ASCII codes and communi cates to the main processor through the I2C bus The P89LPC931 micro controller is normally kept in power save mode and it will awaken in response to keyboard interrupts after the key press The keyboard port of P89LPC931 has a change on status interrupt feature and hence any key press will generate the keyboard interrupt The key bounces are taken care of by the software 0107 The QWERTY keyboard may have a Chinese char acter entry feature and the software transfers the Chinese corresponding ASCH codes to the main processor in Chinese key entry mode 0108 The following tables describe interfaces among the CPU 100 keyboard controller 404 and matrix 406 Keyboard Controller to CPU Interface Signal LPC2132 P89LPC93 Remarks Serial I2C Data SDA SDA I2C interface Serial I2C clock SCL SCL I2C interface Keyboard Control
53. word from the VIC that identifies an FIQ source that is requesting an interrupt Vectored IRAs have middle priority Sixteen of the interrupts can be assigned to this category Any of the inter rupt requests can be assigned to any of the 16 vectored IRQ slots among which slot 0 has the highest priority and slot 15 has the lowest Non vectored IRQ s have the lowest priority 0063 The VIC combines the requests from all the vec tored and non vectored IRAs to produce the IRQ signal to the ARM processor The IRQ service routine can start by reading the register from the VIC and jumping there If any of the vectored IRAs are requested the VIC provides the address of the highest priority requesting IRAs service routine other wise it provides the address of a default routine that is shared by all the non vectored IRAs The default routine can read another VIC register to see what IRAs are active 0064 The LPC 2132 contains two UARTs 246 One UART provides a full modem control handshake interface the other provides only transmit and receive data lines The features of UART is listed below 0065 16 byte receive and transmit FIFO s 0066 Register locations conform to 550 industry stan dard 0067 Receiver FIFO trigger points at 1 4 8 and 14 bytes 0068 Built in baud rate generator 0069 Standard modem interface signals included on UART 1 0070 DC 244 is a bi directional bus for inter IC control using only two
54. work and even overseas They are untethered packing many features into a small form factor not requiring a console Another trend is to repackage a PC as media center complete with a wireless keyboard Recent announcements suggest interfac ing a Microsoft media center with a Bluetooth equipped cel lular telephone to use the sound reproduction ofa TV as a sort of speaker phone relying on the cellular telephone for net work connectivity In both instances the telephone features are untethered from and do not depend on availability of a console 0005 For developing countries and cost conscious buy ers the Treo and media center approaches are over built and too expensive An opportunity arises to provide a low cost integrated consumer electronics system that includes a novel Jan 8 2009 feature set and a cost effective allocation of technical tasks between a remote and a console SUMMARY OF THE INVENTION 0006 The present invention relates to a tethered digital butler consumer electronics product and method The teth ered digital butler of a price and form factor suitable for consumer electronics markets of developed and developing countries includes a communications and multi media con sole and a wireless remote The remote may resemble a hand held personal computer HPC a palm held personal com puter PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the con sume
55. y deliver the key to DRM enabled device Either memory on the remote a memory module or an identification reader combined with the remote may hold the DRM key The identification reader can read a smart card or similar module with memory or can read a fingerprint in order to authorize automatic use of the DRM key to exercise DRM evidenced rights When a user visits a neighbor s console they may take along their hand held remote and the associated digital rights for use on the neighbor s console or other device 0030 Another feature that can be combined with any of these embodiments is personalization based on a single action a swipe of the fingerprint reader Coupled wirelessly to the fingerprint sensor software is a personalization module If a user does not identify himself by swiping the fingerprint sensor then a generic profile is applied to personalization of music movies photos videos files and telephone access If the user swipes the fingerprint sensor then personalization can be applied analogous to switching users in current Win Chip Name Main processor 100 Keypad controller 122 LCD Display module 133 TrackBall 123 Jan 8 2009 dows XP implementations This degree of context shifting based on a single action at a remote control is believed to be new and unique The personalization may include favorite channels movies shows in a streaming video environment favorite music photos or video in an on de
Download Pdf Manuals
Related Search