Final report - Atomic Rhubarb
Contents
1. CWY tM Ne Dean VN t MOU m a ee ee _ ee og Bee JP3 Vaice Direct Module DONDU A w CON13 b The Hardware Connection for VoiceDirect Stand AloneTest Figure 13 Stand Alone Test for VoiceDirect Hardware 18 3 1 2 VOICEDIRECT Driver Development for Z8 The VoiceDirect can output the signals of OUT1 OUT8 to communicate with Z8 microcontroller through the connections to Z8 GPIOs I use PFO PF7 to connect VoiceDirect OUT1 OUTS8 as shown in Figure 14 Rw Pt MO YH CK OAKR WM t MU a a aPUN gs as eee JP3 Naice Direct Nadule CONJA opera RMT ON H O Don win OU 28 Board b Hardware Connection for VoiceDirect Communication with Z8 Figure 14 Hardware Connection for VoiceDirect Communication with Z8 19 The following driver code snippets show how Z8 communicate with VoiceDirect The total 15 words are represented in binary form as shown in Table 2 and decoded as follows define VOICE COMMAND 1 0x01 define VOICE COMMAND 2 0x02 define VOICE COMMAND 3 0x04 define VOICE COMMAND 4 0x08 define VOICE COMMAND 5 0x10 define VOICE COMMAND 6 0x20 define VOICE COMMAND 7 0x40 define VOICE COMMAND 8 0x80 define VOICE COMMAND 9 0x81 define VOICE COMMAND 10 0x82 define VOICE COMMAND 11 0x84 define VOICE COMMAND 12 0x88 define VOICE COMMAND 13 0x90 define VOICE COMMAND 14 0xA0 define VOICE COMMAND 15 0xC0 Initialize the ports for Voice Direct speech recognition2. The SDA pin is open drain SQW is used for square wave output The DS1307 Serial RTC is a low power full binary coded decimal BCD clock calendar plus 56 bytes of NV SRAM Address and data are transferred serially via 2 wire bi directional I C bus DS1307 address map and timekeeper registers are shown in Figure 10 am BITO 00 59 00 59 O1 12 00 23 17 01 28 29 01 30 01 31 j 01 12 00 99 Figure 10 DS1307 Address Map and Timekeeper Registers 2 1 5 MAX6610 Temperature Sensor The MAX6610 is precise low power analog temperature sensors combined with a precision voltage reference as shown in Figure 11 An 8 bit ADC s LSB is equal to 1 C while a 10 bit ADC s LSB corresponds to 0 25 C The MAX6610 operates from 3 0V to 5 5V and has a 2 560V reference output Power supply current is less than 1504A The MAX6610is available in a 6 pin SOT23 package and operate from 40 C to 125 C TOP VIEW MAXIM o MAX6610 cno 2 max6611 SOT23 Figure 11 MAX6610 Temperature Sensor Configuration 14 2 2 6 Parts List Table 3 contains the part numbers used for this project Part Name Quantity Description Z8 Encore Development Kit 1 Development package VoiceDirect Board 1 Speech recognition board SpeakJet 1 Speech synthesis chip Switch 2 Control speech recognition and Training SparkFun Real time Clock Module 1 Real time clock and calen
3. 5 hardware decoding circuits is applied to Word 6 Output 6 get word 9 and word 15 Word 7 Output 7 Word 8 Output 8 Word 9 Output 8 and Output 1 Word 10 Output 8 and Output 2 Word 11 Output 8 and Output 3 Word 12 Output 8 and Output 4 Word 13 Output 8 and Output 5 Word 14 Output 8 and Output 6 Word 15 Output 8 and Output 7 2 1 3 SpeakJet Speech Synthesis Chip The SpeakJet is a completely self contained single chip voice and complex sound synthesizer as shown in Figure 7 SpeakJet uses Mathematical Sound Architecture MSA technology which controls an internal five channel sound synthesizer to generate on the fly unlimited vocabulary speech synthesis and complex sounds without the use of analog or digitally recorded samples The SpeakJet has a built in library of 72 speech elements allophones 43 sound effects and 12 DTMF Touch Tones Through the selection of these MSA components and in combination with the control of the pitch rate bend and volume parameters the user has the ability to produce unlimited phrases and sound effects with thousands of variations at any time The SpeakJet can be controlled simultaneously by logic changes on any one of its eight Event Input lines and or by a Serial Data line from a CPU such as Z8 or PC allowing for both CPU Controlled and Stand Alone operations Other features include an internal 64 byte input buffer internal programmable EEPROM three programmable outputs and direct user
4. SpeakJet As the SpeakJet is vocalizing this list of allophones MSA actively and continuously calculates all the sound components of the allophones including the transitional sounds made between the allophones producing the same sounds that the human mouth does as it moves one position to another position Selecting the appropriate combination of allophones and pauses can thusly create any English word or phrase Further tuning with the Rate Pitch Bend and Volume parameters adds to the delivery of the phrase and can change the emotion in which the phrase is perceived Stressing the Rate Pitch Bend and Volume parameters to levels outside the human range can result in some interesting sounds that go way beyond what a normal human mouth can produce In addition several other sounds effects which are included in the MSA Sound Component Database of which some use vocalization and some do not can be integrated into the phrases 27 The result is a system that gives the user the ability to not only produce an unlimited vocabulary but also to produce slang gibberish moans groans yodels and other weird vocalized sounds not normally included in a canned TTS system All allophones in this final project are edited directly by hands and PhaseALator software These allophones mainly contain temperature time calendar songs etc Although allophones are mainly used for English language they can be used for simulation of some foreign language
5. access to the internal five channel sound synthesizer VOut DO Ready D1 Speaking D2 Buffer Half Full V MO M1 Rst RCX Figure 7 SpeakJet Chip Left and Pinout Right 12 The SpeakJet pin details and electrical specifications are shown in Figure 8 Pin Description _ Functional Details 1 RCWE7 Event Input 7 Electrical Specifications RCO EG Event Input 6 pond popes 2 0 to 5 5 VDC 3 ES Event Input 5 Idle lt 5ma Plus loads E4 Event Input 4 Speaking lt 5ma Plus loads Gnd Ground Event Input 3 Sink Source Current Event Input 2 Outputs 25ma Event Input 1 AI inputs levels EOC Event Input 0 ipo oe Serial Input_ TTL 0 0v to Vcc EEPROM 11 Master Reset Max Write cycles Typical 1 000 000 times 12 Mode Select 1 Baud Configure 13 MO Mode Select 0 Demo Mode Mechanical Specification Power input 2 0 to 5 5 volts DC Thermal storage 60 to 140 Degrees C D2 Buffer Half Full Data Out 2 External Buffer Half Full Internal Thermal operating 18 to 60 Degrees C D1 Speaking Data Out 1 External Speaking Internal ai DO Ready Data Out 0 Data c 0 External Ready riemay T Ready Internal Jhe harma capes ip po alg and te vou Voice Output Le Song SB nS omp Figure 8 SpeakJet Pin Details and Electrical Specifications In the final project Event Input E0 E7 is not used and must be connected to GND The Serial Input RCX is used to communicate between
6. board void init_ VoiceDirect void initialize Port F 0 7 PFADDR 0x02 PFCTL amp 0x00 no alterate function PFADDR 0x01 data direction PFCTL amp 0x00 clear PFCTL OxFF input PF 0 7 Interpret the word code and take corresponding action switch PFIN case VOICE COMMAND _1 action1 break case VOICE COMMAND 2 action2 break case VOICE COMMAND 15 action15 break default break 3 2 Speech Synthesis SpeakJet chip is used for speech synthesis in this project Firstly hardware structure needs to be tested and verified Then the driver for Z8 needs to be written for communication between SpeakJet and Z8 microcontroller 3 2 1 SpeakJet Chip Stand Alone Test SpeakJet speech synthesis chip is connected in the demo i e stand alone mode as shown Figure 15 a and b The Z8 in the figure is only used to be a power supply and ground connection In such a mode if all hardware works well SpeakJet will play the demo sounds 20 ps Smo GPIO 28 o a The Schematic b The Hardware Connection Figure 15 Hardware Test for SpeakJet Demo Mode 3 2 2 SpeakJet Driver Development for Z8 SpeakJet provides Serial Input and Event Inputs to communicate with Z8 microcontroller through Z8 GPIOs In Figure 16 Z8 s PGO and PG1 connect to SpeakJet DO and D1 CTSO PA3 alternate function connects to D2 Serial data line TXDO in Z8 board is u
7. numbers and 9 basic high digit numbers from 10 to 60 all the allophones for these basic phrase elements are first stored in the ROM When used they will be copied into the RAM The following function shows how to compose the speech of the time void SpeakTime unsigned char hour unsigned min int am 28 unsigned char tmp MAX CODE LEN Ic T1 TO lc copy_data_digitCode speech CODE_1 hour 0 if min lt 20 lc copy_data_digitCode speech CODE_1 min Ic else T1 Gnt min 10 TO int min 10 lc copy_data_digitCode speech CODE_10 T1 2 Ic copy_data_ digitCode tmp CODE_1 TO 0 datacat speech tmp Ic lens T0 Ic lens T0 if am datacat_rom speech s_ AM Ic LEN AM else datacat_rom speech s_ PM lc LEN PM puts speech Speak the time The calendar phrases contains more elements including day date month and year Likewise the calendar speech code strings can be composed by these elements using similar methods 3 6 System Integration and Main Application Flow Chart The system integration contains two aspects hardware integration and software integration Hardware components are integrated as shown in Figure 2 and Figure 12 Software modules are integrated into one main application based on the software design block diagram in Figure 3 This application includes 12 sub applications corresponding to 15 voice commands In this VoiceDirect board for the final project sin
8. pronunciation 3 5 1 Temperature Allophone Editing The temperature phrase contains two major parts One is the numerical phrase The other is just degree word The allophone code of the degree can be directly translated from PhaseALator However numerical phrase should be composed with 10 basic digit numbers i e 0 1 9 and 9 basic high digit numbers like 10 20 90 100 1000 In this project all the allophones for these basic phrase elements are first stored in the ROM When used they will be copied into the RAM The following function shows how to compose the speech of the temperature degree void SpeakTemperature float temperature int T T1 TO lc unsigned char tmp 20 T int temperature 0 5 if T gt 0 if T lt 20 lc copy_data_digitCode speech CODE_1 T 0 datacat_rom speech s_ degree lc LEN DEGREE else T1 int T 10 TO int T 10 lc copy_data_digitCode speech CODE_10 T1 2 0 copy_data_ digitCode tmp CODE_1 TO 0 datacat speech tmp Ic lens T0 datacat_rom speech s_ degree lc lens T0 LEN DEGREE puts speech Speak the temperature 3 5 2 Time Calendar Allophone Editing The time phrase contains two major parts One is the numerical phrase The other is just AM or PM word Likewise the allophone code of the AM or PM can be directly translated from PhaseALator Numerical phrases are composed with 10 basic digit
9. 6610 temperature sensor microphone switches and speakers is shown in the following schematic for the design in Figure 2 IP 1 CONI IP3 Vaice Direct Madule CON14 eee OOO NOU BL uno IPe CON19 y 45u LAND wont Om tw Ps ee Pe Pe l m o L Z8 Board a MAx661i 0 RTC Module a The Formal Schematic for the Design Final Version A o SBC 6 SPA CPAT b The Schematic Scratch Work Progress Figure 2 The Schematic for the Design 1 3 The Software Design The software is designed for four major modules Speech Recognition Manager Sensor Manager Speech Synthesis Manager and Driver Manger The block diagram of the overall software design is shown in Figure 3 as follows Speech Recognition Manager Speech Recog inition Voice Command Determi nation Temperature time date name etc Sensor Manager Data Display Data Preprocessing for Speaking 2 Specifications 2 1 Hardware Modules Speech Synthesis Manager Allophone Editing Speech Synthesis Figure 3 The Block Diagram of the Software Design Driver Manager SpeakJet Driver LED Display Driver Temperature Driver Real time Clock Driver Speech Recognition Board Driver The project design consists of five main hardware modules Z8 Encore Flash Microcontroller Development Kit VOICEDIRECT speech recognition board SpeakJet speech synthesis chip Sparkfun DS1307 Real Time Clo
10. SpeakJet and external devices such as Z8 PA5 TXD0 on Z8 board is connected to RCX Voice Output VOut modulates the SpeakJet s voice on a square wave carrier of 32khz 2 1 4 DS1307 Real Time Clock RTC Module This is a custom designed module for the DS1307 Real Time Clock as shown in Figure 9 The module comes fully assembled and pre programmed with the current time The included Lithium coin cell battery CR1225 41mAh will run the module for a minimum of 9 years 17 years typical without external 5V power The DS1307 is accessed via the PC protocol It provides seconds minutes hours AM PM day month date year leap year compensation accurate calendar up to year 2100 1Hz output pin and 56 Bytes of non volatile memory available to user vcc SQW Out SCL Batt BTI 3 3V 31lmAh Header 5 iH i Figure 9 RTC Module Left and RTC Module Schematic Right 13 Vear is a battery input for any standard 3V lithium cell or other energy source Vcc is the 5V input When 5V is applied within normal limits the device is fully accessible and data can be read and written When a 3V battery is connected to the device and Vcc is below 1 25xVpat reads and writes are inhibited However the timekeeping function continues unaffected by the lower input voltage SCL Serial Clock Input is used to synchronize data movement on the serial interface SDA Serial Data Input Output is the input output pin for 2 wire serial interface
11. The George Washington University Department of Computer Science CS339 Final Project Project Final Report Z8 Speaks Apr 25 2006 Duoduo Liao dliao gwu edu Table of Contents Project Abstract oiin cass cesta ants aaeisitx aa lads eden Giada Cotton ean isi E ea aa a 4 Project PSEA CC ea ctee tea aa scan Ona A E ya cease EE EA ae uae nse ta 4 PTO SOE Stats Foo sk ee ecto Os aaa Da hat sa O ea See ae Reet aay 4 FDesipi MCL VI CW rs doecaceesh Sexes oads ise Ch sa sareusl aS acd a a a a mslaiared 4 1 1 The Purpose and Requirements 4 2 s aticsciestectshactenie tera anae wadiardcadivee 4 1 2 The Hardware esti cesta season tetas sateen pecs eas ails wey foci ani kde a teeing 5 1 2 1 The hardware block Gig OV Gin occas aunsarsasdesce ee toea ced eadess neni dein addin aie 5 1 3 The SOP Ware DESI OI fifo ols elacracetcansstectncnsteagcasticansalicuadesluendnetueaieaisanicniaaincuas 7 2 Sp cifications iG ose Gates ta Naa cn ei a Sa aa Gc A E REE EK alt aU ie Rel 8 21 Hardware Mod les adserseni enee ee E EE a aeie 8 2 1 1 Z8 Encore Flash Microcontroller Development Kit c cscsccsssscsessesseseeseeseeses 9 2 1 2 VOICEDIRECT Speech Recognition Kit cccccscccsccsssccsssecsscesscsecceescecsecseccesseeesaeees 9 2 1 3 SpeakJet Speech Synthesis Chip e sessssssessessssessessssseessesseeseesseessesrssresseeseeseessee 12 2 1 4 DS1307 Real Time Clock RTC Module ccccccccccescccsssscesssscesnsscsenscesnsscesneees 13 2 1 5 MAX6610 Temperatur
12. ce OUTS PIN16 does not work the Command 5 and Command 13 cannot be executed In my program Command 4 is not used either Thus the total 12 voice commands or questions are listed as follows 1 Command 1 welcome Hello 2 Command 2 temperature Can you tell me the temperature 3 Command 3 time What time is it now 4 Command 6 date Can you tell me the date 5 Command 7 name What s your name 6 Command 8 day What day is today 7 Command 9 math 7 plus 8 8 Command 10 sing Can you sing 9 Command 11 music pa pa clap the hands 10 Command 12 goodbye Thank you Bye bye 11 Command 14 set the time Reset the time 12 Command 15 Ni Hao Ni Hao Hello in Chinese The flow chart of the main application for Z8 Speaks final project is shown in Figure 18 as follows 29 START Initialization Train Record Train Record Voice Commands Speak Commands Speech Recognition Command 5 Not Used Display Command 9 Command 10 Command 11 Command 12 Goodbye Not Used Command 13 Command 14 Command 15 Figure 18 The Flow Chart of Z8 Speak Main Application 30 4 Conclusions The Z8 Speaks System is a hardware software mix project It integrates Z8 microcontroller speech recognition speech synthesis real time clock temperature sensing LED display timer control and other hardware and software module technologi
13. ck Module and MAX6610 temperature sensor The main hardware components for Z8 Speaks are shown in Figure 4 Breadboar MAX6610 Temperature Sensor Z8 Encore Development Board Figure 4 Main Hardware Components of Z8 Speaks 2 1 1 Z8 Encore Flash Microcontroller Development Kit The Z8 Encore Flash Microcontroller Development Kit allows the user to design and evaluate projects using the eZ8 microcontroller The kit contains a Z8F6423 module which contains the Z8F6423 device running at 18 432 MHz with 64 Kbytes of Flash memory and 4 Kbytes of register RAM This evaluation board provides 12 channel 10 bit A D converter four 16 bit timers a watch dog timer 60 General Purpose I Os GPIO and 24 vectored interrupts The board also contains SPI I2C and 2 UART ports with IrDA encode decoder 3 channel DMA controller four 7x5 LED arrays three pushbuttons and embedded modem socket Furthermore it contains Zilog s proprietary ZDS II for debugging and programming The adapter provides 9VDC for the evaluation board The board supports 3 0 3 6V operating voltage with 5V tolerant inputs 2 1 2 VOICEDIRECT Speech Recognition Kit VOICEDIRECT Speech Recognition Kit includes speech recognition board as shown in Figure 5 one microphone one speaker three microswitches and two 100KOhms resistors VOICEDIRECT is a speaker dependent speech recognition module allowing training of up to 15 words Using sophisticated speech re
14. cognition technology VOICEDIRECT maps spoken commands to system control functions Each time one of the words is recognized a corresponding output pin on the module is toggled for one second ete Se ber lt A E i fas By H 3 nh Rha me y a oz Voice Direct Module CONI 4 E 3 4 3 6 7 B 9 1g Nnonont ano O nonwnt nwa Figure 6 VOICEDIRECT Pinout The module pinout layout is shown in Figure 6 and major module pinout used for this project is listed in the Table 1 as follows 10 Table 1 Major Module Pinout Name Module Pin Description Connection T O PREAMP IN JP2 1 Microphone Input Connect to microphone other microphone I Connection connection to GND MIC BIAS JP2 2 Mic Bias Elec If powered mic being used NC otherwise I Microphone connect JP2 1 AGND JP2 3 5 Analog Ground For GND noise reasons analog and digital grounds should connect together only at VOICE DIRECT 5V JP2 4 5 Volt Power VCC Supply Connection PWMI1 JP2 6 Pulse Width Connect to 8 32Ohm speaker Provides O Modulator Output 1 approximately 0 15 Watts of audio power multiplexed into 32 Ohms PWMO JP2 7 Pulse Width Connect to 8 32Ohm speaker Provides O Modulator Output 0 approximately 0 15 Watts of audio power into 32 Ohms DAOUT JP2 8 Analog Output High impedance 22kOhm analog audio unbuffered output Must be powered amplified to
15. dar MAX6610 Analog Temperature Sensor 1 Analog temperature sensor Microphone 1 For speech recognition Speakers 2 For speech recognition and synthesis output Breadboard 1 For prototyping design and test Wires many For connection 2 2 Software Modules As shown in Figure 3 all hardware control and application software modules listed in the block diagram of the software design are written by myself in C based on Z8 SDK All of them are compiled on Zilong XTools ZDS II Z8 Encore Family 4 9 6 build 05110402 ZDS II runs on the Windows XP platform In addition PhaseALator is used for some basic English words or phrases editing for SpeakJet Allophone code creation The detailed software module development will be discussed in Section 3 Implementation amp Construction 15 3 Implementation amp Construction The hardware construction is exactly followed by the schematic for the design in Figure 2 Figure 12 shows the final Z8 Speaks system Speaker Real time Clock Module hy MAX6610 Z Temp Sensor Switch for training Switch for recognition VoiceDirect Speaker bd bd Microphone Figure 12 The Final Hardware Connection for the Z8 Speaks System 16 During the system development for each major part or module needs to be tested on both hardware and software side respectively In the following sections the main modules including hardware test and software development will be discussed in details Thes
16. drive a speaker and should be low pass filtered O with a corner frequency around 20KHz Better speech quality than the PWM output Recommended for applications requiring either louder volume or better speech quality RECOG JP2 10 Recognition To start recognition pull sensitivity selection the RECOG line to GND To erase all and active for at least 100ms To erase recorded I recognition all recorded words pull words pull both the TRAIN and both the RECOG pins to GND for TRAIN and at least 100ms RECOG pins TRAIN JP2 11 Training sensitivity To start training pull the to GND for at I selection and active TRAIN line to GND forat least 100ms training least 100ms OUT1 OUT7 JP2 12 18 Stand Alone mode Connect to user application s control lines O output ports 1 7 HIGH OUT8 JP2 19 Stand Alone mode Connect to user application s control lines O output ports 8 In this project TRAIN open circuit mode is used for pin configuration This is relaxed training mode easier to train accepts more similar sounding words i e fewer rejections 11 Table 2 15 Words and Corresponding Pinout Since the module can recognize 15 words but only has 8 output pins word Worl ee 9 through 15 are represented in binary Word3 Output 3 form as show in the Table 2 on the right Word 4 Output 4 Software decoding method instead of Word 5 Output
17. e main modules are speech recognition speech synthesis real time clock reading and setting temperature driver and reading and phrase allophone editing All other modules such as LED display timer control in the software block diagram as shown in Figure 3 can be implemented as easily as in the basic real time embedded system Their details will not be given in this report At the end of this section the system integration and flow chart will be described 3 1 Speech Recognition VOICEDIRECT board is used for speech recognition in this project Firstly hardware structure needs to be tested and verified Then the driver for Z8 needs to be written for communication between VOICEDIRECT and Z8 microcontroller 3 1 1 VOICEDIRECT Board Stand Alone Test VoiceDirect speech recognition board is connected in the stand alone mode as shown Figure 13 a and b The Z8 in the figure is only used to be a power supply and ground connection In b push left button at least 100ms training will begin VoiceDirect will prompt Say word x where x is number from 1 to 15 corresponding to the word to be trained After training push right button the VoiceDirect will prompt Say a word If the word matches the training records the VoiceDirect will return to say the number of the word record Otherwise it will return Word not recognized Through this test hardware configuration and connection for the VoiceDirect board can be verified 17
18. e Sensor 3scives dccieessncacessadasguattulsvelaasacevenseccuastuaaccvessadecs 14 Pie Od arts Libon uten a a a E cea E T Sahai icaces 15 Ded SoftWare Modules a ara aia e E E EA E AEE A RESE 15 3 Implementation Se Construction sssssesessseesseseseesseesseseessesresersstessesststssessessessressesne 16 SL Speech Recopniti n siner eerren iei a aE EE AE EEE A 17 3 1 1 VOICEDIRECT Board Stand Alone T OS cassis ies ee ctl hahaa ae ae caso ua Ronee 17 3 1 2 VOICEDIRECT Driver Development for Z8 viccsscccsvascasscesenssencdssesensasndesndasacsevannes 19 BvD Speech Synthesis n esir eera done baton cuted suo eddes E E AA SE 20 3 2 1 SpeakJet Chip Stand Alone Test scccivcrctinsess dankievac cath stivialsidng hia caciehusaliatowies 20 3 2 2 Speake Driver Development for Z8 lt ccies cossudsvecise sade caetagvnkaeacdenaistaonteaeesetss 21 3 3 Real time Clock Reading Setting aos sad ates Olena aicia sea nuietenue anaes 23 BST PPGIOCOUC OMIT O Tai cpein sistas shichias shi ahies tanleettanedetuccia dev Reltncsrtese aeeieta 23 332 Data Transfers taich case docms arts ERE E RA E nad doers tundscacbsreaks 24 3 3 3 Time Calendar Reading Setting exits ealpenaksieieals ida ceh an guia cena ue cunacidiess 25 3 4 Temperature Driver and Reading 5 case tecdtaiveccuccecerecests osen serena eieaaneaene 26 3 5 Phrase ANG phOne BOING icssesiaceincecinsesaceduntasasces tani Ea E AR A EASE 27 3 5 1 Temperature Allophone Editing 0eneseeneeseneseeseesesssesseser
19. ed in Section 2 1 5 The MAX6610 configuration and schematics for Z8 are shown in Figure 11 and Figure 2 respectively The driver for communication to Z8 microcontroller contains ADC initialization and calculation for the temperature as shown in the following code functions ALGO PBO port is used for temperature input to Z8 Initialize the ADC void init ADC int mode PBADDR 0x01 set up port B to use as ADC input PBCTL 0x01 PBO PBADDR 0x02 Port B alternate function PBCTL 0x01 enable PBO ANAO ADC INPUT 0 ADCCTL 0x90 ADC Control Register CEN 1 0 VREF 0 CONT 1 ANAIN 0000 26 IRQOENH 0x01 Set Interrupt Highest Priority IRQOENL 0x01 SET _VECTOR ADGC isr_adc set the interupt vector EIQ CEN will be 0 at first complete conversion result 5129 24 system clock cycles while ADCCTL amp 0x80 Do nothing but wait for the end of the first A D conversion Interrupt routine ADC interupt pragma interrupt void isr_adc void adc_data calADC unsigned int calADC void get temperature unsigned char tmp unsigned int data tmp ADCD L get low bits tmp gt gt 6 move to the right side tmp amp 0x03 clean up data ADCD_H data lt lt 2 move to the left side data amp 0x03FC clean up data tmp ADC value return data 3 5 Phrase Allophone Editing To produce speech a list of selected allophones is sent to the
20. es The overall work for the final project works very well as planned in the project proposal This final work makes the user be able to interact with Z8 Speaks i e a talking robot over the speech communication The final project meets very well all the proposed requirements such as read the temperature from ADC temperature sensor read the Real Time Clock RTC using I2C bus control the speech recognition board using GPIO and hardware switches and control speech synthesis through serial data line In addition more voice operations and speech controls are added into the final project beyond the proposal Just as described in Section 3 Implementation and Construction each step is an important design decision I made for this project After each step passes test and verification the system can be integrated correctly In summary these decisions are as follows e Test and verify speech recognition gt VOICEDIRECT board stand alone test gt OICEDIRECT driver development for Z8 e Test and verify speech synthesis gt SpeakJet chip stand alone test gt SpeakJet driver development for Z8 e Test and verify SparkFun real time clock module gt Driver development through I2C gt Time Calendar management e MAX6610 Temperature Driver development through ADC e Phrase allophone editing e System integration and main application development During my implementation strictly following each step not only made all of them work very well but als
21. lterate function PA3 CTSO PA5 TXDO PAADDR 0x01 data direction PACTL amp 0xD7 ouput PA3 CTS0 PAS TXDO UOBRH char BRG1 gt gt 8 UOBRL char BRG1 amp Oxff UOCTLO UART_TXD_EN Transmit enable No Parity 1 Stop Input the speech string into SpeakJet through serial data line void Speak char speech puts speech In this project I directly use Allophones to edit any speech For example the following allophone code string represents the English speech Welcome to Z8 Speaks unsigned char s welcome LEN_ WELCOME 252 252 147 159 194 134 140 8 191 162 8 167 128 128 154 4 191 187 198 8 128 196 187 1 Welcome to Z8 Speaks 22 3 3 Real time Clock Reading Setting SparkFun Real time clock module is used for read set the time or calendar in this project RTC hardware specifications are described in Section 2 1 4 The schematics for SparkFun DS1307 RTC module is shown in Figure 9 The driver for communication between RTC and Z8 microcontroller contains the IC protocol data transfer and time calendar reading or setting These will be described in detail in this section 3 3 1 PC Protocol Control TC protocol is used for this module to communicate with Z8 microcontroller board The following functions are used for IC communication Note that DS1307 operates in the regular mode 100KHz only Mntialize I2C Interface void init_I2C void BRG 18432KHz 4 100KH
22. o reduce mistake or errors further accelerated the whole project development This further proves that decision making is the key for the development This is also one key point I learnt from this project In addition what else I have learnt from this project is as follow e Hardware design and Z8 programming e Speech recognition board use and development e Speech synthesis chip use and development e I2C control of Real time Clock e ADC control of temperature sensor 31 5 Attachments List The list of the attachments for this final project is as follows Data Sheets 1 Sensory VoiceDirect Speech Recognition Kit hardcopy 2 SpeakJet User s Manual PDF 3 DS1307 64x8 Serial Real Time Clock PDF 4 SparkFun RTC Module Schematic PDF 5 MAX6610 6611 Temperature Sensors and Voltage References PDF Source code 1 Speaks ZDSPROJ file 2 main c main h 3 gpio c gpio h 4 adc c adc h 5 timer c timer h 6 eeprom c eeprom h 7 12C c I2C h 8 rtc c rtc h 9 speakjet c speakjet h 10 voicedirect c voicedirect h 11 zsldevinit asm Demonstration Video 13MB Liao_z8Speaks_320x240 mpg 13MB Reports Project proposal PDF Project Status Report PDF Final Project Report Z8 Speaks PDF Project Summary brochure PDF 32
23. of this project is to create a Z8 speaks It has the capabilities to display current temperature real time date day time name and other information on the LEDs in the Z8 board upon spoken request as well as speaking corresponding information The Z8 Speaks mainly consists of Z8 microcontroller board VOICEDIRECT speech recognition board SpeakJet speech synthesis chip real time clock and temperature sensor The Z8 microcontroller will control temperature reading RTC _ reading writing speech recognition speech synthesis and output The proposed requirements that the project must meet are Read the temperature from ADC temperature sensor e Read the Real Time Clock RTC using I2C bus e Control the speech recognition board using GPIO and hardware switches e Control speech synthesis through serial data line e Control LED display with corresponding information e Interact with the user over the speech communication 1 2 The Hardware Design 1 2 1 The hardware block diagram The block diagram of overall hardware design is shown in Figure 1 as follows VOICEDIRECT SpeakJet Speech Speech recognition board synthesis chip GPIO Serial Data Line GPIO Z8 Microcontroller git Microphone Speaker Temperature Sensor Real time Clock Figure 1 The Block Diagram of Hardware Design 1 2 2 The Schematic for the Design The interfacing of the Z8 microcontroller to the VioceDirect board SpeakJet chip RTC module MAX
24. ransfer The DS1307 device address is 7 bit 1101000 The last bit is for direction 0 for write and 1 for read The definition of the device identification code in the program is as follows define EEPROM Read Address 0xD1 12C EEPROM Read Address define EEPROM_ Write Address 0xD0 12C EEPROM Write Address The data transfer between Z8 and RTC is followed by 2 wire serial data bus That is the bus is controlled by Z8 microcontroller that generates the serial clock SCL controls the bus access and generates the START and STOP conditions The DS1307 operates as a slave device on the serial bus Access is obtained by implementing a START condition and providing a device identification code followed by a register address Subsequent registers can be accessed sequentially until STOP condition is executed Each receiving device when addressed is obliged to generate an acknowledge after reception of each byte The DS1307 data write and read are shown in Figure 17 lt SlaveAddress gt amp lt Data n gt lt Dataine t gt lt Data n 2 gt lt Pata n4 X gt s 1101000 a Ta Dooooxxx a xxxxxxxx a oooxx A XXXXXXXX A P S START DATA TRANSFERRED A ACKNOWLEDGE X 1 BYTES ACKNOWLEDGE NOTE LAST DATA BYTE IS P ST FOLLOWED BY A NOT ACKNOWLEDGE A SIGNAL A NOT ACKNOWLEDGE FUW READ WRITE OR DIRECTION BIT ADDRESS Dih a Data Read A Z lt Slave Address gt Y lt Word Address n gt l
25. sed to connect the RCX in SpeakJet In this project any Event Inputs are not used so all of them connect to GND amp vec 54 T SpeakJet cu Figure 16 The Schematic for SpeakJet Communication with Z8 21 The SpeakJet can receive the commands that can be any of 256 commands listed in the Table D amp E in the attachment A SpeakJet User Manual There are 7 operational groups of commands SCP Allophones Sound Effects DTMF Pauses Levels and Controls In this project SCP commands are not be used Thus each command received is buffered into a 64 byte input buffer and executed by the MSA in FIFO Serial Data is the main command of communicating with the SpeakJet to execute commands or create voices and sounds The SpeakJet serial configuration is fixed at 8bits No parity and 1 stop bit and non inverted The SpeakJet can be configured to accept Baud rates from 2400 to 19200 The factory default setting is 9600 baud In this project default setting is used Therefore the key for SpeakJet Z8 driver development is make serial data line TXDO work The driver code snippets are as follows define FREQ 18432000 18 432MHz define BAUD1 9600 9 6K baud for UARTO define BRG1 FREQ unsigned long BAUD1 16 define UART_TXD_EN 0x80 initialize SpeakJet speech synthesis chip Initialize the ports void init_SpeakJet void initialize Port PA3 and PAS PAADDR 0x02 PACTL 0x28 a
26. ss if 112C_AckNack wait for ACK NACK from EEPROM return 12C_Transmit_Data_Empty wait for transmit buffer empty I2C_write_byte data EEPROM Write data if 112C_AckNack wait for ACK NACK from EEPROM return 12C_Transmit_Data_ Empty wait for transmit buffer empty I2C_stop 0 12C Stop if 112C_AckNack wait for ACK NACK from EEPROM return 3 3 3 Time Calendar Reading Setting DS1307 Address Map and Timekeeper Registers are shown in Figure 10 The following function shows how to read the time and calendar from RTC define SECOND 0 define MINUTE 1 define HOUR 2 25 define DAY 3 define DATE 4 define MONTH 5 define YEAR 6 Read data from DS1307 RTC through I2C unsigned char Read_RTC int mode unsigned char data tmp tms data ReadEEPROM mode if mode HOUR if data amp 0x20 AM 1 AM else AM 0 PM tmp data amp 0x10 tmp gt gt 4 tms data amp 0x0F data tms tmp 10 else if mode DAY data amp 0x07 else tmp data amp 0xF0 tmp gt gt 4 tms data amp 0x0F data tms tmp 10 return data Likewise using function WriteEEPROM mode address can set the time or calendar 3 4 Temperature Driver and Reading MAX6610 analog temperature sensor is used for temperature reading in the final project I directly use MAX6610 sensor on the Lab3 board for this project MAX6610 hardware specifications are describ
27. ssressessesersseesseseese 28 3 5 2 Time Calendar Allophone Editing 5 jsaxiceesch sea Sirducecsseandeatospevteoenseenteawnsnand Sarees 28 3 6 System Integration and Main Application Flow Chart cceccccseeseeseeeseeeeteee 29 4 COGTICTIST OTIS i acca cesiCats staid Sadly ta and a a aa ek a derw duane eases 31 SACHA ETE INS LAGE et sry Wo as See a Naa A EEA A 32 Table of Figures Figure 1 The Block Diagram of Hardware Desigt eceseesesseereeeeceeecesecneeeneeeeeneeeeees 5 Figure 2 The Schematic for the Design 5 155 1ianvans2cvderssetaewsvy sabantagh dnatdardavaeecresnereceasts 7 Figure 3 The Block Diagram of the Software Design s sssssssessssserssssessessrsersessesesseseese 8 Figure 4 Main Hardware Components of Z8 Speaks ss ssensssssssessseseesseeseeseesseeseeseessesse 9 Figure 5 VOICEDIRECT Board front and back ssnsssessseeseesessseessesessseseessesersseesseserss 10 Figure 6 VOICEDIRECT Pinout i5 lt iivcicesstanigectalegrivartege Gaadinssene tug ntalin ics a aaa aiias 10 Figure 7 SpeakJet Chip Left and Pinout Right eee ceecesesseceteeneeeneeeeeeeeceaeenseeneeess 12 Figure 8 SpeakJet Pin Details and Electrical Specifications 20 0 0 ceeeeeceeseceteenetreeeneees 13 Figure 9 RTC Module Left and RTC Module Schematic Right cee ecceeeeeeeees 13 Figure 10 DS1307 Address Map and Timekeeper Registers cccceseeeseeeseeeteeeseeeees 14 Figure 11 MAX6610 Temperature Sensor Config
28. t Data n gt lt Data n 1 gt lt Data n X gt s 1101000 Fo A 20000000 A 2000000K a DOxxxxxx a XXXXXXXX A S START A lt ACKNOWLEDGE DATA TRANSFERRED P STOP X 1 BYTES ACKNOWLEDGE RAW READ WRITE OR DIRECTION BIT ADDRESS D0h b Data Write Figure 17 DS1307 Data Transfer 24 The following code snippets show how the data transfer works i e read write based on I2C protocol unsigned char ReadEEPROM unsigned char addrL unsigned char data I2C start 12C Start I2C_write_ byte EEPROM Write Address EEPROM Address Write 12C_Transmit_Data_ Empty wait for transmit buffer empty 12C_Transmit_Data_ Empty wait for transmit buffer empty I2C_write_byte addrL LSM EEPROM Address if 112C_AckNack wait for ACK NACK from EEPROM return 12C_Transmit_Data_Empty wait for transmit buffer empty I2C start 12C Start if 112C_AckNack wait for ACK NACK from EEPROM return I2C_Send_NACK 0 send NACK to EEPROM I2C_write_byte EEPROM Read_Address EEPROM Address Read I2C_Receive_ Data Full wait for receive data data 12C_read_ byte EEPROM Read data I2C_stop 0 12C Stop return data void WriteEEPROM unsigned char addrL unsigned char data I2C start 12C Start 12C_write_ byte EEPROM Write Address 12C EEPROM Address Write 12C_Transmit_Data_ Empty wait for transmit buffer empty I2C_write_byte addrL LSB EEPROM Addre
29. talks with the robot his or her voice commands need to be trained correspondingly for the preset operations and stored as speech patterns Then the user can ask the questions for the robot If the voice does not match any of trained voice commands a speech instruction words cannot be recognized or Repeat look for will be given to allow the user to try again Project Status The overall work for the final project works very well as planned in the project proposal Specifically the final project meets the proposed requirements as follows Read the temperature from ADC temperature sensor e Read the Real Time Clock RTC using I2C bus e Control the speech recognition board using GPIO and hardware switches e Control speech synthesis through serial data line e Interact with the user over the speech communication In addition more voice operations and speech controls are added into the final project beyond the proposal as follows e Write Reset the RTC using I2C bus e Software decoding to reach up to 15 word commands for speech recognition e Allophone phase editing e Numerical pronunciation 0 69 e Calendar pronunciation Jan 1 Dec 31 Monday Sunday Non standard language speech synthesis Chinese AM PM e Robot music playing Project Final Demonstration Video 13MB http home gwu edu dliao cs339 Liao_z8Speaks_320x240 mpg 1 Design Overview 1 1 The Purpose and Requirements The purpose
30. uration cccescesseeeseeesseeeteeeteeeees 14 Figure 12 Figure 13 Figure 14 Figure 15 Figure 16 Figure 17 Figure 18 The Final Hardware Connection for the Z8 Speaks System ceseeeeee 16 Stand Alone Test for VoiceDirect Hardware cccccccccesssceessssceeeessseecesssees 18 Hardware Connection for VoiceDirect Communication with Z8 19 Hardware Test for SpeakJet Demo Mode eceecceeseeseeeteceeeeeeeeeeeenteenees 21 The Schematic for SpeakJet Communication with Z8 0 0 0 ceeeeeseeneereeeeees 21 DS1307 Data aS ET a a a aa i suas ethane 24 The Flow Chart of Z8 Speak Main Application sseseesessseseeseeseessesseseessee 30 Project Abstract This final project report describes in detail how to create a Z8 speaks like a talking robot The Z8 Speaks is mainly composed of Z8 microcontroller board VoiceDirect speech recognition board SpeakJet speech synthesis chip real time clock and temperature sensor The user can interact with the Z8 Speaks through speech communication based on speech recognition and synthesis It has the capabilities to display current temperature time calendar name music reset and other information on the LEDs in the Z8 board upon spoken request as well as speaking corresponding information This project provides twelve different operations such as temperature time calendar reset etc which have been already set well in the program Before the user
31. z 46 0x2E mode 100kHz for DS1307 I2CBRH 0x00 BRG High I2CBRL 0x2E BRG Low PAADDR 0x02 PACTL 0xC0 alterate function PA6 SCL PA7 SDA for I2C port I2CCTL I2C_ENABLE void I2C_start void I2CCTL SEND_START 12C Start bit void I2C_stop void I2CCTL SEND_ STOP 12C Stop bit while I2CCTL amp SEND_STOP SEND_STOP void I2C_write_byte unsigned char data I2CDATA data Write I2C data void I2C_Transmit_Data_Empty void while I2CSTAT amp TRANSMIT DATA REG EMPTY 0x00 Wait for Transmit Buffer Empty unsigned char I2C_read_byte void unsigned char data data IZCDATA Read I2C data return data void I2C_Acknowledge void while I2CSTAT amp RECEIVED_ACK RECEIVED_ACK wait for ACK unsigned char I2C_AckNack void unsigned char data while 1 Wait for the last byte Transmit Receive ACK NACK if IZCSTAT amp RECEIVED_ACK RECEIVED_ACK 23 return ACK else if IZCSTAT amp RECEIVED NACK RECEIVED NACK I2CCTL FLUSH_TXD I2C start I2C_stop 0 data 12C_read_byte Clear I2C Receive buffer printf n n rI2C Error NACK Received return NACK J39 void I2C_ Send NACK void I2CCTL SEND_NACK Send NOT Acknowledge void I2C_Receive Data Full void while I2CSTAT amp RECEIVE DATA REG FULL 0x00 Wait for Receive Buffer Full gt 3 3 2 Data T
Download Pdf Manuals
Related Search