PeLe user manual for teachers
Contents
1. Di Use standard rules Min 0 00 Max 0 00 J Na of selectable choices Delete IE Use standard rules Min 0 00 Max 0 00 io of selectable choices 0 Indicate correct answer by ticking the alternative s Delete Pi Use standard rules Min 0 00 Minimum Score Max 0 00 B e 70 Ha of selectable choices 0 Delete Maximum Score DA Use standard rules Min 0 00 0 00 Max 0 00 L No of selectable choices 0 O YE SITE Delete eo MI Use standard rules Min 0 00 Max 0 00 Figure 11 shows the main areas of the edit assessment interface In each questions you have several options that you can use to change the setup of the question Y Use standard rules Min 0 00 Max 0 00 Ma of selectable choices 0 A indicate correct answer by ticking the alternative s Delete Figure 12 shows details of how you can edit each individual question shows the question number The correct alternative can be selected and you can allow more than one question to be correct If you need to add or remove an alternative 0 just click or as you want to You can override the standard rules and adjust the score for each alternative as you want to Min and max gives you the possible minimum and maximum score for this question displays the number of choices the students are allowed to select You can delete this question B by pressing delete If no options are selected you ate giv2. LLP 1 2010 1 NO KA3 KA3MP Running a Post Assessment Activitv PoAA When vout students have delivered the results on the assessment and vou as a teacher have the overview over their performance it s time to start working with their results You know what problems they have solved and what problems they haven t solved Now you have a window of time to provide feedback and you can go over the results in a variety of ways dependent on the information you have Below you find a short guide giving you suggestions for how you can perform a PoAA based on the results you find The method you chose depend on your test what you are testing and how you have designed your alternatives Choice of method guide If we assume that we have only one correct alternative on all questions we can start with the simplest case where all students have given the correct answer Here you should give a short positive feedback If the results are scattered all over the place this means that the class does not have a clue and probably are guessing You have to consider if the question is bad formulated or anything else might be wrong of if they do not have any clue When you have your results and you want the do a PoAA with the class you can use the response system build into Pele If the class is divided in two this might be a good start to a group discussion where they argue against each other why one is correct over the other But it is important that you a
3. and they will not do a pure guessing and hence this estimate is low If you have one obvious wrong alternative they can do a qualified guess and reach a quite good score 37 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Appendix B Marks in questions The student page has an option where the student can mark the question This can be used in many different ways The most obvious way might be a digital reminder that this question I have to take a second look at if I have time The figure below shows the student interface after the student has marked question three Question 3 1 answer Figure 44 shows the student interface when question three has been marked The question button on top is tagged with a flag and the number of marks that has been placed in the assessment is shown in the bottom menu Those questions that are marked will appear in you monitoring The question monitoring interface has a column dedicated to the total amount of marks and a bar showing the percentage of students that has marked the question Default Section Results Correct Unanswered Percentage bar 100 00 U 0 00 0 0 00 i 0 00 Cardinality 100 00 U 0 00 0 0 00 0 00 33 33 U 0 00 2 66 67 w 66 67 66 67 U 0 00 1 33 33 0 00 33 33 U 0 00 2 66 67 A 0 00 Figure 45 shows the question monitoring interface with question 3 marked by two students 38 Done
4. below A Assessment not available Create a new assessment Load an assessment from fila 63 Figure 19 shows the start page when no document is prepared You then have to option to 8 create a new assessment or 8 load an assessment from file 21 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Monitoring of assessments in Pele When you have uploaded the assessment to the server you will be given an assessment code that is displayed on top of your screen Then the application move to the monitoring stage Monitoring is done on individual candidates and on individual questions in two different views The monitoring matrix shows the student oriented list of the results sendt Login Assessment Monitor In Class Admin Show status Show resulis summary Number of logged in students O Current section default Submitted 0 00 0 Default Section First Mame Last Name User 2 1 Questions Figure 20 shows the monitor interface with the retrieved session code Now you can monitor your students as they login and respond to the assessment The first page of the monitor interface contains a student oriented view with their delivery If you press Show results summary B you will get an overview of the submitted responses oriented towards each question As students log in they will appear in this list with small dots for each question that is not responded to As they respond the dot
5. has been installed you start by double clicking the Pele icon Then the application starts and displays the login panel By default the login panel will show no connection information After the first log in the information entered last time and that it has been used successfully will be preloaded in the login form There are two way to enter the connection information First way is the manual entry of the server details suitable when you have been provided with these at registration Second approach is to use username institution_id in the username box The available institutions will be shown in an autocomplete list that will allow the user to avoid anv tvpos The application will automaticallv seek and fetch the connection information for the given institution id using the designated zero configuration directorv Here vou have to give vou username and password and press ok Login to PeLe Service Username Password WI Remember password Server show details Figure 2 The login Panel where the user has to provide username and password in order to access the server You can chose to Remember password and the system will remember till the next login on the same computer The username and server configuration will automatically be remembered Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP If there for any reason is an error either that you username or password is wrong the system will notify you with a s
6. if you want to you can give additional points to the responses given by SRS If you don t want the sts part to count you will set SRS weight to 0 0 If you want to give them something you might give a weight of 0 5 on the srs results The score from the srs section is added to the default assessment section and given in the final results Editing the assessment When you have finished the create assessment wizard you get a created assessment that needs work You have to specify the correct number of alternatives the correct alternatives and fine tune you score settings The overall picture is shown in the figure below The main area consists of two tabs where you can see your questions or can check or change the metadata There is a rules area where the default rules that you selected are shown and where you can still alter the values The questions are aligned vertical in a table where you can change cach individual question You can append a question at the end 8 The maximum and minimum score are calculated and displayed B in the overall score area If you want to you can also simulate a scenario with these settings and see how the score distribution looks like if everyone is just guessing More about simulating the assessment and the Monkey cage you will find later in Appendix A 17 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Standard rules CI Allow Bleeding Unlimited O Choices Corect altematie
7. user in order to give him the teacher rights Back Register user Enter your data First name Last name eMail User name Password Retype Password All elds are required Figure 4 Registration form from the mobile app use the link to the app 12 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Registration Peer Learning Assessment Svstem Student Registration Username Password First Name Last Name Email fucceffor mj a 9 reCAPTCHA Q Figure 5 Registration form from the portal use the link to the registration General information When you have been granted access to the system you will be provided with the main Pele interface This is a menu bar that displays the normal linear flow in the way you will use the system The black buttons will change and a pointer will point at the location where you are in the workflow The flow is as follows When you have logged in you are in the Login area WE downloading assessment Ist Login Assessment Start Monitor In Class Admin zu Figure 6 shows the menu bar with session code placeholder and communication status area Then you move right to the assessment where you can create a new assessment When the assessment is created you start and move to monitoring of the assessment When the assessmentis finished it has to be ended and when you are ready you go in Class with the 13 Done IT LLP Project Nr 511485 LLP 1 2010
8. wrong tesponse8 The chart also displays how many students have chosen to mark this question in a percentage bar 0 This bar can be used also from the students to remind the teacher that they have marked this question 29 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Default section Question 4 lis Correct Wrong 90 00 90 00 Figure 31 shows the percentage chart with percent correct percent wrong and marks Bon this question The histogram When you select to display the histogram of what the students have chosen no correct or wrong markings are displayed Default section Question 4 Li Figure 32 shows results from a question without any indication of what is wrong or correct 30 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP The histogram can be scaled or moved as you wish on the screen You move the dialog by dragging the panel title 8 and scale using the scale handle in the lower right corner Using the histogram you can mark questions as correct by clicking on the bar or in the area where the bar should be If no one has selected alternative a as in the above result you can still select to mark this as correct by clicking in the area where the bar should be You can always remove the correct mark by clicking on the bar again Default section Question 4 Figure 33 shows the histogram where alternative a and d has been marked as correct by clicking in th
9. 1 NO KA3 KA3MP results and start working through the results with the students Then you have an Administrator area and an Exit button Above the menu buttons you find two light areas used to display the session code to the left and communication status to the right When you have uploaded you assessment to the server you get a session code in return from the server that will be displayed Below the menu bar you have a work area and down in the tight corner you find a control button This control button will always stay on top if you move to another program If you have your questions on a powerPoint for later work in the classroom you can hide Pele and move to Login Assessment Start Monitor In Class Admin 1 il Server 24 5 14 Changa Sunset Client Fele ver 1 2 7 E Hs I T T LOIR Demo demonstration 2013 03 18 11 17 36 open _Monitor_ Results KOR ED Dermo demonstration 2013 03 18 10 37 49 open kanidor ji Results GEJV Demo demonstration 2013 03 18 09 17 54 completed Monitor l Results NIGEL Demo demonstration 2013 03 13 1247 20 uploaded Monitor l Rasults MHLZ bem demonstration 2013 03 13 134728 open Monitor l Results BOBAG Demo G demonstration 2013 03 13 10 24 43 open Monitor Results SAADAN Offline assessment testing 2013 93 08 13 15 08 open lonar Results SOOAK Testing 14 7 testing 2013 03 08 130426 completed Monitor Results DONE IT GOMIE Tes
10. E a a e 16 II LL 16 Editing tne assessment es a aE 17 Save aSSESSMENUSELUP CO file nun erkunden 20 Uploading an assessment to the server sssssennenennnnnnnznnnnnnzunnnnnnzunnnnnzznzzn 20 Monitoring of assessments in Pele ssnnnnnnnnnnnannennnnnnnnnnnmnnnnnmnnnnnmmzanamnnananmz 22 Ending ING ASSES SINCE U i Gaia 25 NIC l A A EEE EARSEREESONEERE 26 Running a Post Assessment Activity POAA LL sese eee 27 CHOICEOF method SU ICC i kasi nti 27 Selecting questions to bring in Class ss eee eee 27 In class and display of results 28 The per enmtade halt ae e LA 29 INES LOST A A i ha 30 Sending back the question as SRS 0 L sess eee 31 Working with the plav controller 31 Adjusting timer time 32 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP AR a eae SR skritt ou akuti va mt tadatta l a enge 33 ES U S 29 2 youtesoveacessnaseseaes 34 Appendix A Simulating an Assessment sssennnnnnnnzannnnnnenzanannnnenzzzznnnnnmnzz 35 Appendix B Marks in questions eennnnnnnnnnnnnnnnnnnnnnnn nanna nm nn rmmnannmmzAnnmmznn 38 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Overview Pele is a web based Peer Learning Assessment System for mobile devices Pele designed to make the assessments and arena for learning ssessments are normally given periodically to determine at a particular point in time what students know and don t know Assessments are used to provide t
11. IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP If you as a teacher want to you can use these flags as indicators You might give your students the instruction e Mark those questions that you find difficult and I will place additional focus to questions that are marked e Mark those questions that you find simple This allows you students to influence the post assessment activity You as a teacher can also chose to ignore the marks Notice that marks does not show in the monitoring matrix If a student want you to pay attention to a question he or she should be able to do that without exposing themselves to the teacher Marking is made anonymously 39
12. LLP KA3 ICT Project 2011 13 Z 511485 LLP 1 2010 1 NO KA3 KA3MP Education and Culture DG Lifelong Learning Programme Done IT Develop of open systems services for smartphones that facilitates new evaluation methods and enhances use of immediate feedback on evaluation results obtained in tests as a creative learning tool WP 8 Developing evaluation system for 4 Operative System platforms for Smartphones D 8 1 Done IT User Manuals Teacher Client Author and editor T M Thorseth Co Authors R P Pein M Uran S Keseling B Voaidas R Stockert B Zorc M Jovanovi A Koves Version Final Date 31 03 2013 Start month 1 End month 21 Package leader Institut za Varilstvo IzV Ljubljana Slovenia Language of the report English This project has been funded with support from the European Commission This publication reflects the views only of the authors and the Commission cannot be held responsible for any use which may be made of the information contained therein Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP This document mav not be copied reproduced or modified in whole or in part for anv purpose without written permission from the Done IT consortium In addition to such written permission to copv reproduce or modifv this document in whole or part an acknowledgement of the authors of the document and all applicable portions of the copvright notice must be clearly referenced All rig
13. Login Assessment start l E i In Be m ji x B N oy Sen Ver Bl D ee z X F Any z 3 Ad hoc SRS Question 1 Why do you want ta perform the assessment a To give the students feedback on their level of understanding b To see where my students are c To be allowed ta do both aj and b and let the student learn from that dj I don t know To SRS Ad hoc SRS Clase Figure 29 shows the In Class page with a word document containing the questions below When you select question 1 in the menu 0 the question control panel appears B where you can choose what to do with this questions 28 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Look at Percentage Histogram Ad hoc SRS Figure 30 shows the question control panel The question control panel displays the main question number From this question you can navigate to the previous or next question For the selected question you can display a percentage chart B a histogram B as a way to display the results or chose not to display any results yet You can also send out the question again after focusing on something that has been misunderstood in the question or for any other reason The percentage chart Displaying the results as a percentage chart can be given to give some feedback but without revealing any pattern of what the students have chosen This chart only shows what percentage chart has given a correct response or a
14. ces 1 Delete 6 9 Use standard rules Min 0 00 S Max 1 00 l No of selectable choices 1 Delete 7 W Use standard rules Min 0 00 Max 1 00 Ho of selectable choices 1 Delele A Figure 41 shows the edit assessment interface with a defined assessment and where you find the simulate button You can simulate a situation where a given number of students respond randomly to this assessment Press the malai link and the monkey cage control appears 35 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Monkey Cage control ml Use the slider ta control how many simulated monkeys you want to release on your assessment Figure 42 shows the monkey Cage control where you select the number of randomly filling inn your assessment Each question the response is randomly selected as many as I am allowed to select Assume that we release 5000 monkeys to this assessment Then we press Run Simulation You will now get a simulated outcome space of you assessment Min 1 9 Max 8 5 Prob 51 94 Figure 43 shows the simulation results with the slider where you can measure the probability of getting a score in the selected range 36 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP When you use the slider on top and move the lower limit up to 1 9 and the upper limit to max you get the probability to get a score of 2 or more by pure guessing Remember that our students are smarter that monkeys
15. e assessment setup to file You can save the assessment by pressing save button in the main navigation bar below Assessment so you can reload the assessment document later Notice that the save button is disabled if you have no assessment document setup in memory SR LOIR riti i Login Assessment Start Monitor In Class Admin Create Edit Load Save Figure 16 shows the menu with the save button under Assessment When your assessment has at least one correct alternative for each question the finish button lights up and you can run the assessment by pressing finish When you are finished press the finish button and the application will move start uploading the assessment to the server Uploading an assessment to the server When your assessment document is set up and the system has no indication about an obvious fault in the setup you are allowed to upload the assessment to the server Assessment ready upload Figure 17 shows the start upload assessment document to server button If you don t have any setup ready this will not be enabled If you forget to set the correct alternative to a question this will appear on start 20 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP A Assessment not completel Edit existing assessment Figure 18 shows the start interface if the assessment is not completelv set up If you try to start without any prepared assessment you will get the message as shown in Figure 19
16. e figure Sending back the question as SRS What happens if you give students a hint or if they are allowed to discuss the problem as small groups or in a class discussion You can send the question out as an student response single question again The system has the question configured and you only have to press Send SRS and the students will have the alternatives ready to vote again If you press Send SRS the play controller appears on your screen ea 00 20 7 80 0 es U Figure 34 shows the SRS play controller The SRS system has been preconfigured to request as many alternatives as the question you are working with The only thing you have to consider is the amount of time given Working with the play controller The play controller has many options and we will use some time to explain them First of all you can notice how the label displays how many options are requested Then you have the play 31 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP button B that will send out the question and change to a pause button when the vote is open Pressing pause will pause the timer but your students will be able to submit results If you press Stop B the vote is closed and the students will no longer see the vote page 0 0009 a aar 6 ax on 00206 The sound button allows you to turn sound from timer on or off The timer button turns timer on or off allows you to let the vo
17. ection assessment and start preparing for the post assessment activity Ending the assessment When all students have submitted you can now close the assessment To do that move to the end monitoring stage by pressing the End button as shown in Figure 25 below Monitor In Class Figure 25 shows the menu bar and the location of the end button Then the end button will appear with a warning Pressing stop will prevent students from delivering more results Figure 26 shows the end button with the warning Pressing STOP will close the assessment and no student will be able to respond to the assessment A new interface with the results focusing on the questions will appear as shown in Figure 27 below Here it fits nice to give the students a short break so you can consider the results 25 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Login Assessment Monitor In Class E gt hii selection e Reopen default section Current section srs Default Section Results Select No at Marks cardinattv L Correct lunan swer Wrong Percentage bar aan MOAK ca 0 0 00 M aa 1 2 9 90 00 0 0 00 1 10 00 0 0 00 1 50 00 0 00 5 50 00 Default section Question 3 LI 8 80 00 1 o a C b L Gp 50 00 U 0 00 5 50 00 1 10 00 1 40 00 U 0 00 6 60 00 LI in ale 3 30 00 1 d Correct 20 00 NI 0 00 50 00
18. en a warning 18 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Now we can start specifying each question and finalize the assessment setup The questions are arranged sequentially downwards and we can select the right alternative by just checking the correct alternative If questions one has one correct alternative c you check alternative c You can notice how the score adds up and change as you select correct alternatives Then we move on to question 2 and select alternative d on 3 we have alternative b and d Edit setup for DEMONSTRATION Demo El Properties Questions append Question Standard rules Rules Score CI Allow Bleeding Fz cj Unlimited A Indicate correct answers for each question to complete setup v Use standard rules Mir 0 00 A Choices War 1 00 Comedi 1 Ho of selectable choices 1 aliemative Detele 2 Use standard rules Min 0 00 Wrong 0 Mar 1 00 allemative j Ha of selectable choices 1 Delete No selection 0 v Use standard rules Min 0 00 je War 2 00 Ho of selectable choices Z Delete v Usa standard rules i az Min 0 00 Minimum Score tax 0 00 0 00 Ko of selectable choices 0 Detete Maximum Scone PA Use standard rules Min 0 00 4 00 Mar 0 00 Na of selmctabia dhom U Delete IV Use standard rules Minc 0 00 Mar 0 00 ill 13 show the edit assessment interface after selecting correct alternatives on tree questions Note ho
19. estion yet The play controller gets less and your options are removed If you use the timer the vote will close after the countdown and the student page will close If you want to pause the countdown press pause and the timer will stop The students can still give their responses By pressing run the countdown will continue Figure 37 shows the results from assessment question 1 5 and one SRS result Results from the SRS round will appear up together with the other results SRS results are tagged with a SRS number and the assessment question number in light gray You can get the results through clicking on the results button Ad hoc SRS If you want to ask a question with a different setup from the assessment you can run an ad hoc SRS This means that you have to set up the number of alternatives Press to get the alternatives panel 8 If you want more alternatives press more to get more alternatives or press less if you want less alternatives again AJ 9 u S AeA A O 15 Figure 38 shows the play controller when running an ad hoc SRS 0 display the number of alternatives that you can select and allows you to have one selection or many selections on the student side In an ad hoc SRS you also have to set the number of alternatives that the student can select By default the student can select only one but by pressing the cardinality button you can select to have unlimited number of selected
20. he teacher and the students with feedback Quite often the results from a test is given 1 2 weeks after the performance and the information back to the student may be everything from ok or not approved or not a grade ot a solution These kinds of assessment are normally referred to as summative assessments In contrast formative assessments are assessments done as a part of the instructional process While summative assessments are associated with standardized tests and exams the formative tests are designed to give students feedback and guide the students towards the learning goals Although formative assessment strategies appear in a variety of formats there are some distinct ways to distinguish them from summative assessments One criterion for a formal assessment is that students are involved as assessors of their own learning and as resources to other students Pele allows running both summative and formative tests Figure 1 Todays challenge large groups of students in a huge hall taking their final exam Are the results from the exam the only feedback they get during the course In Pele you don t have to enter the questions into the system It is assumed that you have created an assessment on paper where there are multiple alternatives for each question Handing out a paper with the task makes this possible without any limitations of the question by the system You can then design the multiple choice test as you want using your fav
21. hts reserved This document mav change without notice but consortium members should be informed and number of version stage and date should be given Project consortium e S r Tr ndelag University College Faculty of Technology Trondheim Norway e Centrum for Flexible Learning Soderhamn Sweden 6 Petru Maior University of Targu Mures Tirgu Mures Romania e Magyar Hegeszt stechnikai s Anyagvizsgalati Egyes l s MHtE Budapest Hungaria e Institut za Varilstvo IzV Ljubljana Slovenia e HiST Contract Research Trondheim Norwav Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP PeLe User Manual Teacher Client Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP PeLe User Manual Teacher Client Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Table of Contents Sau 1 RPPEERBROREAPRDLEREABERHERESESERPNEREEEAEFEREEEFEFERPEERENEEREERENEEETERUBEREERHERERESPRLSEEEEDEHREEENFAERETENESE 1 OO RCW da e 7 Regu reM N S i ae a 8 Access to WiFi VT sea en ea aaa 8 FRUIT IVS ON Window S ae as ass 8 Running on Macana LINUX a a nee E duarvsneses 9 StaringUp and log IN en ae 9 GEINE access A a wied ala a 12 General INFO FIM AU OND i EEE EEE NEEEEEEEEEEEEEEEEEEEEEEEENEEEEEENEREENEOESEEE 13 Create an assessment in Pele sssunnnnnnnnnnnznnnnnnnmmnmmnnnznnnanznmznznmmnznnnnnnnzzna 14 Create a NOW assessment ea i a i i l u 14 Assessment metadata l i ia ieda ai ra 15 ASSESSMENT SIZ ae a A
22. items This allows you to have select only one alternative or select up to all alternatives When you run the ad hoc SRS results appear as the other results but without the reference to the assessment question 33 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP eds kE Ke Figure 39shows the assessment results from question l 5 one SRS result based on question 1 SRS 1 and one ad hoc SRS item SRS2 Results When the assessment with the Post Assessment activitv is finished it s time to look at the results You can look at the results from each individual user under Admin By default no results will show up here This is done deliberately so that you as a teacher can avoid by pressing this by a mistake and show the results to all students You have select Show Results Table 8 LOIR Login Assessment Start in Class Admin Epon To XLS Show resulis to students LI Show Resulis Table You will however get a warning to avoid any mistake where you have to confirm that you do this action deliberately Confirm Are you sure that you want to show the results Make sure that you are on a private screen Figure 40shows the warning dialog when selecting to look at the individual results If you want the students to look at their individual score you have to press Show results to students button This will allow the students to see on their own device the score they got on
23. lways give a final verification of what results are correct and why and what results are wrong and why Your explanation is highly valued Selecting questions to bring in Class In the End page you can select questions that you want to display in class You can click and select one at a time or select them all B If you have only a few questions I would recommend that you select all You can also invert the selection Notice as you make the selections how new buttons appear up on the menu line 0 where you select each question from later 27 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP CJ SelectAll Invert selection Reopen default section Current section srs Default Section Percentage bar 0 0000 0 00 0 0 00 Li 90 00 0 0 00 1 10 00 I 0 00 50 00 0 0 00 5 800 O o 8 80 00 50 00 U 0 00 5 50 00 1 10 00 40 00 0 00 6 0 00 ll KO 3 20 00 Figure 28 Selecting questions for an In Class sequence manually 8 or selecting all 8 The figure also shows the selected questions appearing in the top 9 In class and displav of results When you move over to the in class page you application turns transparent 8 Now you can display the assessment as you display results Now when you select the first question a question control panel appears B From here you can select the form of chart or activity that you find suitable for each question cn
24. n B the number of students who have selected the option B the percent of students who have selected the option B and a flag telling if the option was set to be the correct answer 8 Figure 23 shows the monitored question with the histogram for one question When the students have filled inn all their results they have to submit their responses To do that they have to go and deliberately submit Figure 24 shows the interface where the number Show status Show results summary Number of logged in students 10 _ Current section default Submitted 100 00 10 Default Section FirstName Last Name User ID a Questions an IE EB ED E studenti studenti BATCH stuc student BATCH stuc student 7 BATCH stut students BATCH stuc students BATCH stuc students 9 BATCH stuc students BATCH stuc student BATCH stuc student BATCH stuc studento of students that have submitted is displayed On top you see the number of students that have logged in and the number of students that have submitted The blue bar shows the 24 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP percentage of students that have submitted You can also see on each student whether they have submitted or not 8 By clicking on the S column you can have those submitted sorted on top or at the bottom When all you students have submitted their responses it s time to close the default s
25. ne Android phones or computers The only requirement is that the web browser is a webkiti based web browser You find a short list of browsers in Table 1 below Table 1 The most common webkit enabled browser that we have tested A more extensive list can be found online Computer Browser Status PC Google Chrome v Safari v Mac Safari v iOS Safari v Android Dolphin v Running on Windows The system had been developed and tested mainly on windows However the air application can run on other operating systems that support the Adobe Air runtime We have intentionally kept the implemented application at a compatibility level that coincides with the last supported version for Linux The support for Adobe Air on Linux has been dropped by Adobe in favor of mobile platforms but they kept the support for Mac OS 1 http en wikipedia org wiki WebKit 2 http en wikipedia org wiki List of web browsersf WebKit based 8 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Running on Mac and Linux The system needs further testing to optimally run on Mac OS and Linux Even if the runtime at the base is smoothing out the differences between the platforms there are still issues with certain features In some instances we have encountered problems with the way transparent windows are treated Moreover there are differences between the operating systems in the way they treat the always on top windows Starting up and log in When Pele
26. orite editor and include equations graphics or symbols at your own will You distribute the assessment as a task on paper and the students work with the problems as usual The only difference is that your students submit the results digitally This allows you to start working with providing feedback on the assessment immediately after the assessment Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Pele has been designed to allow students to respond to tests electronically and hence allow the teacher to see what happens during the test and prepare for a Post Assessment Activity PAA When the students have given their response the teacher can start to explain and use the students results immediately If a lot of students have struggled or there are many misunderstandings the system has a build in Student Response System SRS that can be applied to give a second chance create a group discussion or engage the students in a new response after giving some hints The system has been designed as a tool to allow working with the problems addressed in the assessment immediately after the when the problem is still fresh in mind How the system is used is dependent upon the teacher and what he she wants achieve Requirements Access to WiFi Network In order to be able to run Pele in the classroom you need a good coverage of a stable WiFi Network in the room Students can log in using most kinds of web enabled devices like iPod iPad iPho
27. ound and message in the login panel Check your username and password again Username x Password Credentials have not been d Remember password Server hitp jlaft test histno 80 Histrest Show details Figure 3 Username or the associated password is not accepted If you have to change the server click on Show details and the login panel will expand with the additional server settings and you can change the server and the path to the server teacher test Password V Remember password Server tip aft testhistno 80 His Hide details Server htip Naft test hist no Service path If you insert an invalid web address to the server the system will notify you that the server can t be reached 10 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Port Jlso Ir http aft stimuli ne l Server is not accessible If the service address is wrong but the server responds with a message that the service path is not accessible You then have to change the settings to correct settings http aft stimuli no s r amp Service path x service path is not accessible 11 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Getting access The users can register using either the mobile client or the portal page These are available at the desired server e g http aft test hist no Hist After registration an administrator must assign the teacher role to the newly registered
28. s will grow to a small black square You can turn on colors on these squares by pressing Show status 8 and answers that are correct will be colored green and wrong answers will have a red color By default the responses are indicated as neutral since you should not show this to the students If you keep the interface neural you can show the login to the students and give them a feeling that technology is working and they are in the correct place but this is recommended only in a first demonstration Later the students trust the technology they will not need it You also get a count of how many students are logged inn and a percentage bar indicating how many of your students have submitted their answers Show results summary Number of logged in students Fi Current section defauli ubr Default Section First Name Last Name User ID Questions gt studenti studenti BATCH stut student BATCH sturt studenti Figure 21 shows the student list with three students in Only student 1 has responded to the first six questions 22 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP You will be able to see if their responses are correct or wrong by clicking Show status Now each response will be colored red or green When the results are shown you can switch back to Neutral view of the monitoring matrix If you chose Show results summary the
29. score this bleeding is not relevant In most normal cases you can leave this unselected Unlimited choices B allow you to allow the students to select more than one alternative on each question You can also leave this unchecked Correct choice B sets the general score for a correct answer The default value is one but you can change this if you want to give more for a correct answer Wrong choice B gives you the default score by selecting a wrong alternative No choice allows you to select the score given if no response is given If you now press next we will start editing the created assessment 16 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP gt Metadata Size D Rules 1 LI Allow bleeding if you alow bieding the negative score for an individual question wil mfuence ihe overal score L Unlimited Choices Check this option to alow students to Select any number of alernatrves Corredi choice 1 0 Wrong choice 0 5 No choice 0 0 SRS responses will be given the same score as the rules set up for each question How do you calculate the total score from the SRS responses 1 0 20 EERS weight 6u _ _ 0 Le Total Score Assessment Score 1 00xSRS score lt lt Previous Next gt gt Figure 10 shows step tree of create assessment wizard where you define the general rules The final part is to give the weight to the srs questions When the assessment is done and
30. sessment wizard where you enter metadata The first step is to insert metadata about the assessment 8 The name of the assessment the Course name 0 a note area where you as a teacher can write what you want and a last message that will be displayed on the students when they start the assessment Then you move to the next step 15 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Assessment size In the second step you give an approximate setting of the assessment size Humber of qua siions T o m 4 anna 3 Member of alteenaltaas Figure 9 shows step two of the create assessment wizard where you define the size of the assessment First you give the number of questions 8 by pulling the slider to the correct position The maximum number of questions are 50 Then you select the average number of alternatives by pulling the second slider You can later add questions and change the number of alternatives on each question individually Then you select next step Rules The system will need some rules to calculate the score from the assessment In the third step shown in Figure 10 you set the general rules for how the score are given on general for the assessment These rules can again be changed on each individual question separately later Aow bleeding B is an option you can use if you allow more than one correct alternative and you use punishment negative score for wrong answer If you don t use negative
31. the assessment and from the SRS section You can from this interface export data as an excel file 34 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Appendix A Simulating an Assessment When you design a multiple choice assessment you want to have a feeling with how easy is it to do a pure guess and pass your assessment Let s look at the possibility to simulate the outcome from an assessment and what you can learn from doing it If I have an assessment with seven questions set up as below I have one correct alternative on each question except question 3 where I have rules that deviate from the standard setting I have one question that bleeds to the total score Edit setup for DEMONSTRATION Demo B Append Question Standard rules No Altematives Rules Score L Atow Bleeding CI Use standard rules Min 0 Unlimited 1 FI biz LI Choices LI Bieed Max 1 00 CI Unimited choices Comed 1 No of selectable choices 1 alternative a T Delele 4 19 Use standard rus Min 0 00 Wrong 0 Max 1 00 alteniatnve a C Mo of selectable choices 1 Delete No selection Q 3 LU Use standard rules Min 1 00 o DI Bleed Max 2 50 LI Unlimited choices Ho of selectable choices 2 Delete W Use standard rules LI FI n 4 Hr H Minimum Score Max 1 00 4 00 a No of selectable choices 1 Delele Maximum Score 5 Use standard rules Min 0 00 es Max 1 00 Ho of selectable choi
32. ting 1 47 testing 2013 03 08 12 04 26 open L Monitor _ _Resuts CAMIS Testing 147 testing 2013 03 08 13 04 26 open Monitor Results 3 YAGOU Demo demonstration 2013 03 01 15 58 06 open Monitor Results UACIG Demo demonstration 2013 02 37 10 16 22 open Monitor Results PowerPoint but the control button will remain on top of you programs Pressing it will reveal Pele again On the login interface a list of you previous assessments that is stored on the server Create an assessment in Pele When we create an assessment in Pele we have to setup a document which resemble the actual assessment that you give out on paper We have to feed the system with the number of questions alternatives and what alternative is correct Create a new assessment When you want to create a new assessment move to Assessment and click Create Then the first step of the create assessment wizard will appear 14 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Assessment metadata Login Assessment Create Edit Wagga LSR Metadata Size D Rules J Qu Aa Dea cient iame Demp Course Used io sort assessment codes in iie erie DEMONS TRAN Teacher description Not shown ta Ihe shaderii T in 15 a remider of why the asseszmeri was nunnmed the idea and what was bested Massage t the s sdends on sian page Welcome and good luck Figure 8 shows step one of the create as
33. ting last until you close it with the stop button and not the timer The next button 0 lets you display results automatically when the voting is closed Automatic results are by default disabled Then finally at the end you have the chance to display results live showing the histogram as the results are submitted by the students In the information panel G you see the timer time how many of the registered student have submitted and a bar indicating the percentage of students that have voted The two numbers a b Correspond to a the number of students that has logged in to you session and b the number of students that given their response Time left eoo Adjusting timer time If you tight click the timer icon on a digital blackboard click and hold you get an extended part of the play controller where you are allowed to change the timer time You then simply drag the slider 8 and close the window 0 Bua 2 JA in seconds 10s 1min 1 00 20 0 aa I 0 C gt Figure 35 shows the timer adjustment panel that appears on right click on timer option When you press play the vote page will appear on the student s device and the students can respond to your question 32 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP 00 18 LI Figure 36 shows the play controller after having pressed run 10 students are connected to the session and none of them have responded to the qu
34. ve 20 00 Now it s time to consider the responses that you students have provided and start planning the Post Assessment Activity You have to select those questions you want to bring into the PAA When you have only a few questions you can bring them all by selecting Select all 8 You can also select manually B each individual or you can invert the selection 8 If you want to you can reopen the assessment again and go back to monitoring here When you select one row in the responses B a histogram showing the actual responses will appear In the example shown Figure 27 you have to balance the time you have got with how many questions you want to go through Question one appeats to be understood and a quick positive can be enough Question 2 is answered wrong by one student but question 3 has 50 errors and is marked by 80 of the students You should spend time on the last three questions But since the number of questions were few you could bring them all into the classroom What you should do is dependent upon what you want to achieve with the PAA As a teacher you know the assessment and the possible problems the students might have In class When your results are ready you can start displaying results and work with their deliveries it s time to gather the students again If you want your students to learn something from this assessment now is the time to put in the effort Done IT LLP Project Nr 511485
35. view will change from student oriented to a question oriented list as shown in Figure 22 below Here you find the questions oriented vertically with the number of correct unanswered and wrong results 8 The percentage bar shows the percentage correct in green the percentage wrong in red and the percentage still unanswered in gray The number o f marked questions is shown in a separate column and as a percentage bar B You find more information about marks and how to use them in Appendix B L Show monitoring matrix Number of logged in students 2 Current section default Submitted 100 00 100 00 s 3 C ese 2 Default Q Results oO TKS Cardinality Correct _ Unanswered bar L 100 00 U 0 00 0 0 00 0 0 00 00 90 00 U 0 00 10 00 0 00 80 00 50 00 U 0 00 50 00 50 00 U 0 00 50 00 10 30 00 40 00 U 0 00 60 005 Figure 22 shows the question oriented monitoring interface When you click on a question you immediately get a histogram of the results for the selected question This histogram and the monitoring data will update as the results appear Default section Question 3 X 20 00 0 00 50 00 30 00 23 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP Figure 23 shows the histogram for the selected question with the table showing the optio
36. w question 3 has two correct alternatives If we uncheck use standard rules you can see the score settings On question 3 if for a reason alternative d is more correct that b you can give the weight here to 1 5 and the total score on this question can now add up to 2 5 CI Use standard rules Min 0 00 LI Bleed Max 2 50 L Unlimited choices No of Selectable choices 2 Delete Figure 14 show details on question tree when we overrule the standard rules with new score If you use negative score for wrong answer this might end up to a negative score in total if both selected alternatives are wrong If you want the score to be negative from this question you have to check bleed LI Use standard rules Min 1 00 2 U yj Bieed Max 2 50 a LI Unlimited choices A Bai s No of selectable choices 2 Delete Figure 15 show details where we have selected negative scores on wrong alternatives and where bleeding is allowed Notice how the minimum score on this question can now be negative 19 Done IT LLP Project Nr 511485 LLP 1 2010 1 NO KA3 KA3MP By default you students will not be able to select more than the correct number of alternatives If you want your students to be able to select as many as possible up to all you can do that by checking the Unkmuted choices This will give the students the possibility to select them all Think carefully before you allow this one and consider using the negative score Sav
Download Pdf Manuals
Related Search