ePEN Marker User Guide
Contents
1. To return to the Qualification Set click on Return to Task button You must work through all the Score and Review Responses in a Set Note You must work through the whole Set for an item in one session and not close your viewer part way through If you close your viewer you will need to work through all the responses for the item again until you come to the next available unscored item 25 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Figure 39 Qualification Review Response pire piovesed by bore The student response will Qm HAG Dae dere Que O 2 2 BL appear in the top right hand AB eee raed eer ou cee parece Hecate vet W n d OW MM Work out 4 y The True Score left side and the Marker s score right e mi jor side appear in the middle Any annotation will appear o at the base of the window if applicable S17 0 OH ee gpa ee ee one eee Set i prr TR mi iB Applet com rece ong eee Sie e o Teed Ge Once all of the Score Responses and Review Responses have been worked through click on the Commit button Figure 40 Commit Set button EIMS Pearcen e PIN Sepine Microced bniereei Explorer provided by Diemel Pile fidt View Favorites Took ib cE ole a a L A paa O 2 2G Pa gree Gee O S H LJ Fa oebG I E i E l Haah T i WB mip leet serh e ini peep e ae o Ej Cli2. Marking items reset in ePEN on the day of standardisation Markers and supervisors mark their samples for each item View Progress marking tab supervisors can see when samples are completed Backread samples and feedback to markers Marking Period Ensuring progress and quality of marking is maintained and milestones achieved Or Online Standardisation Activity Familiarisation Marking period queries regarding mark scheme to supervisors All Familiarisation Marking items reset in ePEN after pre standardisation Markers access Edexcel Gateway for the final version of the mark scheme Markers access and score the Practice Set s for each item and receive feedback Markers contact supervisors after Practice Sets for feedback from supervisor Markers access and score the Qualification Set s for each item and receive feedback Markers proceed to live marking Feedback from supervisors received during the marking period Marking Period Ensuring progress and quality of marking is maintained and milestones achieved 30 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor
3. Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 1 0 Introduction ePEN electronic Performance Evaluation Network is an image based marking system available on line ePEN allows the user to mark sections of papers known as items Scripts are scanned into the system and divided into individual responses which correspond to each item The student responses are then displayed on the marker s PC As the candidate responses are shown against the item selected the marker can focus on the mark scheme for that particular item for as long as required Senior Examiners and Qualification Delivery Award Managers have access to real time monitoring quality control reporting and other functionality to help with the supervision of marking 2 0 Getting Started Before you can begin using the ePEN system you must have Installed ePEN The Current version of ePEN is version 4 6 2 It is essential that you download and install version 4 6 2 You can do this by accessing the following website www exam2score com and clicking on the Download and Install ePEN link Once you have clicked on this link please follow the onscreen instructions Figure 1 ePEN Homepage ePen 05 Microsoft Internet Explorer provided by Edexcel File Edit view Favorites Tools Help You must enter the website address of ePEN as advised by Edexcel Q ak z i x a A Search 5 Favorites L2 y4 7 z a 3 Addr
4. dies The annotation should be carefully considered especially if there is a deviation between your score and the True Score You must work through all of the Score and Review Responses the whole Set for an item in one session and not close your viewer part way through If you close your viewer you will need to work through all the responses for the item again until you come to the next available unscored item Once you are ready to progress to the next response click on Next Response The current Response will always be highlighted in blue in the top left hand window This window also gives information on how many Responses in a Set how many attempted and how may remaining Figure 32 Practice set information j 4 e Current response is always Response 1 highlighted in blue A Review L Response 2 Responses remaining to be viewed All responses within the Set Once you have reviewed the last Review Response in the Set click on the Submit Set button to receive a report indicating your overall performance on the Set The Summary Report for a Practice Set gives details on whether each Response was scored correctly or incorrectly and an overall agreement with the True Scores Note There is no pass criteria for Practice Sets Any queries regarding any of the responses in the Practice Set whether the Set has been passed or not or on the application of the mark scheme should be referred to your Supervisor by
5. down View Pries Adjudication Scoring Backreading ePen Scoring GO Summer 2006 English GCSE V4 53 Build 330 Copyright 1999 2006 NCS Pearson Inc All rights reserved Pulled Paper Scoring ePEN helpline free phone 0800 169 9202 i Message of the Day and Administration Mark Student Responses details displayed 5 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor From this screen you can select an item from the drop down list of Available Items as well as the task you want to undertake from the list of Available Tasks This welcome screen may contain a Message of the Day for all users of the system Every time you log into ePEN please make sure to check for any new messages 5 0 How to Mark Using ePEN 5 1 Access Mark Student Responses After selecting the item you wish to mark from the drop down menu click on the Available Tasks and select the Mark Student Responses option If this option is not available to you this could be because you need to complete the practice and qualification marking first Online standardised items only or that you need to access your messages 5 2 Downloading Updates In order for the system to work properly certain files will be downloaded automatically You do not need to do anything just wait for the download to complete This is likely to happen the first time you enter Mark Student Responses Figure
6. for the item Figure 12 Single Trait Marking Grid Figure 13 An example of a multi trait marking grid Oo 1 O23a Q25b Q23c Figure 12 above is an example of a single trait or single aspect grid The possible marks are 0 1 2 and 3 Figure 13 above shows a multi trait grid This means that you will be awarding marks based on different aspects for example Part 1 Part 2 Part 3 or for different language criteria such as Style and Punctuation Grammar Purpose and Organisation or any variation of multi aspects which are pre determined based on the agreed mark scheme 8 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Once you have reviewed the response in full and are ready to award a mark click your mouse over the appropriate mark value for that response A red dot will appear showing that you have entered a mark Once you have completed scores for each aspect you can click on the Submit Score button As soon as you click on the submit button a new response will appear You can continue with this item until you close the viewer or you have exhausted the queue in which case you will see the message No More Responses Available Figure 14 An example of a drop down list marking grid In Figure 14 above available marks appear in a drop down list Note If the Submit Score button is not activated this can mean one of two things
7. has been subtracted My allocation has changed before the If you have marked your contracted number contract completion date of responses for the paper before the contract completion date you will have access to extra items from the pool My allocation has changed after the contract Once the contract completion date has completion date passed all markers cap and allocations are reset to 10000 to allow access to the unmarked items My allocated items do not add up to the Progress Through Contract data does not get contract value in View Progress updated when additional items are allocated from the pool 28 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Cannot Close Viewer The common cause of this error is the use of pop up blockers Please contact Helpdesk for further advice The paper have access to is not the same The practice site uses historical items from subj ect unit as will be marking previous series This site should be used to practice using ePEN functionality and also to test that ePEN has been successfully installed on your PC Therefore you may not be allocated your subject Is my paper being standardised online Your contract will have details of whether your paper is to be standardised online or if you are required to attend a standardisation meeting Please contact the helpdesk if you are unsure can not see Mark Stude
8. 6 Download Progress Window f Downloading jar file x Downloading from URL http epenpraco3 epen eu com ToolsMediacib jar k x amp amp During this process files are installed on your PC these files enable marking to take place When the download is complete you will be able to mark 5 3 The Marking Window The marking window is the main view you will use during online marking The contents of the marking window can be re sized so that you can see the type of response you are marking Figure 7 Mark Student Responses Window Z NCS Pearson e PEN Scoring Microsoft Internet Explorer provided by Edexcel File Edit view Favorites Tools Help ae Q sek Y amp ix E A P Search Pe Favorites A media EA ud Address amp http pracO1 e marking eu com EpenWwebapp HomeServlet Resize the windows by using d the Fl and gt C Reference Libi a Draw a line 6 cm long in the space below Start from the point labelled A buttons or drag the window to the required size Enter mark here eee using the mouse the point on your line which is 2 cm from A SS ae Ii ER NJAZI FIA 0 ara a gow sentonan Then click Submit Close Viewer td Leeve i Mark here 0 of 10 5521_01_001 type Unscored scoreType Score responseld 926 T 6 Company Confid
9. Any queries regarding any of the responses In the Qualification Set whether the Set has been passed or not or the application of the mark scheme should be referred to your Supervisor Once the required number of Sets have been attempted use the Close Viewer button to return to the Welcome page Markers that have passed the required number of Qualification Sets will have access to Mark Student Responses for those items Any Markers that do not qualify will not be unable to access Mark Student Responses in the Available Tasks drop down menu and should contact their Supervisor for further instructions If a Marker does not qualify on a certain item it will not disqualify them from continuing to take further Practice or Qualification Sets for other items that they have been contracted to mark If you do not pass a Qualification Set for an item you may be asked to take another Qualification Set once all Markers have attempted the Set If this is the case you will be notified separately 27 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 10 0 Frequently Asked Questions and Trouble Shooting Please contact helpdesk with your queries however some may be resolved by reading the information below Has the version of ePEN changed for the No it is the same version of ePEN that was November 2009 marking series used since March 2008 however the View Progress screens have been updated
10. Contract Completion Date View Progress enables you to see your Progress Through Contract and Marking Progress by Item To access this facility click on the View Progress option in Available Tasks on the Welcome page as follows Figure 24 Accessing View Progress e PEN Welcome 1 Microsoft Internet Explorer provided by Edexcel O Mp0 189 21 2er er viet a r r E ei y De a er ke vt XK file Edt Yew Foretes foo tet A amp ererweeere 1 Performance Evaluation Welcome marker test Network L Available Itesss PEEP aie bmn Select View Progress of the Day f Available Tasks 10 09 2009 Choose your cp oa scol down gt 5 yout 6 66 ePen Scoring Science 360 GCSE March 2009 V4 62 Bald 1012 nen Copyright 1999 2009 NCS Pearson Iac Al rights reserved oni Heip nefree phone 0800 169 9202 z edexcel Q rtoret 10 gt The following screen will be displayed It is divided into two sections Progress Through Contract Marking Progress By Item Note the data displayed on this screen is updated on a regular basis Figure 25 View Progress screen f Progress Through Contract 01 Microselt Interne Explorer provided by Edexcel E E Bae 10 giti ihi ahi i ki sop ke eon i erin te l To minimise Bie Edt wew Fgvortes Tool el Wee gropes through Contract 00 fp Do mrp Gp te Be expand the menu marker test markertesr Edexcel sos PIToigh Contr
11. If necessary please click on the Download and Install ePEN link on the Landing Page to install ePEN Error Message page cannot be displayed Please ensure you are connected to the during installation where the user needs to internet during installation For assistance upload PC specs installing the helpdesk can be contacted am getting an error with J ava Please contact helpdesk with any queries Should my username be the same each series The first 6 digits of your username are your Assessment Associate number and should not be different However the last three digits may change from series to series Please refer to your letter for confirmation of your username each series Your supervisor cannot unlock your account Forgotten password Click on the Forgotten Password link on the login page You will be emailed a password reminder If you enter the password incorrectly 3 times you will be locked out ePEN has asked me to change my password From time to time ePEN will ask you to during the marking period change your password This is for security reasons The number of items marked on View There can be a delay approx15 minutes progress does not look correct before the View Progress screen is updated Note The data shown includes both valid and invalidated responses This means any items where your score has been changed in backreading will be included in the total in previous sessions this
12. act End Task Paper SOUGF iF w Paper Contract Typ Pobre Contract Anrount Contract Completion Date Marked Contract Progress ir amp eEPRRT Expert Examiner 11958 Ir 2009 120 on Marking Progress By Item To return to the item Them Type Progress Through Cap Allocation Overall Responses We come P a ge Completed By Item Qol EXPERT 10 18 200 109 Lans diso O04be EXPERT FETT 100 22 250 Q05ab EXPERT 20 20 100 az Barz 28 250 qase eats BEE so io 51 250 sabia o100 oon Low J ay2s0 gored EXPERT m leraz 100 ow seen Copyrght 1999 2008 NCS Pearson Inc All mghts reserved PEN helpline freephone 00O 16 4202 edexcel ip mimre A ar 15 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Progress Through Contract This area of the screen displays information about your contract and allocation It is available as soon as ePEN is live Figure 26 Progress Through Contract Progress Through Contract End Task Paper 5016F 1F Paper Contract Type Role Contract Amount Contract Completion Date Marked Contract Progress 5016F 1F EXPERT Expert Examiner 11968 17 08 2009 120 Your overall contracted The Contract Completion This displays the number of allocation is displayed Date for the paper is responses you have marked so far displayed dd mm yyyy Marking Progress by Item This area of the screen shows the number of response
13. by Cdoxce l Fle Edt Wem Favorites Too Hele ip fuck aj EA n Bamth F yaorker Hala E oe a 13 y a E teii g nthe epenbOL rearking eu coniDoenWebsnp Mabcontraler Ee D Click Send to RM Messaging mail your message s to your supervisor Performance ih Evaluation Network F lde List End Taek Write your message here Copyright 1444 WSS Pearson Inc All rights reserved APEN Ralpling froe phan 0800 169 9002 edexcel Dene E Trusted shes 7 3 Responding to Messages In the row of the message you want to read click on the contents of the From Subject or Date column and the message will be displayed Read the details and content of the message You can then choose to reply click Reply or archive click Archive this message This can be used to help you see the active messages while retaining previous mail S p From mackja Reply Forward Or To mackja Subject Example of message text A rc h Ive M essa g Sent Tue 2006 10 03 14 28 51 Example of message text Return to the Folder List folder list or the Welcome Page Print out the message or navigate to the next or previous message 14 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 8 0 View Progress During the Marking period you should use View Progress to monitor and plan your marking against your allocation and
14. by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Number of Responses How to Select Required Click on the response More than one Click on the first response hold the shift key on your keyboard adjacent item and click on other end of the range More than one non Click on the first response hold the Ctrl key on your keyboard adjacent response and click on as many other responses as you require All responses Click on the button Once you have selected the responses required click on the button You will now be returned to the Mark Student Responses window where you will be presented with the items that you have selected from the Review Own Responses screen You will see the previous mark awarded and the additional option The skip option allows you to quickly review the marks given previously without having to re mark the responses In this way you can quickly spot a discrepancy and if required change the mark using the marking grid and the button Figure 17 Review Your Own Scores Window Submit mark here wimi Score Skip Sond 1a Revine Skip the response if Hamama Ries panini marked correctly Clos Viewers Please note that the button becomes greyed out when you have completed reviewing your own responses and are back to live marking 5 7 Security Markers must not mark in public places All marking is confidential and must be carried out in private This mean
15. ck on the Commit Set button to receive a cm l mim R summary report of Total 2 marks fain Lo performance on the Set 7 i anea pray es 0 0 G SM GAL es A La Pr ut pe Sat 1 Time Siri J I Review TEST TEST DOC 1D S geoi 400202 TEST TEST GWQRE Gh d MARRS cacra Ta a Appi corii hiiri vi hiked Apt arad a feted ates The Summary Report for the Qualification Set will then appear The Summary Report for a Qualification Set gives details on whether each Response was scored correctly or incorrectly and an overall agreement with the True Scores It also indicates whether the Set has been passed or not soy The Response Summary On Oe eS ee eee ae indicates whether each s sC response was marked correctly r na E T e e D e ai or incorrectly by the Marker Yeu have competed of the 1 asi passadi fof dae Cabhin seta Rerponse Simimary Bi i d DR a J aA d a lt ar 0 g cesT a g Ik b The Scoring Summary indicates Somme a A aAA the agreement with the True Pemes m ae E ome Score across all responses pee within the Set i Baek ne ey rarest Agger Uae lester ane 26 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor If there is a requirement to see multiple Qualification Sets a Get Next Set button will be available Click on this to access the next Set
16. d by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 7 0 How to use Messaging 7 1 Reviewing Messages Received Messaging is available to all Markers and allows basic communication with your Supervisor Team Leader Figure 22 Messaging Screen F Pen Messaging Folder Display 05 Microsoft Internet Explorer provided by Edexcel Performance A Messaging Evaluation Network l Compose er Folders Contents of Inbox Inbox va z From amp Subject Date Leambs Copyright 1999 2006 NCS Pearson Inc All rights reserved ePEN helpline free phone O00 169 9202 cel From the available tasks list on the Welcome Screen you will have an option called Messaging You can respond to a message and access your archive You can also send messages The Messaging interface will open and show the contents of your inbox as a table Each row represents a message and shows whether it has been opened envelope icon who the sender is what the subject is the date and time sent 13 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 7 2 Sending a Message If you want to send a message from the initial messaging interface click Compose click inside the Message area that opens type your message and click Send Figure 23 Composing a message T Messaging Mall Compose 09 Microsoft Internat Explorer provided
17. edexcel advancing learning changing lives ePEN Marker User Guide ePEN 4 6 2 Issue 2 A PEARSON COMPANY Edexcel Limited Registered in England and Wales No 4496750 Registered Office One90 High Holborn London WC1V 7BH _ _ _ _ Contents 1 0 2 0 3 0 4 0 5 0 6 0 7 0 8 0 9 0 10 0 Introduction Getting Started How to Log into ePEN The Welcome Screen How to Mark Using ePEN Send to Review How to Use Messaging View Progress Updated from November 2009 Online Standardisation Activity only applicable to certain units Frequently Asked Questions and Trouble Shooting Appendix 1 Sequence of Events Note this document should be read in conjunction with ePEN Marker Activity Flow Charts Issue 1 Online E38 39 Edexcel is one of the leading examining and awarding bodies in the UK and 11 13 15 18 28 30 throughout the world We provide a wide range of qualifications including academic vocational occupational and specific programmes for employers Through a network of UK and overseas offices Edexcel s centres receive the support they need to help them deliver their education and training programmes to learners For further information please call our GCE line on 0844 576 0025 our GCSE team on 0844 576 0027 or visit our website at www edexcel com December 2009 All the material in this publication is copyright Edexcel Ltd 2009 Company Confidential
18. either you have not fully awarded marks within all the rows of the marking grids or you have not viewed all possible pages of a student response typically for longer essay style questions Please ensure that you exit the mark student responses screen using the button at the end of marking to ensure all marks are submitted 5 6 Review own Responses During the course of marking you may submit a mark and then wish to have another look at the student s response A number of student responses are held on your PC and are available for review If you want to review a mark you have a limited window in which to achieve this as only a limited number of responses are retained generally this is 5 depending on the size of the item Once you have marked the first response a new option will be available Figure 15 Review Own Responses Option o 1 Q05b Send To Review Review Responses Close Viewer a y 0 of 10 521_01_Q05b type Unscored scoreType Score responseld 362 Ll fi You will then be able to select the button which will show the available responses Figure 16 Select Own Responses to Review Response Fitters fern Se Od F DBseription S21 _ 02 Cet Te red a ree The last response marked always appears at the top of the list Solact All Dereci AT Kmera Rasporrees You can then select a response as follows 9 Company Confidential Prepared
19. en Marks can be submitted for the responses viewed using the marking grid Click in the grid and then click on the Submit Score button If the response has multiple pages scores cannot be submitted until all pages have been viewed Once a score has been 18 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor submitted the next response will appear To cease marking a particular item and return to the Welcome page click on the Close Viewer button When does Familiarisation Marking end Familiarisation Marking will end at 23 00hrs on the day before the standardisation activity date for the paper Any marking that has taken place will be reset and the scores deleted so that the Online Standardisation process can commence followed by live marking When this reset is taking place all Markers will be asked to log out of the ePEN system A message will appear as follows You have been logged out as a mark reset has taken place Please login again You will be able to log back into ePEN and commence the Practice and Qualification process within approximately 15 minutes 9 2 Marking Practice Sets Before you start marking the Practice Sets you must ensure that you have downloaded the Final Mark Scheme from Edexcel Gateway This will be posted no later than 23 00hrs on the day before the standardisation activity date The aim of the Practice Sets is similar to the photocopied scrip
20. ential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor In the example below the page has been adjusted to suit the marker and shows an essay type multiple page response in the process of being marked Figure 8 Marking Essay Type Question Ow x 2 e Raie Fart n Ami E a Section A Continued TNe INE LELEO TY The cnilds Ufe Sic YY KE ea nor MUO adorarnd WON Os are otOi CLIE i crm FAIL A De CaOS AVE oN Nay if INS MTEMA YWYXAKE GR SCA ke NO CVY EL pas mod Feu cses WY H ThHRO MASE PEVE ey A TNO LEETS SLUIS E ae Bk APAA zi 2 of 10 1209_2_001 typeeLinscoredscore lype Scorevesponseld 1023 You can navigate through the pages and adjust the image size using the options below Figure 9 Page Navigation di aril ele lOlOla Pagination icons Predefined views Drag scrolling tool when selected allows you to move the image in the marking window without using scroll bars Manual zoom These allow you to change the view of the student response This means that you can zoom in or zoom out at any time You will not need to change this setting every time you submit a mark You will however have to change the setting each time you log into the system or change the item you are marking For multi page responses you will have the ability to move through the pages using the pagination icons You will not be able to submit a mark
21. er score in marking grid and Linda says that the 175 g Regular tub is the better value for money Who is correct Submit score 4 elei 2 Pm STAT ia T 0 a Submit Scy E a 4q J gt 5521_02_028 type OCResponse scoreType Practice action Score qcSetid 25 responseld 105066 i12 iTi 20 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Each set consists of two types of responses Score Responses and Review Responses Once you have submitted a mark for the Score Response the Review Response will appear with feedback The responses will continue to appear in this alternate fashion Figure 31 Review Response item screen SINS Pearson e PIN Scoring Microsoft Internet Explorer provided by Edewcel L d als T h e st u d e nt re Sp O n se W i Fle Cdk en Favorkes Took Help Om O DAG Pau yr Que O Da Lj sdomre e appear in the top right emeh F 3 hip iepel enaking ou oan Epen eap Hore eni EJ a hand window The diagram shows a cuboid The True Score left side and the Marker s score right side appear in the middle window ANHMOTATION FOR Q0 DOC ID GEI 7400300022 TRUE SCORE 15 0 TEST ee eer Annotation if available oe appears in the lower window 5517170 001 i Appi iar mts scoring eraa d kra a a tharind E Tanted
22. ess http iwww exam2Zscore com edexcel PEN Online Training Site Practf ce Site Greann and Install ePEN r D Download and Install ive Mar PE Level Administration ePEN link GCSE ETE Helpdesk telephone Copyright 1999 2007 NCS Pearson Inc All rights reserved ePEN helpline free phone 0800 169 9202 If you have any issues with the installation please contact the helpdesk on 0800 169 9202 This number can be found in the bottom left hand corner of many ePEN screens The installer will also capture some information about the PC you are using An internet explorer window will open displaying this information and giving you the opportunity to send this information to Edexcel You do not have to submit your details but if you do it will allow us to greatly improve our support if you should have any problems using ePEN We will only pass on your details to approved third part support personnel if it is necessary and with your permission we will not pass your details on to anyone else Once you have installed the components for ePEN and have established an Internet connection you are ready to log into ePEN a Local intranet 2 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 2 1 Landing Page To log into ePEN you will need the following information Internet Address URL Username Password These will be sent t
23. essment Issue date 02 December 2009 Authorised By Peter Challinor The Qualification window contains a set of Qualification marking Instructions You must ensure that you read these instructions thoroughly Figure 35 Qualification Set Instructions EINS Pearson e PEH Scoring Microsoft Intermet Explorer provided by Edexcel Pel Fie Eat vem Favorites Took Hap i gma x E Fi jH Search sie Pawortes Que a4 M Fa BS B a ipa oo ae Read the Qualification Piw A bito fepenadt e marhing eu conjEpanwetapoliionaSanist bail d ich marking instructions q F iy ah Qualification Bett instructions Qaalification carefully Comprising Yeu Bare completed online practice anaig and you are about to begin ihe quibficabin process What is Qualification In quahhicalhen you score slide responses bo manome your underitandmg of tbe soormg cole as defined by ihe State The qualifying papers have been pre scored and approved by the State for wre in quaking scorers How Dip Quality You will be given the opportunity io take some sete of qualification papers E You wil read the pipers imd assign Scores as you ded for Lhe praciobe papers C l C k O n N ext You wil be given only one opportunety to take each Qualification sel R esponse to access Ad ibe end of qaaiification pou will be pregented a summary report showing your rerus When you t h fi t A S t quake pou wall be allowed to beg
24. fore you will be emailed a username and password shortly after accepting your contract Once you have logged in you will be in the ePEN Information and Training Site By clicking on the link you will have access to both the ePEN marker and supervisor courses It is essential that you complete the marker course and the online standardisation course if appropriate Supervisors will also need to complete the additional ePEN supervisor s training course s Once you have completed the courses return to the Home page and click on Here at the bottom of the page and complete a short questionnaire This allows us to monitor activity on the training site 3 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor These online training courses will enable you to familiarise yourself with ePEN functionality relating to marking and also the online standardisation process The online training courses are available for use throughout the marking period 2 3 Marking In The Practice Site When you click on the Practice Site link on the landing page you will be taken to the Practice Site login page The username and password provided and the initial login details for the Practice Site will be sent to you prior to the marking period When you login successfully to this site you will be prompted to change your password Please be aware that any password change Is site specific and will not be car
25. ged to mark all of their assigned items will be available for the rest of the marking team View Progress is reset to display a default allocation of 10000 8 6 Help The Help in View Progress displays the activity flow charts for reference 17 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 9 0 Online Standardisation Activity This section should only be referred to if the paper you have been contracted to mark is being standardised online Online Standardisation is a remote standardisation activity undertaken in place of holding a traditional standardisation meeting The aim of the activity remains the Same to ensure a well founded and common understanding of the requirements of the mark scheme that can be applied reliably Using the ePEN system it is possible to prepare standardisation material and make this available online Markers then have to complete three stages Familiarisation Marking Practice Marking Sets Qualification Marking Sets 9 1 Familiarisation Marking As soon as candidate scripts are scanned and items become available on ePEN normally 24 to 48 hours after the examination is sat you will have access to all the available items in order to familiarise yourself with candidate responses and the application of the provisional mark scheme This time is known as Familiarisation Marking The marks awarded at this stage will be reset prior to actual live ma
26. he responses will continue to appear in this alternate fashion If applicable the feedback on the responses within a Qualification Set is in the form of annotation This is prepared by the Principal Examiner and gives details of the True Score awarded and how the mark scheme was applied You are advised to read the annotation carefully especially where there is a deviation between the mark you awarded and the True Score You must ensure you work through the whole Set for an item in one session and not close your viewer part way through If you close your viewer you will need to work through all the responses for the item again until you come to the next available unscored item How to access Qualification Sets To access the Qualification Set s select an item from the Available Items drop down menu then Select Qualification from the Available Tasks drop down menu Figure 34 Select Qualification Ble POM Welcome 0S Microsett Internet Explorer provided by Edewcel l x Pie ide ew Marota Took Hab E Gp ox r wi 2 Pr F Pesch P Foeorter KA reis fe a la El a T ier i e neahing cu com Deerebapp Rede ectoncen l Select an item from R Welcome the Available Items Natasha Test Rudetsky drop down menu Performance A Evaluation Network there eel 12006 ities Select Qualification form the Available Tasks drop down menu le Treted e 23 Company Confidential Prepared by Online Ass
27. leted and you have clarified any issues with your Supervisor you can move onto the Qualification Set marking Note you can view the Practice Set items while in Qualification by accessing the Reference Library on the left hand side of the screen The aim of the Qualification Set is similar to the traditional first sample of marking CE1 but with the ability to feedback immediately to each marker on their performance All markers allocated to any given item will see the same Qualification Set s You are expected to pass a Qualification Set for an item before you can access Live Marking The pass criteria set for Qualification Set s ensures that the required accuracy in the application of the mark scheme has been demonstrated This is measured by comparing the scores you give to a response within a Set against the True Score attributed to a response The True Score is finalised at pre standardisation and is the responsibility of the Principal Examiner You are expected to access the Practice and Qualification Sets within 48 hours of the Familiarisation Marking Reset taking place Markers will only gain access to Live Marking for items when they have successfully completed and passed the Qualification Set s A Qualification Set will consist of a number of responses for a given item The set will consist of Score Responses and Review Responses Once you have submitted a mark for the Score Response the Review Response will appear with feedback T
28. n Imc All rights reserved akak FTH Melplinafree phone 000 169 1202 edexcel ave fal 2 iterfest Login Once you have entered your details click on the button Changing Passwords Please note that you will need to change your password the first time you log into any ePEN site and that you will be required to change your password during the marking period to maintain security If you have forgotten your password you can click on the link on the Login Page and you receive details of your password via email If you enter your login details incorrectly 3 times the system will lock your account If this happens please contact the helpdesk to re activate your account 4 0 The Welcome Screen Once you have successfully logged into ePEN you will be taken to a welcome screen as follows Figure 5 Welcome Screen Z e PEN Welcome 03 Microsoft Internet Explorer provided by Edexcel Fie Edit wiew Favorites Tools Help ae Q Back v x a A r Search e Favorites es Address a http prac01 e marking eu com EpenwWebapp RedirectionServlet action JoinPre Go T h e i t e m S a V a i a b e to you are displayed Performance Evaluation f in a drop down Welcome menu Janine Mackow Network Your available tasks Available Items i 1 Message 12032F 006 W are displayed in the ofthe Day Available Tasks d ro p d OW n m e n u i 05 10 2006 Choose your option scroll down s ccnose your option scroll
29. nt Responses as an If you have been sent a message the option option in the Available Tasks to Mark Student Responses is not available You must select Messages and read your mail first After reset if your paper is online standardised you must complete the Practice and Qualification Sets for the item before you have the option to Mark Student Responses 29 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Appendix 1 Sequence of Events The list below is to be used as a guide to the sequence of events that markers may be involved with It is by no means meant to cover all aspects of the marking process More detailed information can be found in the Online E38 39 booklet Before pre standardisation Receive passwords to Practice and Live Marking Complete online training courses and access the Practice Site Day after the exam access Edexcel Gateway for a copy of the Question paper and pre standardisation mark scheme Access live site after examination to practice marking live responses Familiarisation Marking Traditional Standardisation Activity Pre standardisation meetings use photocopies of either whole scripts or items Agreement of standards marks awarded Mark scheme updated and posted on Edexcel Gateway Markers and supervisors notified of assigned items Number of items for initial sample agreed to be submitted within 48 hours All Familiarisation
30. o you by email and letter before you are asked to start marking Your email provider s spam filter might occasionally hold the email with your login details in your J unk email folder We would therefore advise you to check this email folder A link to a practice site containing a sample of candidate responses from a previous series is available on www exam2score com This site should be used to test if ePEN has been installed correctly on your PC and also to familiarise yourself with the functionality within the ePEN system Your username and password for this site will be made available through to you before you are asked to start marking When you access the web address specified in the letter specifying your login details you will be presented with the ePEN landing page as shown below O SS SS i asx Link to Online Training Site Ea Link to Practice Site containing historical items Copyright 1999 2007 ACS Pearson le AM rights reserved BPEH helpline Tree phone oo 167 F202 Done interet 2 2 Online Training Site When you click on the Online Training Site link on the landing page you will be asked to provide your Edexcel Gateway username and password Your username will be your email address If you cannot remember your password you can regenerate it by clicking on the Forgotten your password link on the login page at www edexcelgateway com If you are a new examiner and have not used Edexcel Gateway be
31. plete your marking on a particular item a default message asking you to contact your supervisor will appear It is advisable that you check your marking progress through item and see if your progress through cap is 100 and if your cap has not been set at a different value to the allocation If you are showing 100 against your allocation for that item you should mark a different item until all items show 100 If you have a cap set at a different value to that of the allocation then you must contact your Supervisor in the first instance When you have marked all items assigned to you you have completed your contract At this point the system may allocate additional responses that have not been allocated to other markers This reallocation of responses from the unallocated pool will occur every 15 minutes once you have completed your contract This is a default setting and may be changed during a series Once the reallocation takes place the View Progress will show a new item allocation which will be larger than the original allocation You will now be able to continue marking any additional responses This may occur before the contract completion date as long as the contracted items have been marked Note The Progress Through Contract is not updated with the new allocation values 8 5 Allocation of Items After the Contract Completion Date On the day after the contract completion date 00 01hrs the allocation of any marker who has not mana
32. ponse AN Send a request to review this response Are you sure Java Applet Window Clicking on Yes will bring up a window where you can select the category and enter text to describe the issue with the item Figure 20 Send To Review Options 3 Send to Review Select a Review Option and provide a message 1000 char max if desired Type comment here Review Options Choose an Option p Malpractice Sample 11 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor When the Send to Review window appears you must first select a category from the Review Options drop down menu Choose an Option Suggested Reasons for Using Each Option A query about the mark scheme Out of Clip The student has written outside the area presented Malpractice You suspect malpractice Not applicable for Examiners Markers Any other reason Once selected you are required to write a message explaining why you opted to send the response to review Once you have made your selection click on the Send To Review button which will then send the message including the actual response to your supervisor who will take further action Once you have selected a category you can then send the response to review or cancel Figure 21 Submit To Review Review Options LY Send To Review j Java Applet Window 12 Company Confidential Prepare
33. rence Library You will be given the opportunity to take some sets of practice papers You will have the opportunity to review practice papers via the ePEN Reference Library Remember practice makes perfect Click the Next Annotations Response button to Keep in mind that annotations are useful guides in explaining how the Rubric applies to a particular response Please read the Annotations for b e g n every paper even for the papers you scored correctly This will help you score in a consistent manner e y Next R Sponse View the candidates response resizing the screen if necessary and using the marking grid enter the appropriate mark for the response The items where you allocate marks are known Score Responses If the response is multi page all pages will need to be viewed before the Submit Score button becomes active Figure 30 Practice Response Z NCS Pearson e PEN Scoring Microsoft Internet Explorer provided by Edexcel M efx gt File Edit View Favorites Tools Help ay Address amp http ipracO1 e marking eu com EpenWebapp HomeServlet x Go Practice Set 1 a Instructions D Response 1 28 Response 2 Response 3 200g Large A Large tub of popcorn costs 3 80 and holds 200 g A Regular tub of popcorn costs 3 50 and holds 175 g o C Reference Library Rob says that the 200g Large tub is the better value for money Ent
34. ried forward to any other site Therefore you will be required to enter the username and password provided twice once for each site Practice and Live A sample of non subject specific historical responses will be available for marking on the practice site This site will be available for practice marking to familiarise yourself with the functionality of ePEN and will continue to be available during the marking period 3 0 How to Log into ePEN Live Marking To log into ePEN you will need to open Internet Explorer and enter the Internet Address assigned to you This will take you to a page which will allow you to select the level of qualification you wish to mark Once you have selected the level the page will display the administration associated with that level Select the relevant administration and click the Enter ePEN button Figure 3 ePEN Landing Page or Homepage E ePen 05 Microsoft Internet Explorer provided by Edexcel File Edit view Favorites Tools Help Q sax x A CD search Sle ravortes A R i LJ 2 Address http y www exam score com Defaukt aspx First select the Level of Qualification e g GCE or GCSE edexcel OPEN Then select the Administration subj ect English GCSE November 2007 Mathematics GCSE November 2007 group Mathematics iGCSE November 2007 i Science 360 GCSE November 2007 Enter button Administration Copyright 1999 2007 NCS Pear
35. rking commencing You must ensure that before accessing Familiarisation Marking you have downloaded and printed a copy of the question paper and mark scheme from Edexcel Gateway www edexcelgateway com so that you can familiarise yourself with the questions and mark scheme Please bear in mind that in the early stages of Familiarisation Marking there may only be limited work available due to the scanning and editing stages of the online marking process All markers are expected to feedback to their supervisor prior to the end of Familiarisation Marking regarding any omissions or amendments to the mark scheme These comments will be used at the pre standardisation when the final mark scheme is agreed Any queries regarding the content or application of the mark scheme should also be raised with your supervisor either by telephone e mail or using the ePEN messaging system How to access Familiarisation Marking To access Familiarisation Marking you need to log into the ePEN live site and then select the Qualification level and Administration Once in the Welcome Page select an item from the Available Items drop down menu then select Mark Student Responses from the Available Tasks drop down menu See Sections 3 0 and 4 0 of this guide for further details The Mark Student Responses window will appear displaying the candidate response which can be resized Please refer to Section 5 0 of this guide for instructions on how to resize the scre
36. s that online marking should be undertaken at home or in a private office at your place of work If you only have access to a PC at work where other members of staff have access please discuss this with your QDA Manager Subject Leader and your employer prior to installing ePEN and undertaking any marking Edexcel recommends that when you leave your PC unattended for any length of time you log off the system completely If you do not the system will log you off automatically and produce a Session Error message You will need to close your Internet Explorer program and open again before logging back into ePEN 10 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 6 0 Send To Review 6 1 Using Send To Review If during the course of marking you are unable to award a mark for any reason you can send the response to your Team Leader for review together with an explanation of the issue with the response Sending a response for review will move the response out of your marking queue to your Team Leader for appropriate action Figure 18 The send to review option Trait Score l Submit Score irii E jii Send To Review Select the Send to Review option q After you select the Send to Review button a confirmation box will appear asking you to confirm your request Figure 19 Send to review dialogue box 1 Request review of res
37. s you have marked for each item and should be used to help with planning your marking This screen also displays your allocation per item The sum of your allocation per item will be the Same as your contracted responses for that paper Figure 27 Marking Progress By Item The marking progress for the whole paper is also displayed i e the Marking Progress By Item Item Item Type Progress Through Cap Allocation Overall Responses Completed By Ite Q03c EXPERT eA apni 100 oe total number of Q04bc EXPERT 23 ean 100 ae responses marked by wie ee Tae Ea Tnme_ laces ain ee Pss 51 100 51 250 scanned responses ee Spe 0 100 oil 0 250 available when you Qo7cd EXPERT T 100 0 250 first log in this number will be low it will increase as more scripts are scanned in The item type is Your marking Allocation per item displayed progress for each item The Progress Through Cap column shows the number of responses you have marked against your cap Normally your cap should equal your allocation Where your cap is less than your allocation you should contact your Supervisor for advice Note Your Supervisor can also view this information 8 1 Allocation of Items Before Standardisation Familiarisation Marking After the examination has been sat a small number of scripts are scanned to enable you to view candidates responses prior to pre standardisation At this stage all available markers will have the defaul
38. sconng actial student responses If pou d not socesshilhy pass e Q u a C a O n e the quaificalon sez you wil be prin mination on how to proceed otis F Heri Responsen ry NE f pa Ciia ft hori var T A ear A a herd 1 Trua a Once you have read the instructions thoroughly and have to hand a copy of the final mark scheme you can access the Qualification Set by clicking on Next Response The first Score Response will appear resize the screen as necessary see section 5 of this guide Figure 36 Submit Qualification Score The first Score response will appear in the top right hand ti i ppa 30 Work out i i Wi ndow Use the marking grid to enter a score and click on Submit Score iow OBS 44 gt E A a E E e Wa n The mark that the response is worthy of according to the final mark scheme should be entered using the marking grid Click on Submit Score The Review Response will appear showing the True Score and any annotation if applicable The current Response will always be highlighted in blue in the top left hand window This window also gives information on how many Responses there are in a Set how many have been attempted and how many are remaining 24 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Figure 37 Qualification Set Information iz uWalification Set 1 Instructions D Response 1 Current respon
39. se is always a Review highlighted in blue Remaining responses are always greyed out At any time the Reference Library can be opened to refer to those responses scored in Practice Double click on the Reference Library folder in the bottom left hand window or click onthe icon next to the folder A new folder will appear which details the paper and item number Double click on this or click on the icon next to the folder Another folder will appear Practice Double click on this or click on the icon next to the folder all responses in the Practice Set will be shown Simply click on any of these responses to view Figure 38 Viewing Practice Set items in the Reference Library T NCS Pearson e PIM Scoring Microsoft Intermed Lxplorer provided hy Edexcel Elek Fle Edt ew Frote Toot Help Om O DAO Ome dam Ge O42 Bw The Reference Library can be le hrc eing ns conferring nea JE opened at any time by clicking on the folder 30 Work out 4 3 5 The responses in the Reference Library can be viewed one by one When a response in the Reference Library is highlighted blue the students response True Score and Annotation will appear in the Right hand windows 5521 _01_030 ype 0t Response tbi ety iian scion tinier ges el 14a pir 18 T 4B Applet com nes BONAJ A E airian Ap shorted E Trusted shes By clicking on Next Response all responses in the Reference Library can be viewed
40. son Inc All rights reserved ePEN helpline free phone 0800 169 9202 a Local intranet You will then be taken to the ePEN login screen see Figure 3 ePEN Landing Page Instructions on how to use these pages are provided with your user account details that will be sent to you prior to the examination series Please note that your user name and password are case sensitive 4 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Figure 4 ePEN Login Screen T NCS Pearson eP EH image Scoring B1 Microsoft Internet Explorer provided by Edexcel fie Ei ven Fyi jok Help G a a i Arn frre a m a Sects A hupe 180 14 117 r apasae H Eo u o Edexcel will assign you a user name and password You must enter this here Performance Evaluation Network Microzett s Evtermet Explore verag Password reminder link CLICE HERE FOR PASSWORD REM E you enter your pasword micermecty three times your account wil wutomabealy be locked and you wil need to tomat the AA Hefodesk on 0800 169 9202 te be unlocked Therefore f you have already ined unsuccessfully to log on pero tees and are still unsure of pour password i is recommended bat Fou cick on the render ink above The ink vel ead your current password to pou for you bp s on ph third altempt and aeond rou hiang to contact the Helpdesk Copright amp 1952 2008 NES Pearso
41. t allocation of 10000 and a cap of 10000 for each item to allow them to mark using the provisional mark scheme to note any issues e g Item Item Type Progress Through Cap Allocation Overall Responses Completed By Item ree 3 10000 10000 42 750 16 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 8 2 On the day of the Standardisation activity All the marks in ePEN are reset This means that any marking undertaken prior to the reset is deleted Your Progress Through Cap will be reset to display O until you start marking Please note that if you sent any items to review these will not be reset Your Supervisor will be required to mark these items The allocation and cap columns should always have the same values Only in exceptional circumstances will these differ e g where a marker has been capped due to quality issues 8 3 Allocation of Items After Standardisation Once a sufficient number of candidates scripts have been scanned into ePEN the allocation and cap values will be amended automatically The value of the allocation will add up to the number of responses that a Marker has been contracted to mark The cap will automatically be set at the value of the allocation unless it has been amended manually e g Item Item Type Progress Through Cap Allocation Overall Responses Completed By Item Q03c EXPERT Of 150 150 0 0 2300 8 4 Marking your allocation As you com
42. telephone or e mail before a Qualification Set is attempted 21 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor Figure iret cb 33 ing M Practice Set Summary Report tial lalar gpliret piowkded by Eitri The Overall Practice Summary indicates the Set requirements The Agreement Percent Summary indicates the agreement with the True Score and the agreement within adjacency Click on Get Next Set to proceed to the subsequent Set alternatively return to Se Se mm O the Welcome Page by clicking on Close Viewer Note If there is a requirement to see multiple Practice Sets a button appears Get Next Set Click on this to access the next Set Practice Sets will be available for all the items that you are contracted to mark These need not all be attempted at one time For example you could progress to Qualification for some items before completing the Practice Sets for other items Once the required number of Practice Sets have been attempted use the Close Viewer button to return to the Welcome page You will still only have access to a limited number of available tasks from the Welcome Page These are View Progress Messaging and Qualification 22 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 9 3 Qualification Marking Once the Practice Set for an item has been comp
43. ts that would have been used at a traditional standardisation meeting to provide feedback and details of how marks should be awarded The Practice Set s allow you to become more familiar with the candidate responses to items and the application of the Final Mark Scheme Each Practice Set consists of a number of responses for a given item All of the markers allocated to any given item will see the same Practice Set s Note You must work through the whole Set for an item in one session and not close your viewer part way through If you close your viewer you will need to work through all the responses for the item again until you come to the next available unscored item How to access Practice Sets Once all the Familiarisation Marking has been reset you will also only have access to a limited number of available tasks The only Available Tasks that you will see when you log into ePEN are as follows View Progress Messaging and Practice From the Welcome Screen select an item from those available in the drop down list Select Practice from the Available Tasks drop down list Figure 28 Options in Available Tasks Available Items 5521 02 026 kd Select an item Available Tasks Choose your option scroll down Choose your option scroll down Select Practice from the Available Tasks View Progress Messaqing 19 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised B
44. until all the scanned pages have been reviewed even if the candidate has not written on them 7 Company Confidential Prepared by Online Assessment Issue date 02 December 2009 Authorised By Peter Challinor 5 4 Marking Tools For some papers marking tools are made available such as a ruler or angle measure Both of these tools can be used by clicking on the buttons at the bottom of the marking window and then clicking and holding the left mouse button on the image and dragging the mouse over the area The tool can be manipulated on screen by left clicking and holding the small boxes situated on the tools and dragging to the required position Figure 10 Example of a Measuring Tool in use Sarr ered I In some cases an overlay will be available for example where the student Is required to draw a graph or geometric shape This can be used in the same way as the measurement tools Once the overlay is placed on the student response it can be moved or rotated as required by left clicking on the squares at the end of the toolbar Some items will have the following icons also displayed which can be used to annotate onscreen Figure 11 Annotating your marking Click for predefined Highlighter colour Note Not all papers require these tools so the icons may not appear when you mark Highlighter pens 5 5 Marking Grids The marking grid displays the possible marks available for a particular item Each grid is designed specifically
45. y Peter Challinor You will see a set of Practice marking instructions in the marking window as shown in Figure 28 Please ensure you read these thoroughly and ensure that a copy of the final mark scheme is to hand Then click the Next Response button to begin Figure 29 Practice Marking Instructions Z NCS Pearson e PEN Scoring Microsoft Internet Explorer provided by Edexcel mef gt File Edit View Favorites Tools Help ae Address El http pracO1 e marking eu com EpenWwebapp HomeServlet bi Go Practice Set 1 4 b instructions Practice Response 1 Practice Marking Response 2 Raenonse 3 Now it s time to practice what you ve learned n st r u ct i O n S What are Practice Papers Practice papers are sample student responses that allow you to practice scoring You will be more successful in this task if you refer to your Rubric and your Anchor Papers as guides You will score each paper then receive feedback on your scoring This is your chance to assign scores to actual student responses to compare the scores you give with the scores given for the practice responses and to adjust when your scores do not agree Keep in mind these are Practice papers and completing them should be a learning experience When the score you give a paper does not match the score for response read the annotation and try to understand why the paper was given that True Score a Scoring Practice Papers o C Refe
Download Pdf Manuals
Related Search