Home

pyIRSF user`s manual the English version

image

Contents

1. To see how to use the options execute mktwflist py without arguments A quick list will be displayed 2 A warning message while mktwflist py is running The background level monotonically increases in the morning and decreases in the evening while observing twilight sky frames when there is no cloud on the sky When it does not some of the frames may have observed cloud in the field A message like background level unstable at 030313 0010 appears on the terminal when the background does not change monotonically in the J band The warning is also recorded in jbackground txt with an asterisk at the end of the lines for unstable frames The background level is affected also by OH and thermal emissions for the H and K bands Therefore it does not always indicates the presence of cloud when the background doesn t change monotonically in the H and K bands So the masseges are not displayed on the terminal but recoreded in hlk background txt This warning messege is recorded in mktwfwarning txt as well 3 Output files from mktwflist py jlhlk flatlist are the input files to twfcom py and jlhlk flatlist 0 are log files The following is an example of jflatlist more jflatlist 030129 0025 0036 3310 0 1254 0 030129 0026 0040 3001 0 928 0 030129 0027 0044 2724 0 720 0 030129 0914 0909 4712 0 2468 0 030129 0913 0907 4157 0 1912 0 030129 0912 0905 3651 0 1465 0 The first line denotes that the J band frame
2. 1 Make a working directory 2 execute imgrecom py para in the working directory 3 execute imgrecom py set yields a message this time imgrecom py set multiple fields are mixed in imgrecom list The content of imgrecom list is shown below The field index at the first column includes not only 1 but also 2 and 3 which indicates that there 010102 ffiles 0450 0 0 0 0 1 omegalen 5 0 010102 ffiles 0451 14 6 3 9 1 omegaCen 5 0 010102 ffiles 0452 7 5 13 1 1 omegaCen 5 0 010102 ffiles 0453 3 9 14 6 1 omegaCen 5 0 010102 ffiles 0454 13 1 7 5 1 omegaCen 5 0 010102 ffiles 0455 14 6 3 9 1 omegaCen 5 0 010102 ffiles 0456 7 5 13 1 1 omegaCen 5 0 010102 ffiles 0457 3 9 14 6 1 omegaCen 5 0 010102 ffiles 0458 13 1 7 5 1 omegaCen 5 0 010102 ffiles 0459 0 0 0 0 2 omegalensky 5 0 010102 ffiles 0460 010102 ffiles 0461 10 0 17 4 2 omegaCensky 5 010102 ffiles 0462 5 2 19 4 2 omegaCensky 5 010102 ffiles 04635 17 4 10 0 2 omegaCensky 010102 ffiles 0464 19 4 5 2 2 omegaCensky 5 010102 ffiles 0465 10 0 17 4 2 omegaCensky 010102 ffiles 0466 5 2 19 4 2 omegaCensky 5 010102 ffiles 0467 17 4 10 0 2 omegaCensky 010102 ffiles 0468 0 0 0 0 3 Ceni 30 0 010102 ffiles 0469 14 6 3 9 3 CenA1 30 0 010102 ffiles 0470 7 5 13 1 3 CenA1 30 0 010102 ffiles 0471 3 9 14 6 3 CenAl 30 0 iles 04 0 0 010102 ffiles 0473 14 6 3 9 3 Cen 30 0 010102 ffiles 0474 7 5 13 1 3 CenA1 30 0 010102 ffiles 0475 3 9 14 6 3 CenA1 30 0 01010
3. 01 46 0492 Cenaz FO 7 5 143 1 2001 01 03 02 27 0452 omegaCen 5 7 5 13 1 2001 01 03 01 47 0493 Ceng2 30 3 9 14 6 20017 01703 02 28 d 0453 omegaCen 5 3 9 14 6 2001 01 03 01 47 0494 Cend 30 13 4 7 5 20047 01703 02 29 40 0454 omegaCen 5 13 1 7 5 2001 01 03 01 44 0495 CenAZsky 30 0 0 0 0 2001 01 03 02 34 0455 omegaCen 5 14 6 3 9 2004 01 03 01 49 0496 CenAazsky 30 19 4 5 2 2004 01 03 02 32 0456 omegaCen 5 7 5 13 1 2001 01 03 01 4 o497 CenAgsky 30 10 0 17 4 2001 01 03 02 7 0457 omegaCen 5 3 9 14 6 2001 01 03 01 50 0498 Cena sky 30 5 2 19 4 2004 01 03 O02 0458 omegaCen 5 13 1 7 5 2001 01 03 01 50 0499 Cenagsky 30 17 4 10 0 2001 01 03 O2 0459 omegalCensky 5 0 0 0 0 2001 01 04 01 9 0500 CenA sky 30 19 4 5 2 2001 01 05 02 7 0460 omegalensky 3 19 4 5 2 2001 01 05 01 0501 CenA sky 30 10 0 17 4 2004 04 03 Og 0461 omegalCensky 5 10 0 17 4 2001 01 04 J 0502 CenA sky 30 5 2 19 4 7001 01 05 02 4 0462 omegalensky 5 5 2 19 4 2001 01 05 OF 0503 CenA gsky 30 17 4 10 0 2001 01 03 02 0463 omegaCensky 5 17 4 10 0 2001 01 03 0504 CenAS 30 0 0 0 0 2001 01 03 02 41 23 0464 omegalensky 5 19 4 5 2 2001 01 04 0J 0505 CenAS 30 14 6 3 9 2001 01703 OF 47 24 0465 omegalensky 5 10 0 17 4 2001 01 05 0506 CenA3 30 7 5 13 1 2001 01 05 02 43 24 0466 omegalensky 5 5 24 19 4 2001 01 03 OF o507 Cena s 30 3 9 14 6 2001 01 03 OF 44 9 0467 omegaCensky 5 17 4 10 0 2001 01 03 Q 0508 CenAS 30 13 1 7 5 2001 01 03 02 45 23 0468
4. 02 54 34 0485 CenAisky 30 17 4 10 0 2001 01 03 02 19 16 0517 CenA3sky 30 17 4 10 0 2001 01 03 02 55 0486 CenA2 30 0 0 0 0 2001 01 03 02 21 04 7 2004 0518 CenA3sky 30 19 4 5 2 2001 01 03 02 56 4 0487 CenA2 30 14 6 3 9 2001 01 03 02 22 01 7 200 0519 CenA3sky 30 10 0 17 4 2001 01 03 02 54 0488 CenAZ 30 7 5 13 1 2001 01 03 02 23 04 5 200 0520 CenASsky 30 5 2 19 4 2001 01 03 02 58 4 0489 CenA2 30 3 9 14 6 2001 01 03 02 24 05 0 20 0521 CenA3sky 30 17 4 10 0 2001 01 03 02 59 4 Execute sirius py para 5 Execute sirius py set 6 Execute sirius py run 7 View the results The working directory is like below 010102 ffiles jmflat fitse log obs log recom param hmflat fits kmflat fits of1 CenAl obslog sirius param There is only one resultant directory with a target name 01 CenA1 in the working directory because the same field is observed for all CenA1 CenA2 and CenA3 pyIRSF automatically recognises if the same field is observed for different sets based on RA DEC RA_OFF and DEC_OFF in the FITS header of each frame RA_OFF and DEC_OFF are the offset from the dithering center If the dithering centers are within 10 arcsec pyIRSF recognises them to be the same field Observed sets with the same field and exposure time are registered and combined into a sigle image per band The target name of the first set will be used in o integer target name 5 4 Pairing of a target and a sky bias set pyIR
5. 0364 M42_nisky 10 12 6 27 53 2005 12 26 20 0319 M42_n1 10 3 9 14 6 2005 12 26 20 03 0365 M42_nisky 10 12 6 27 53 2005 12 26 20 0320 M42_n1 10 3 9 14 6 2005 12 26 20 03 0366 M42_nisky 10 12 6 27 53 2005 12 26 20 0321 M42_ni 10 3 9 14 6 2005 12 26 20 03 0367 M42_nisky 10 27 3 12 6 2005 12 26 20 0322 M42_ni 10 3 9 14 6 2005 12 26 20 04 0368 M42_nisky 10 27 3 12 6 2005 12 26 20 0323 M42_ni 10 6 3 13 7 2005 12 26 20 04 2 0369 M42_nisky 10 27 3 12 6 2005 12 26 20 0324 M42_ni 10 6 3 13 7 2005 12 26 20 04 4 0370 M42_nisky 10 27 3 12 6 2005 12 26 20 0325 M42_ni 10 6 3 13 7 2005 12 26 20 04 51 1491 DARK 10 0 0 0326 M42_ni 10 6 3 13 7 2005 12 26 20 05 1 1492 DARK 10 O 0 0327 M42_ni 10 13 7 6 3 2005 12 26 20 05 3 1493 DARK 10 O 0 0328 M42_ni 10 13 7 6 3 2005 12 26 20 05 41 1494 DARK 10 0 0 0329 M42_ni 10 13 7 6 3 2005 12 26 20 06 0 1495 DARK 10 O 0 0330 M42_n1 10 13 7 6 3 2005 12 26 20 06 14 1496 DARK 10 O 0 0331 M42_n1sky 10 0 0 0 0 2005 12 26 20 13 1497 DARK 10 O 0 0332 M42_nisky 10 0 0 0 0 2005 12 26 20 13 1498 DARK 10 0 0 0333 M42_nisky 10 0 0 0 0 2005 12 26 20 13 1499 DARK 10 O 0 0334 M42_nisky 10 0 0 0 0 2005 12 26 20 14 31 1500 DARK 10 0 0 0335 M42_nisky 10 29 1 7 8 2005 12 26 20 14 Note that a set of a target 0291 0330 in this example must be a neighbor of a set of a sky bias If the object name ends with sky regardless of the lower or upper cases the set is r
6. 21 1 DARK 10 0 0 0339 M42_nisky 10 17 1 24 6 2005 12 26 0533 M42_n5 10 0 0 0 0 2005 12 26 24 1 DARK 10 0 0 0340 M42_nisky 10 17 1 24 6 2005 12 26 0534 M42_n5 10 0 0 0 0 2005 12 26 21 1 DARK 10 0 0 0341 M4Z_nisky 10 17 1 24 6 2005 12 26 0535 M4Z_n5 10 14 6 3 9 2005 12 26 21 DARK 10 0 0 0342 M42_nisky 10 17 1 24 6 2005 12 26 0536 M42_n5 10 14 6 3 9 2005 12 26 21 DARK 10 0 0 0343 M42_nisky 10 0 3 29 7 2005 12 26 0537 M42_n5 10 14 6 3 9 2005 12 26 21 DARK 10 0 0 0538 M42_n5 10 14 6 3 9 2005 12 26 21 DARK 10 O O DARK 10 0 0 skipping here skipping here 4 Prepare flatfield images and put them in the working directory 5 Execute sirpol py para 6 Execute sirpol py set 7 Execute sirpol py run 8 View the results 051726 ffiles jtwftandte fits htwtJandte fits ktwftJande fits log o1 M42_n1 obslog obslos recom param Sirpol param There is only one resultant directory with a target name 01 M42_n1 in the working directory because the same field is observed for all M42_n1 n9 pyIRSF automatically recognises if the same field is observed for different sets based on RA DEC RA_OFF and DEC_OFF in the FITS header of each frame RA_OFF and DEC_OFF are the offset from the dithering center If the dithering centers are within 10 arcsec pyIRSF recognises them to be the same field Observed sets with the same field and exposure time are registered and combined
7. 30 0 0 0397 NGC2024C 30 14 6 3 9 2001 01 04 01 06 29 3 2 0364 NGC2024 30 0 0 0 0 2001 01 04 00 22 07 0 2001 0398 NGC2024C 30 7 5 13 1 2001 01 04 01 07 25 9 0365 NGC2024 30 14 6 3 9 2001 01 04 00 23 04 9 200 0399 NGC2024C 30 3 9 14 6 2001 01 04 01 08 22 2 2 0366 NGC2024 30 7 5 13 1 2001 01 04 00 24 01 4 200 0400 NGC2024C 30 13 1 7 5 2001 01 04 01 09 19 0 2 0367 NGC2024 30 3 9 14 6 2001 01 04 00 24 57 6 20l 0401 NGC2024Csky 30 0 0 0 0 2001 01 04 01 13 31 3 0368 NGC2024 30 13 1 7 5 2001 01 04 00 25 53 7 20l 0402 NGC2024Csky 30 14 6 3 9 2001 01 04 01 14 27 8 0369 NGC2024 30 14 6 3 9 2001 01 04 00 26 50 6 20i 0403 NGC2024Csky 30 7 5 13 1 2001 01 04 01 15 24 3 0370 NGC2024 30 7 5 13 1 2001 01 04 00 27 48 3 2I 0404 NGC2024Csky 30 3 9 14 6 2001 01 04 01 16 20 0371 NGC2024 30 3 9 14 6 2001 01 04 00 28 44 8 20I 0405 NGC2024Csky 30 13 1 7 5 2001 01 04 01 17 17 0372 NGC2024 30 13 1 7 5 2001 01 04 00 29 41 1 20 0406 NGC2024Csky 30 14 6 3 9 2001 01 04 01 18 14 0374 NGC2024sky 30 0 0 0 0 2001 01 04 00 36 09 9 2I 0407 NGC2024Csky 30 7 5 13 1 2001 01 04 01 19 10 0375 NGC2024sky 30 19 4 5 2 2001 01 04 00 37 06 1 0408 NGC2024Csky 30 3 9 14 6 2001 01 04 01 20 07 0376 NGC2024sky 30 10 0 17 4 2001 01 04 00 38 02 7 0409 NGC2024Csky 30 13 1 7 5 2001 01 04 01 21 03 0377 NGC2024sky 30 5 2 19 4 2001 01 04 00 38 59 1 0410 NGC2024D 30 0 0 0 0 2001 01 04 01 24 10 9 200 0378 NGC2024sky 30 17 4 10 0 2001 01 04 00 39 56 0411 NGC20
8. 6 2005 12 26 2 M42_n9sky 10 7 8 29 1 2005 12 26 0326 M42 n1 10 6 3 13 7 2005 12 26 20 0520 M42_n4 10 3 9 14 6 2005 12 26 2 M42_n9sky 10 7 8 29 1 2005 12 26 0327 M42 n1 10 13 7 6 3 2005 12 26 20 0521 M42_n4 10 3 9 14 6 2005 12 26 2 M42_n9sky 10 7 8 29 1 2005 12 26 0328 M42_ n1 10 13 7 6 3 2005 12 26 20 0522 M42_n4 10 3 9 14 6 2005 12 26 2 M42_n9sky 10 12 6 27 3 2005 12 26 0329 M42 n1 10 13 7 6 3 2005 12 26 20 0523 M42_n4 10 6 3 13 7 2005 12 26 21 M42_n9sky 10 12 6 27 3 2005 12 26 0330 M42 n1 10 13 7 6 3 2005 12 26 20 0524 M42_n4 10 6 3 13 7 2005 12 26 21 M42_n9sky 10 12 6 27 3 2005 12 26 0331 M42_n1sky 10 0 0 0 0 2005 12 26 2 0525 M42_n4 10 6 3 13 7 2005 12 26 21 M42_n9sky 10 12 6 27 3 2005 12 26 0332 M42_n1sky 10 0 0 0 0 2005 12 26 2 0526 M42_n4 10 6 3 13 7 2005 12 26 21 M42_n9sky 10 27 3 12 6 2005 12 26 0333 M42_n1sky 10 0 0 0 0 2005 12 26 2 0527 M42_n4 10 13 7 6 3 2005 12 26 21 M42_n9sky 10 27 3 12 6 2005 12 26 0334 M42_n1sky 10 0 0 0 0 2005 12 26 2 0528 M42_n4 10 13 7 6 3 2005 12 26 21 M42_n9sky 10 27 3 12 6 2005 12 26 0335 M42_n1sky 10 29 1 7 8 2005 12 26 0529 M42_n4 10 13 7 6 3 2005 12 26 21 M42_n9sky 10 27 3 12 6 2005 12 26 0336 M42_n1sky 10 29 1 7 8 2005 12 26 0530 M42_n4 10 13 7 6 3 2005 12 26 21 DARK 10 0 0 0337 M4Z2_nisky 10 29 1 7 8 2005 12 26 0531 M42_n5 10 0 0 0 0 2005 12 26 21 1 DARK 10 0 0 0338 M4Z_nisky 10 29 1 7 8 2005 12 26 0532 M42_n5 10 0 0 0 0 2005 12 26
9. 6 4 9 1 omegaCen 5 0 gigidz 7 5 14 1 1 omegaCen 5 0 tal Ola ea 5 9 14 6 1 omegalen 5 0 gioid 13 1 7 5 1 omegaCen 5 0 gigidz i4 6 4 9 1 omegaCen 5 0 O4101L02 7 5 153 1 1 omegalen 5 0 gioid 4 9 14 6 1 omegaCen 5 0 a a ae 14 1 7 5 1 omegaCen 5 0 1 1 1 1 1 1 1 1 1 The columns denotes field index yymmdd ffiles frame number ra_off dec_off set number object name and exposure time In this example number in the first column is 1 for all the lines which indicates that these frames have the same field and exposure time If you delete lines in this file the corresponing frame will not be combined 4 execute imgrecom py run in the working directory Similar messages as sirius py run appears on the terminal This creates combined FITS files and jlhlk quality txt in the working directory homegalen fits imegrecom list jquality txt kquality txt sS1irilus param quality txt jomevalen fits komegalen fits recom param Case2 to process frames from a night when yymmdd ffiles contains multiple targes imgrecom py can process one field of a target at a time However it often happens that frames for multple targets are included in a yymmdd ffile directory It is tedious to remove unnecessary frames from a yymmdd ffile directory But you don t have to do that You can specify a field to combine with a command option of imgrecom py In this example there are frames for omegaCen and CenA in 010102 ffiles
10. Ceni 30 0 0 0 0 2001 01 03 07 01 21 0509 Cena z 30 14 6 3 9 7001 01703 OF 46 49 0469 Ceni 30 14 6 4 9 FOOLSO1L OS OF 102 73 0510 Cengs 30 7 5 13 1 FO0O1LfO1L 035 OF 47 0470 CenAt 30 7 5 13 1 2001 01 03 07 03 29 0541 CenQ z 30 3 9 14 6 2001 01703 07 48 43 0471 Cengi 30 3 9 14 6 2001 01 03 07 04 49 o517 CenQs 30 13 1 7 5 7001 01 03 07 49 43 O4 2 Ceni 30 14 1 7 5 2ZOOL O1 08 Of 05 4 0543 CenAssky 40 0 0 0 0 FOOLeLfOLL OS OF S1 04 75 Ceni 30 14 6 4 9 FPOOL O1 05 OF 06 4 o514 CenAssky S30 19 4 5 7 2OOLLOL OS OF S53 0474 Ceni 30 7 5 13 1 2001 01 03 02 07 0515 Cend3sky 30 10 0 17 4 2001 01 03 02 5 0475 CenAal 30 3 9 14 6 2001 01 03 02 08 49 0516 Cen 3sky 30 5 2 19 4 2001 01 03 02 5 0476 Ceni 30 13 4 7 5 2004 01 03 02 09 49 o547 Cend3sky 30 17 4 10 0 2004 01 03 OF 0477 CenAisky 30 0 0 0 0 2001 01 03 02 11 0518 CenaS3sky 30 19 4 5 2 2004 01 03 02 5 O478 CenAlsky 30 19 4 5 2 7001 01 03 Of 14 0519 CenAssky S40 10 0 17 4 FOOLS OL OS OF 0479 CenAisky 30 10 0 17 4 2001 01 03 02 4 o520 CenASsky 30 5 2 19 4 2001 01 03 02 5 0480 CenAtsky 30 5 2 19 4 2001 01 03 02 4 0521 Cenfasky 30 17 4 10 0 2001 01 03 O02 0481 CenAisky 30 17 4 10 0 2001 01 03 OF 0452 CenAisky 30 19 4 5 2 2001 01 03 OF 0483 CenAisky 30 10 0 17 4 7001 01 03 Og 0484 CenAisky 30 5 2 19 4 2001 01 03 OF 0485 CenAisky 30 17 4 10 0 2001 01 03 OF The lines for dark were omitted The obslog file includes sets of a standard star omegaCe
11. integration time These frames are need to be registered and combined into one frame per band Here is an example that a field of M42 was observed with four sets on 2005 12 26 1 Make a working directory at the same level as the rawdata directory 2 Make an obslog file by executing mklog py in the working directory 3 Modify the obslog file FRAME OBJECT ITIME RA_OFF DEC_OFF DATE_ inn 0291 M42_n1 10 0 0 0 0 2005 12 26 19 5 skipping here _ Skipping here 0292 M42 n1 10 0 0 0 0 2005 12 26 19 5 0486 M42_n3sky 10 12 6 27 3 2005 12 2 M4Z2_n9 10 13 7 6 3 2005 12 26 722 0293 M42_n1 10 0 0 0 0 2005 12 26 19 5 0487 M4Z2_n3sky 10 27 3 12 6 2005 12 2 M42_n9 10 13 7 6 3 2005 12 26 22 0294 M42 n1 10 0 0 0 0 2005 12 26 19 5 0488 M4Z2_n3sky 10 27 3 12 6 2005 12 2 M42_n9 10 13 7 6 3 2005 12 26 22 0295 M42 n1 10 14 6 3 9 2005 12 26 19 0489 M42Z2_n3sky 10 27 3 12 6 2005 12 2 M42_n9 10 13 7 6 3 2005 12 26 22 0296 M42 n1 10 14 6 3 9 2005 12 26 19 0490 M42_n3sky 10 27 3 12 6 2005 12 2 M42_n9sky 10 0 0 0 0 2005 12 26 22 0297 M42 n1 10 14 6 3 9 2005 12 26 19 0491 M42_n4 10 0 0 0 0 2005 12 26 21 0 M42_n9sky 10 0 0 0 0 2005 12 26 22 0298 M42 n1 10 14 6 3 9 2005 12 26 19 0492 M42_n4 10 0 0 0 0 2005 12 26 21 0 M42_n9sky 10 0 0 0 0 2005 12 26 22 0299 M42 n1 10 8 6 12 3 2005 12 26 19 0493 M42_n4 10 0 0 0 0 2005 12 26 21 0 M42_n9sky 10 0 0 0 0 2005 12 26 22 0300 M42 n1 10 8 6 12 3 2005
12. into a sigle image per band The target name of the first set will be used in o integer target name 6 4 Pairing of a target and a sky bias set pyIRSF makes a pair of a target set and a sky bias set based on the obslog file The median sky from the sky bias set is subtracted from each frame in the target set The rules of the pairing is the same for SIRIUS and SIRPOL Please refer the section 5 4 about the rule and replace sirius py with sirpol py when using SIRPOL data 6 5 Rules for the image registration and how to change it By default all frames from the sets with the same dithering center and exposure time in the obslog file are to be combined to one image for each band by sirpol py run process lt does not matter if the object names are not the same Besides that by default frames with object name ending with sky or std are not combined Again the rules for the image registration is the same for SIRIUS and SIRPOL Please refer the section 5 5 about the rule and replace sirius py with sirpol py when using SIRPOL data 6 6 Some important remarks on obslog One of the most important points described so far is that how you edit object names and how you combine sets of observations determine the pipeline process It can be modified later by editing objectskylist and dithsetlist though Some important remarks on how to describe the obslog file is described in 5 6 6 6 Tuning the pipeline process 1 by editting
13. is observed for two sets when the dithering center coordinates are within this limit This valus is set to be 10 arcseconds by default Cfitsio Set this value to 0 when you don t have the cfitsio library installed in your computer and have uncompressed FITS files in the rawdata directory You don t need to uncompress FITS files in the rawdata directory if you have cfitsio installed keepd Average combined dark images for dark subtraction are removed after the pipeline process by default If you set this to be 1 they will remain keeps Sky bias images for sky bias subtraction are removed after the pipeline process by default If you set this to be 1 they will remain keepm Bad pixel mask images are removed after the pipeline process by default If you set this to be 1 they will remain 5 9 Tuning the pipeline process 2 by editting recom param The recom param file created by sirius py para contains parameters for image registration and recombination You need to finish editting it before sirius py run search 20 search radius minsep 9 minimum separation reject 0 reject in imcombine O sigclipli minmax ifwhm 3 5 initial guess of fwhm for daofind lstarnum 3 lower limit for the number of matched stars in a field ufwhm 10 upper limit for fwhm Wellip i upper limit for ellipticity urms 0 5 upper limit for matching rms mlim 0 1 upper limit for magnitude error theta 0 fov sS up
14. multiple nights Here is an example to combine frames for a field of 30Dor from 050701 and 050703 They have been processed with sirius py and there are 050701 ffiles and 050703 ffiles somewhere 1 Make a working directory 2 Create a symbolic link of each yymmdd ffiles to the working directory or copy yymmdd ffiles to the working directory 3 Make another working directory at the same directory as yymmdd ffiles S ls 050701 ffiles 050703 ffiles mywrk 4 execute imgrecom py para in the working directory at the same level as yymmdd ffiles mywrk this example 5 execute imgrecom py set in the same directory An imgrecom list file will be created 050701 ffiles 2137 0 0 0 0 1 30Dorn2 5 0 050701 ffiles 2138 19 4 5 2 1 30Dorn2 5 0 050701 ffiles 2139 11 4 16 4 1 30Dorn2 5 0 050701 ffiles 2140 0 2 19 8 1 30Dorn2 5 0 050701 ffiles 2141 14 2 14 2 1 30Dorn2 5 0 050701 ffiles 2142 19 8 0 2 1 30Dorn2 5 0 050701 ffiles 2143 16 4 11 4 1 30Dorn2 5 0 050701 ffiles 2144 5 2 19 4 1 30Dorn2 5 0 050701 ffiles 2145 8 4 18 2 1 30Dorn2 5 0 050701 ffiles 2146 18 2 8 4 1 30Dorn2 5 0 050701 ffiles 2157 0 0 0 0 2 30Dorn3 30 0 050701 ffiles 2158 19 4 5 2 2 30Dorn3 30 0 050701 ffiles 2159 11 4 16 4 2 30Dorn3 30 0 050701 ffiles 2160 0 2 19 8 2 30Dorn3 30 0 050701 ffiles 2161 14 2 14 2 2 30Dorn3 30 0 050701 ffiles 2162 19 8 0 2 2 30Dorn3 30 0 050701 ffiles 2163 16 4 11 4 2 30Dorn3 30 0 050701 ffiles 2
15. previous example 1 to make a working directory at the same level as the rawdata directory mklog py object NGC2024 is much easier here as well 2 to make an obslog file by executing mklog py in the working directory 3 to modify the obslog file NGC2024 NGC2024sky NGC2024B NGC2024C NGC2024Csky and NGC2024 were observed with an exposure time of 30 second for frames 0364 0418 in a row A set of 30 second dark frames were obtained for frames 0031 0040 Remove the rest from the obslog file Sets of frames were observed in an order of target sky bias target target sky bias target Note that a set of a target must be a neighbor of a set of a sky bias otherwise sirius py set yields FRAME OBJECT ITIME RA_OFF DEC_OFF DATE_UTC TIME_UTC 0387 NGC2024B 30 13 1 7 5 2001 01 04 00 53 18 0 2 0031 DARK 30 0 0 0388 NGC2024B 30 14 6 3 9 2001 01 04 00 54 14 7 2 0032 DARK 30 0 0 0389 NGC2024B 30 7 5 13 1 2001 01 04 00 55 11 1 0034 DARK 30 0 0 0390 NGC2024B 30 3 9 14 6 2001 01 04 00 56 07 7 2 0034 DARK 30 0 0 0391 NGC2024B 30 13 1 7 5 2001 01 04 00 57 04 3 2 0035 DARK 30 0 0 0392 NGC2024C 30 0 0 0 0 2001 01 04 01 01 45 9 200 0036 DARK 30 0 0 0393 NGC2024C 30 14 6 3 9 2001 01 04 01 02 42 1 20 0037 DARK 30 0 0 0394 NGC2024C 30 7 5 13 1 2001 01 04 01 03 39 6 20 0038 DARK 30 0 0 0395 NGC2024C 30 3 9 14 6 2001 01 04 01 04 36 6 2 0039 DARK 30 0 0 0396 NGC2024C 30 13 1 7 5 2001 01 04 01 05 33 0 2 0040 DARK
16. s foack compressed files with extension of fits fz or cfitsio s imcopy compressed files with extension of fits ic You do not need to uncompress compressed files Then move into the working directory and create a list to specify dates from which twilight sky data are available Just write dates line by line as shown in the following example S more dlist 030211 030214 030219 You do not need to be too careful Directories without twilight sky data are just ignored The mktwflist py program examines the FITS header of every FITS file in the specified directories A FITS file having OBJECT twflat is considered to be twilight flat data frame If you are suspicous about the correction process you may skip this step and use the flatfield images calculated in the standard manner with twflatcom py Basic processes 1 Execute mktwflist py in the working directory first as shown in the following example mktwflist py dlist A list specifying the date directories is given as the first argument If there is no twilight sky data at a specified date a message like No flat frames taken on 030211 is shown At the end of the process messages like the following will be displayed a total of 62 pairs are selected for j a total of 59 pairs are selected for h a total of 47 pairs are selected for k Done As the results jlhlk flatlist 0 jlhik flatlist jlhlk backround txt mktwflist param wi
17. the simplest case In this example there is a directory 010102 ffiles in a directory There are FITS files after the dark subtraction flat correction and sky bias subtraction processes only for a target omegaCen of a field i e the same dithering center and an exposure time The content of the 010102 ffiles directory is shown below hfO450 fits hf 454 fits hf 458 fits Jf 4553 fits jrfO45 fits kPO4d52Z fits kfO456 fits HhfO451 fits hf 455 fits JFf0450 fits jfOdo4 fits jfO4ne fits kFOdDS fits kf 457 fits hfO4o2 fits hf 456 fits Jf 451 fits jJf 455 fits kf 450 fits kf 454 fits kf 458 fits hfO455 fits hf 457 fits jJf 4bz fits Jf 456 fits kfO451 fits kf 455 fits 1 Make a working directory at the same directory as the yymmdd ffiles directory ls 010102 ffiles wrk The name of the working directory can be anything 2 execute imgrecom py para in the working directory and sirius param and recom param will be created If necessary edit the parameters in these files sirius param is shorter than that created by sirius py para because some of the parameters are not necessary for registration and recombination band jhk jlhlk jhk default jhk crremove 0 cosmic ray removal O no L imin max method dtime 10 in minutes Ffldrad 10 in arcsec 3 execute imgrecom py set in the working directory to make a text file imgrecom list OTOL OZ 0 0 0 0 1 omegalen 5 0 gioid 14
18. unnecessary lines This night M42_n1 and M42_n1sky a sky bias field for M42_n1 were observed with an exposure time of 10 seconds for frames 0291 0330 and 0331 0370 respectively A set of 10 second dark frames were obtained for frames 1491 1500 which are necessary to process the above set of M42_n1 The obslog file will be like the below FRAME OBJECT ITIME RA_LOFF DEC_OFF DATE_UTC T 0336 M42_nisky 10 29 1 7 8 2005 12 26 20 14 0291 M42_n1 10 0 0 0 0 2005 12 26 19 55 46 0337 M42_nisky 10 29 1 7 8 2005 12 26 20 14 0292 M42_n1 10 0 0 0 0 2005 12 26 19 56 01 0338 M42_nisky 10 29 1 7 8 2005 12 26 20 15 0293 M42_n1 10 0 0 0 0 2005 12 26 19 56 17 1 0339 M42_nisky 10 17 1 24 6 2005 12 26 20 1 0294 M42_n1 10 0 0 0 0 2005 12 26 19 56 32 4 0340 M42_nisky 10 17 1 24 6 2005 12 26 20 1 0295 M42_n1 10 14 6 3 9 2005 12 26 19 56 51 0341 M42_nisky 10 17 1 24 6 2005 12 26 20 1 0296 M42_n1 10 14 6 3 9 2005 12 26 19 57 06 0342 M42_nisky 10 17 1 24 6 2005 12 26 20 1 0297 M42_n1 10 14 6 3 9 2005 12 26 19 57 22 0343 M42_nisky 10 0 3 29 7 2005 12 26 20 1 0298 M42_n1 10 14 6 3 9 2005 12 26 19 57 37 0344 M42_nisky 10 0 3 29 7 2005 12 26 20 1 0299 M42_n1 10 8 6 12 3 2005 12 26 19 57 56 0345 M42_nisky 10 0 3 29 7 2005 12 26 20 1 0300 M42_ni 10 8 6 12 3 2005 12 26 19 58 11 0346 M42_nisky 10 0 3 29 7 2005 12 26 20 1 0301 M42_n1 10 8 6 12 3 2005 12 26 19 58 27 0347 M42_nisky 10 21 3 21 3 2005 12 26 20 0302 M42_ni 10 8 6
19. 0 29 14 7 8 2005 12 28 0984 DARK 50 0 0 0167 30Dor_nisky 20 29 1 7 8 2005 12 28 0985 DARK 20 00 0168 30Dor_nisky 20 29 1 7 8 2005 12 28 0986 DARK 20 00 0169 30Dor_nisky 20 17 1 24 6 2005 12 29 0987 DARK 20 00 0170 30Dor_nisky 20 17 1 24 6 2005 12 29 0988 DARK 20 0 0 0171 30Dor_nisky 20 17 1 24 6 2005 12 29 0989 DARK 20 00 n 0990 DARK 20 0 0 skipping here 0991 DARK 20 0 0 0992 DARK 20 0 0 Sets of frames were observed in an order of target sky bias target target sky bias Note that a set of frames for a target must be a neighbor of a set of frames for a sky bias otherwise Sirpol py set yields an error message and you can t proceed further 4 Prepare flatfield images and put them in the working directory 5 Execute sirpol py para 6 Execute sirpol py set 7 Execute sirpol py run 8 View the results The working directory will be like below o integer target name directory will be created for each target in which resultant files are 051278 ffiles ktwfLPO6Jun fits of M1_1 recom htwfLPF0SJun fits logy obslog recom param JtwfLPOS Jun fits o1 s00or_ni obslog sirpol param stored o integer is an index to dinstinguish the target sets The index is used so that one can register and combine frames from different sets of the same target name separately 6 3 To process a target observed with multiple sets One often observes a target with many sets to increase a total
20. 0476 Ceni 0477 0485 skyl 0486 0494 Cen 0477 0485 0495 0503 skyz 0504 0517 Cend 0495 0503 skys Sirius py skyset Then all the files related to sky bias process will be updated Then execute Sirius py run 5 5 Rules for the image registration and how to change it By default all frames from the sets with the same dithering center and exposure time in the obslog file are to be combined to one image for each band by sirius py run process It does not matter if the object names are not the same Besides that by default frames with object name ending with sky or std are not combined describe how to change these rules By modifying dithsetlist The sirius py set process makes a text file dithsetlist denoting how to combine frames based on the dithering center exposure time and object name Here is an example of the obslog file from 2001 01 02 0382 p9l09std 20 0 0 0 0 2001 01 03 00 09 0426 Cenaz FO 0 0 0 0 20017 01703 02 24 01 0383 p9109std 70 120 0 120 0 2001 01 03 Od 0487 Cena 30 14 6 3 9 2001 01 03 07 27 04 0384 p9109std 20 120 0 120 0 2001 01 03 0488 Cena 30 7 5 13 1 2001 01 03 07 73 04 0385 p9109std Z0 120 0 120 0 Z2001701 03 0489 Ceng2 30 3 9 14 6 20041 01703 02 24 40 0386 p9i09std 20 120 0 120 0 2001 01 03 0 0490 Cena 30 143 1 7 5 2004 01 03 02 25 0 0450 omegaCen 5 0 0 0 0 2001 01 03 01 46 00 0491 Cena 30 144 6 3 9 2001 01 03 OF 76 0451 omegaCen 5 14 6 3 9 2004 01 03
21. 05 12 26 0313 M42 n1 10 14 8 0 1 2005 12 26 20 0507 M42_n4 10 10 7 10 7 2005 12 26 2 M42_n9sky 10 21 3 21 3 2005 12 26 0314 M42 n1 10 14 8 0 1 2005 12 26 20 0508 M42_n4 10 10 7 10 7 2005 12 26 2 M42_n9sky 10 21 3 21 3 2005 12 26 0315 M42_n1 10 12 3 8 6 2005 12 26 2 0509 M42_n4 10 10 7 10 7 2005 12 26 2 M42_n9sky 10 21 3 21 3 2005 12 26 0316 M42 n1 10 12 3 8 6 2005 12 26 2 0510 M42_n4 10 10 7 10 7 2005 12 26 2 M42_n9sky 10 29 7 0 3 2005 12 26 0317 M42_n1 10 12 3 8 6 2005 12 26 2 0511 M42_n4 10 14 8 0 1 2005 12 26 21 M42_n9sky 10 29 7 0 3 2005 12 26 0318 M42 n1 10 12 3 8 6 2005 12 26 2 0512 M42_n4 10 14 8 0 1 2005 12 26 21 M42_n9sky 10 29 7 0 3 2005 12 26 0319 M42 n1 10 3 9 14 6 2005 12 26 2 0513 M42_n4 10 14 8 0 1 2005 12 26 21 M42_n9sky 10 29 7 0 3 2005 12 26 0320 M42 n1 10 3 9 14 6 2005 12 26 2 0514 M42_n4 10 14 8 0 1 2005 12 26 21 M42_n9sky 10 24 6 17 1 2005 12 2 0321 M42 n1 10 3 9 14 6 2005 12 26 2 0515 M42_n4 10 12 3 8 6 2005 12 26 2 M42_n9sky 10 24 6 17 1 2005 12 2 0322 M42 n1 10 3 9 14 6 2005 12 26 2 0516 M42_n4 10 12 3 8 6 2005 12 26 2 M42_n9sky 10 24 6 17 1 2005 12 2 0323 M42 n1 10 6 3 13 7 2005 12 26 20 0517 M42_n4 10 12 3 8 6 2005 12 26 2 M42_n9sky 10 24 6 17 1 2005 12 2 0324 M42_ n1 10 6 3 13 7 2005 12 26 20 0518 M42_n4 10 12 3 8 6 2005 12 26 2 M42_n9sky 10 7 8 29 1 2005 12 26 0325 M42 n1 10 6 3 13 7 2005 12 26 20 0519 M42_n4 10 3 9 14
22. 0501 CenAzsky 30 10 0 17 4 2001 01 03 02 34 0470 Cen 1 30 7 5 13 1 2001 01 03 02 03 23 4 200 0502 CenAzsky 30 5 2 19 4 2001 01 03 02 38 4 0471 CenAt 30 3 9 14 6 2001 01 03 02 04 23 7 20 0503 CenAzsky 30 17 4 10 0 2001 01 03 02 39 0472 CenA1 30 13 1 7 5 2001 01 03 02 05 24 0 20 0504 CenAs 30 0 0 0 0 2001 01 03 02 41 23 0 0473 Cen 1 30 14 6 3 9 2001 01 03 02 06 24 6 20 0505 CenA3s 30 14 6 3 9 2001 01 03 02 42 24 1 0474 Cen 1 30 7 5 13 1 2001 01 03 02 07 27 4 2 0506 CenAS 30 7 5 13 1 2001 01 03 02 43 24 8 0475 Cen 1 30 3 9 14 6 2001 01 03 02 08 34 0 20 0507 CenA3S 30 3 9 14 6 2001 01 03 sue oe 0476 Cen 1 30 13 4 7 5 2001 01 03 02 09 36 2 20 0508 CenAS 30 13 1 7 5 2001 01 03 02 45 26 0477 CenAisky 30 0 0 0 0 2001 01 03 02 11 14 0 2 0509 CenA3s 30 14 6 3 9 2001 01 03 02 46 27 4 0478 CenAisky 30 19 4 5 2 2001 01 03 02 12 13 8 0510 CenA3S 30 7 5 13 1 2001 01 03 02 47 29 0479 CenAisky 30 10 0 17 4 2004 01 03 02 13 14 1 0511 CenA3S 30 3 9 14 6 2001 01 03 02 48 30 4 0480 CenAisky 30 5 2 19 4 2001 01 03 02 14 14 5 0512 CenAS 30 13 1 7 5 2001 01 03 02 49 32 0481 CenAisky 30 17 4 10 0 2001 01 03 02 15 14 0513 CenA3sky 30 0 0 0 0 2001 01 03 a ee 0482 CenAisky 30 19 4 5 2 2001 01 03 02 16 16 4 0514 CenAS3sky 30 19 4 5 2 2001 01 03 02 52 3 0483 CenAisky 30 10 0 17 4 2001 01 03 02 17 15 0515 CenA3sky 30 10 0 17 4 2001 01 03 02 53 4 0484 CenAisky 30 5 2 19 4 2001 01 03 02 18 16 3 0516 CenA3sky 30 5 2 19 4 2001 01 03
23. 12 26 19 0494 M42_n4 10 0 0 0 0 2005 12 26 21 0 M42_n9sky 10 29 1 7 8 2005 12 26 2 0301 M42 n1 10 8 6 12 3 2005 12 26 19 0495 M42_n4 10 14 6 3 9 2005 12 26 21 M42_n9sky 10 29 1 7 8 2005 12 26 2 0302 M42 n1 10 8 6 12 3 2005 12 26 19 0496 M42_n4 10 14 6 3 9 2005 12 26 21 M42_n9sky 10 29 1 7 8 2005 12 26 2 0303 M42 n1 10 0 1 14 8 2005 12 26 19 0497 M42_n4 10 14 6 3 9 2005 12 26 21 M42_n9sky 10 29 1 7 8 2005 12 26 2 0304 M42 n14 10 0 1 14 8 2005 12 26 19 0498 M42_n4 10 14 6 3 9 2005 12 26 21 M42_n9sky 10 17 1 24 6 2005 12 26 0305 M42 n1 10 0 1 14 8 2005 12 26 19 0499 M42_n4 10 8 6 12 3 2005 12 26 21 M42_n9sky 10 17 1 24 6 2005 12 26 0306 M42_n1 10 0 1 14 8 2005 12 26 19 0500 M42_n4 10 8 6 12 3 2005 12 26 21 M42_n9sky 10 17 1 24 6 2005 12 26 0307 M42 n1 10 10 7 10 7 2005 12 26 2 0501 M42_n4 10 8 6 12 3 2005 12 26 21 M42_n9sky 10 17 1 24 6 2005 12 26 0308 M42_n1 10 10 7 10 7 2005 12 26 2 0502 M42_n4 10 8 6 12 3 2005 12 26 21 M42_n9sky 10 0 3 29 7 2005 12 26 0309 M42_n1 10 10 7 10 7 2005 12 26 2 0503 M42_n4 10 0 1 14 8 2005 12 26 21 M42_n9sky 10 0 3 29 7 2005 12 26 0310 M42 n1 10 10 7 10 7 2005 12 26 2 0504 M42_n4 10 0 1 14 8 2005 12 26 21 M42_n9sky 10 0 3 29 7 2005 12 26 0311 M42_n1 10 14 8 0 1 2005 12 26 20 0505 M42_n4 10 0 1 14 8 2005 12 26 21 M42_n9sky 10 0 3 29 7 2005 12 26 0312 M42 n1 10 14 8 0 1 2005 12 26 20 0506 M42_n4 10 0 1 14 8 2005 12 26 21 M42_n9sky 10 21 3 21 3 20
24. 12 3 2005 12 26 19 58 42 0348 M42_nisky 10 21 3 21 3 2005 12 26 20 0303 M42_ni 10 0 1 14 8 2005 12 26 19 59 0 0349 M42_nisky 10 21 3 21 35 2005 12 26 20 0304 M42_n1 10 0 1 14 8 2005 12 26 19 59 1i 0350 M42_nisky 10 21 3 21 3 2005 12 26 20 0305 M42_n1 10 0 1 14 8 2005 12 26 19 59 3 0354 M42_nisky 10 29 7 0 3 2005 12 26 20 1 0306 M42_n1 10 0 1 14 8 2005 12 26 19 59 4 0352 M42_nisky 10 29 7 0 3 2005 12 26 20 1 0307 M42_n14 10 10 7 10 7 2005 12 26 20 00 0353 M42_nisky 10 29 7 0 3 2005 12 26 20 1 0308 M42_n1 10 10 7 10 7 2005 12 26 20 00 0354 M42_nisky 10 29 7 0 3 2005 12 26 20 1 0309 M42_n14 10 10 7 10 7 2005 12 26 20 00 0355 M42_nisky 10 24 6 17 1 2005 12 26 20 0310 M42_n1 10 10 7 10 7 2005 12 26 20 00 0356 M42_nisky 10 24 6 17 1 2005 12 26 20 0311 M42_n1 10 14 8 0 1 2005 12 26 20 01 1 0357 M42_nisky 10 24 6 17 1 2005 12 26 20 0312 M42_n1 10 14 8 0 1 2005 12 26 20 01 2 0358 M42_nisky 10 24 6 17 1 2005 12 26 20 0313 M42_n1 10 14 8 0 1 2005 12 26 20 01 4 0359 M42_nisky 10 7 8 29 1 2005 12 26 20 0314 M42_n1 10 14 8 0 1 2005 12 26 20 01 5 0360 M42_nisky 10 7 8 29 1 2005 12 26 20 0315 M42_n1 10 12 3 8 6 2005 12 26 20 02 0361 M42_nisky 10 7 8 29 1 2005 12 26 20 0316 M42_n1 10 12 3 8 6 2005 12 26 20 02 0362 M42_n sky 10 7 8 29 1 2005 12 26 20 0317 M42_n1 10 12 3 8 6 2005 12 26 2030234 0363 M42_n sky 10 12 6 27 3 2005 12 26 20 0318 M42_n1 10 12 3 8 6 2005 12 26 20 03
25. 164 5 2 19 4 2 30Dorn3 30 0 050701 ffiles 2165 8 4 18 2 2 30Dorn3 30 0 050701 ffiles 2166 18 2 8 4 2 30Dorn3 30 0 050703 ffiles 1714 0 0 0 0 3 30Dorn1 5 0 050703 ffiles 1715 19 4 5 2 3 30Dorn1 5 0 050703 ffiles 1716 11 4 16 4 3 30Dorni1 5 0 050703 ffiles 1717 0 2 19 8 3 30Dorn1 5 0 050703 ffiles 1718 14 2 14 2 3 30Dorni1 5 0 050703 ffiles 1719 19 8 0 2 3 30Dorni 5 0 050703 ffiles 1720 16 4 11 4 3 30Dorn1 5 0 050703 ffiles 1721 535 2 19 4 3 30Dorn1 5 0 050703 ffiles 1722 8 4 18 2 3 30Dorni 5 0 050703 ffiles 1723 18 2 8 4 3 30Dorni 5 0 050703 ffiles 1734 0 0 0 0 4 30Dorn2 5 0 050703 ffiles 1735 19 4 5 2 4 30Dorn2 5 0 050703 ffiles 1736 11 4 16 4 4 30Dorn2 5 0 050703 ffiles 1737 0 2 19 8 4 30Dorn2 5 0 050703 ffiles 1738 14 2 14 2 4 30Dorn2 5 0 050703 ffiles 1739 19 8 0 2 4 30Dorn2 5 0 050703 ffiles 1740 16 4 11 4 4 30Dorn2 5 0 050703 ffiles 1741 5 2 19 4 4 30Dorn2 5 0 050703 ffiles 1742 8 4 18 2 4 30Dorn2 5 0 050703 ffiles 1743 18 2 8 4 4 30Dorn2 5 0 NNNNNNNNNNFPRBPBBEBBBEBERE PRPPPPPBPBPBPBPBBBBBEBBEPPBPPE There are frames with a exposure time of 30 second in 050701 ffiles in this example which are distinguished from frames with 5 second exposure time and a field index of 2 is assigned Even if there are frames with the same frame number frames from different nights are distinguished and you don t need to alter the file name by your hand 6 execute imgrecom py run field index To combine fram
26. 1_1sky 20 29 7 0 3 2005 12 28 21 5 0149 30Dor_ni 20 3 9 14 6 2005 12 28 2 0265 M1_1sky 20 24 6 17 1 2005 12 28 74 0150 30Dor_ni 20 3 9 14 6 2005 12 28 2 0766 M1_4sky 20 24 6 17 1 2005 12 28 2 01541 S0Dor_ni 20 3 9 14 6 2005 12 28 2 O 67 M1_4sky 20 24 6 17 1 2005 12 28 2 0152 S0Dor_ni 20 3 9 14 6 2005 12 28 27 0768 M1_4sky 20 24 6 17 1 2005 12 28 2 0153 S0Dor_ni 20 6 3 13 7 2005 17 28 20 0269 M1 dsky 20 7 8 29 1 2005 12 28 22 0154 30Dor_n1 20 6 3 13 7 2005 12 28 20 0270 M1_1sky 20 7 8 29 1 2005 12 28 22 0155 30Dor_n1 20 6 3 13 7 2005 12 28 20 0271 M1_1sky 20 7 8 29 1 2005 12 28 22 0156 30Dor_n1 20 6 3 13 7 2005 12 28 20 0272 M1_1sky 20 7 8 29 1 2005 12 28 22 0157 30Dor_n1 20 13 7 6 3 2005 12 28 20 0273 M1_1sky 20 12 6 27 3 2005 12 28 22 0158 30Dor_n1i 20 13 7 6 3 2005 12 28 20 0274 M1_isky 20 12 6 27 3 2005 12 28 22 0159 30Dor_n1i 20 13 7 6 3 2005 12 28 20 0275 M1_isky 20 12 6 27 3 2005 12 28 22 0160 S0Dor_ni 20 13 7 6 3 2005 17 28 20 0276 M1_1sky 20 12 6 27 3 2005 12 28 27 01641 30Dor_nisky 20 0 0 0 0 2005 17 28 J 0277 M1_1sky 20 27 3 12 6 2005 12 28 22 0162 30Dor_nisky 20 0 0 0 0 2005 17 28 7 0278 M1_1sky 20 27 3 12 6 2005 12 28 0163 30Dor_nisky 20 0 0 0 0 2005 12 28 0279 M1_1sky 20 27 3 12 6 2005 12 28 72 0164 30Dor_nisky 20 0 0 0 0 2005 17 28 0780 M1_1sky 20 27 3 12 6 2005 12 28 27 0165 30Dor_nisky 20 29 4 7 8 2005 12 28 0983 DARK 20 00 0166 30Dor_nisky 2
27. 2 0 z000 13 2 7 5 15 1 2001 01 05 01 49 59 4 2001 01 06 05 49 39 4 519112 0 2000 13 3 9 14 6 20010103 01 50 13 7 2001 01 0 03 50 15 7 514912 0 z000 13 2 14 1 7 5 2001 0705 01 50 49 5 20017017035 05 50 49 5 514912 0 2000 15 2 0 0 0 0 2001 01 03 01 52 51 4 001 01 03 04 52 51 4 514912 0 2000 145 19 4 5 2 2001 01 03 01 55 26 0 200 ols 05 55 26 0 519112 0 2000 13 10 0 47 4 20010103 01 54 01 7 2001701708 04 54 01 7 514912 0 2000 1 5 2 19 4 2001 01 05 01 54 37 5 Z001r01 05 03 54 57 353 519124 0 2000 1 17 4 10 0 ZOOL Ole OSs 01 55 15 1 SOUL OLS 04 55 13 1 514912 0 z00 19 4 5 2 2007 01 04 01 55 46 9 4001 01 08 03 55 48 9 519124 0 4000 1 10 0 Lf ed 2001 01 04 01 56 24 8 20010103 0 56 24 8 511912 0 2000 ove 19 4 2007 01 05 01 57 00 5 z001r01 05 03 57 00 5 519124 0 2000 1 7 10 0 20017017035 01 57 36 3 2001 0 Os 05 57 46 5 514912 0 2000 Oooo oo on oo Ooo oo on on oo Note that a set of a target 0450 0458 in this example must be a neighbor of a set of a sky bias If the object name ends with sky regardless of the lower or upper cases the set is recognised to be a set of a sky bias for the adjacent target set s Now 4 Execute sirius py para in the working directory sirius py para yymmdd is 010102 the mastar flat frames are deployed A message to confirm the date appears What is the second message Flat correction frames were not prepared this time sirius py noticed that and declared to use the master fl
28. 2 ffiles 0476 13 1 7 5 3 CenAl 30 0 010102 ffiles 0486 0 0 0 0 4 CenA2 30 0 010102 ffiles 0487 14 6 3 9 4 CenA2 30 0 010102 ffiles 0488 7 5 13 1 4 CenAZ2 30 0 010102 ffiles 0489 3 9 14 6 4 CenAZ2 30 0 010102 ffiles 0490 13 1 7 5 4 CenA2 30 0 010102 ffiles 0491 14 6 3 9 4 CenAZ2 30 0 010102 ffiles 0492 7 5 13 1 4 CenA2 30 0 010102 ffiles 0493 3 9 14 6 4 CenA2 30 0 010102 ffiles 0494 13 1 7 5 4 CenA2 30 0 010102 ffiles 0504 0 0 0 0 5 CenA3 30 0 010102 ffiles 0505 14 6 3 9 5 CenA3 30 0 010102 ffiles 0506 7 5 13 1 5 CenA3 30 0 010102 ffiles 0507 3 9 14 6 5 CenA3 30 0 010102 ffiles 0508 13 1 7 5 5 CenA3 30 0 010102 ffiles 0509 14 6 3 9 5 CenA3 30 0 010102 ffiles 0510 7 5 13 1 5 CenA3 30 0 010102 ffiles 0511 3 9 14 6 5 CenA3 30 0 010102 ffiles 0512 13 1 7 5 5 CenA3 30 0 LN ON ON ON ON ON ON ON ON ON ON ON ON OW ON OW OU OW OJ OW ON ON are frames for three fields 4 execute imgrecom py run field index You can specify a field to regoster and combine by adding a field index at the end of the command In this example if you want to register and combine omegaCen execute imgrecom py run 1 Then lines with the field index of 1 are extracted from the list and their frames are processed Alternatively you can remove the lines for the other fields than that you want to register and combine from imgrecom list by your hand then execute just imgrecom py run Case 3 to process frames from
29. 24D 30 14 6 3 9 2001 01 04 01 25 06 3 20 0379 NGC2024sky 30 19 4 5 2 2001 01 04 00 40 53 2 0412 NGC2024D 30 7 5 13 1 2001 01 04 01 26 02 3 20 0380 NGC2024sky 30 10 0 17 4 2001 01 04 00 41 49 0413 NGC2024D 30 3 9 14 6 2001 01 04 01 26 59 3 2 0381 NGC2024sky 30 5 2 19 4 2001 01 04 00 42 46 0 0414 NGC2024D 30 13 1 7 5 2001 01 04 01 27 55 2 2 0382 NGC2024sky 30 17 4 10 0 2001 01 04 00 43 42 0415 NGC2024D 30 14 6 3 9 2001 01 04 01 28 51 7 2 0383 NGC2024B 30 0 0 0 0 2001 01 04 00 49 31 6 200 0416 NGC2024D 30 7 5 13 1 2001 01 04 01 29 48 0 0384 NGC2024B 30 14 6 3 9 2001 01 04 00 50 27 8 20 0417 NGC2024D 30 3 9 14 6 2001 01 04 01 30 45 1 2 0385 NGC2024B 30 7 5 13 1 2001 01 04 00 51 24 3 20 0418 NGC2024D 30 13 1 7 5 2001 01 04 01 31 41 6 2 0386 NGC2024B 30 3 9 14 6 2001 01 04 00 52 20 6 2 an error message and you can t proceed further 4 Execute sirius py para 5 Execute sirius py set 6 Execute sirius py run 7 View the results The working directory will be like below O10103 ffiles jmflat fits log o NGCZO024B hmnflat fitse kmflat fits of NGC2O44 o4 NGCZO244C o integer target name directory will be created for each target in which resultant files are o4 NGC2024D obslog recom param S1rlus param stored o integer is an index to dinstinguish the target sets The index is used so that one can register and combine frames from different sets of the same target na
30. 4 s e 0246 Mi_isky 20 29 1 7 8 2005 12 28 21 541 oe Edy es ete ee ee ee 0247 M1_1sky 20 29 1 7 8 2005 12 28 21 51 ee core Ue cde B G 12 3 PUOL 2S e3 0248 M1_1sky 20 29 1 7 8 2005 12 28 21 52 e e EA T ee 0249 M1_1sky 20 17 1 24 6 2005 12 28 21 51 a eee Sete ee eee ee 0250 M1_1sky 20 17 1 24 6 2005 12 28 21 5 0135 30Dor_ni 20 0 1 14 8 2005 12 28 20 J Oie or nl 20 0 4 14 8 2008 Ar 2an 0251 M1_1sky 20 17 4 24 6 2005 12 28 21 5 0252 M1_isky 20 17 1 24 6 2005 12 28 21 5 0137 30Dor_ni 20 10 7 10 7 2005 12 28 Z 0253 M1_1sky 20 0 3 29 7 2005 12 28 21 54 0138 30Dor_n1 20 10 7 10 7 2005 12 28 Z 0254 M1_1sky 20 0 3 29 7 2005 12 28 21 54 0139 30Dor_ni 20 10 7 10 7 2005 12 28 Z 0255 M1_1sky 20 0 3 29 7 2005 12 28 21 5 0140 30Dor_n4 20 10 7 10 7 2005 12 28 2 0256 M1_1sky 20 0 3 29 7 2005 12 28 21 5 0141 30Dor_ni 20 14 8 0 14 2005 12 28 20 0257F M1_1sky 20 54 3 21 3 2005 17 28 1 0142 30Dor_ni 20 14 8 0 14 2005 12 28 20 0258 M1_1sky 20 71 3 2141 3 2005 17 28 1 0143 30Dor_n1 20 14 8 0 1 2005 12 28 20 0259 M1_1sky 20 21 3 21 3 2005 12 28 21 0144 S0Dor_ni 20 14 8 0 14 2005 12 28 20 0760 M1_4sky 50 71 3 21 3 2005 12 28 51 0145 50Dor_n1 20 12 53 8 6 2005 12 28 4 0261 M1_1sky 20 29 7 0 3 2005 12 28 21 5 0146 50Dor_n1 20 12 5 8 6 2005 12 28 4 0262 M1_1sky 20 29 7 0 3 2005 12 28 21 5 0147 30Dor_ni 20 12 53 8 6 2005 12 28 2 0263 M1_1sky 20 29 7 0 3 2005 12 28 21 5 0148 30Dor_ni 20 12 3 8 6 2005 12 28 2 0264 M
31. 42 ni fits huM4z_n1 fits jo42_n1 fits kabYM42_ nil fits hadoM4e nl fits jaQOM42 ni fits jquality txt kiM4e ni fits hab M42 ni fits ja z M4e_n1i fits juM44_n1 fits kqM4 ni fits hilid4e nil fits jasdoh4e ni fits kaQOM44_ ni fits kquality txt hoM4 ni fits jab M47_ ni fits ka2eM4e_ni fits kumM42_n1i fits They are averagedly combined images of frames after dark subtraction flat correction sky bias subtraction and image registration for jlhlkji object fits Stokes parameter jInlk q object fits Stokes parameter Q jIhlk u object fits Stokes parameter U jIhlk a0O object fits wave plate angle of O degree jlhlk a22 object fits wave plate angle of 22 5 degree jIhlk a45 object fits wave plate angle of 45 degree jIhIk a67 object fits wave plate angle of 67 5 degree The combined I Q U images are not made from the combined 0 22 5 45 67 5 degree images Differential images of i i 0 1 45 i 22 5 i 67 5 2 q i 0 45 and u i 22 5 i 67 5 are made for each cycle of wave plate rotation The i q and u images are averagedly combined to make the final Q and U images Subtraction within each cycle mitigates the affects of atmospheric variation on photometry and yields a better subtraction of sky bias Let s take a look at one of the combined frames with ds9 ds9 j3iM42 nl fits Select File gt Display Headers to see the FITS header NAXIS1 and NAXIS2 are larger than 1024 because of dit
32. 5 14 9495 0 108 INDEF INDEF 513 5 75 6 12 869 0 006 3 554 0 06 461 3 90 2 14 034 0 037 INDEF INDEF 562 5 96 4 14 194 0 049 INDEF INDEF This does not process the three band s images at once You need to repeat this for each band Options ifwhm float This is the initial guess of stellar fwhm used in daofind The default value is 3 pixels When the size of fwhm is larger than 6 you may want to specify a rough value here thresh float This value is used for iraf daofind datapars threshold The default value is 10 aprad float An aperture radius in pixels put into iraf apphot photpars apertures The default values is the resultant fwhm obtained with iraf osfmeasure INDEF is found for fwhm and ellipticity column 5 and 6 for some lines This happens when the central coordinates obtained with iraf psfmeasure is shifted from that obtained with iraf apphot by more than the fwhm value of the field which implies the fwhm was not measured correctly for the star and possibly it is not a star 7 2 sirwcs2 py The former version sirwcs py used the OPM program for catalog matching But this version uses iraf ccxymatch Also some algorithms have been improved This program carries out aperture photometry by using sirphot py and compares the results with the 2MASS catalog to transform the x y coordinates to RA Dec coordinates and to calibrate the J H Ks magnitudes roughly and to put the wcs information into th
33. FITSIO library in directories other than usr local lip and usr local include edit the lines for LDFLAG and CFLAG in the Makefile 4 If you use Ubuntu modify the Makefile as following before COPTS 02 after COPTS O2 WI no as needed 5 Add the pyIRSF XXX directory to your PATH in the bashrc or something 1 3 The rawdata files the SIRIUS standard directory structure The name of SIRIUS raw data file is labeled Jyymmdd_nnnn fits hyymmdd_nnnn fits and kyymmdd_nnnn fits for the j h and k band respectively describe them as jlhlk yymmdd_nnnn fits all at once in this document Obviously yymmdd is the date and nnnn is the file number of the day Each of the raw data file is usually compressed with the fpack program of CFITSIO and has an extension of fz or ic The raw data files observed on yymmdd are contained in a directory yymmdd rawdata e g 140306 rawdata call this as the SIRIUS standard directory structure The pylIRSF pipeline softwares assume this standard structure Besides that the pyIRSF pipeline softwares assumes the followings 1 There are not the other files than the SIRIUS rawdata files in the rawdata directory 2 The extension is unified to one of fits or fits fz or fits ic in a rawdata directory However a contamination of less than 10 of the other extensions will be just ignored 2 Contents of pyIRSF sirius py the pipeline software for SIRIUS sirpol py the pipeline software for
34. SF makes a pair of a target set and a sky bias set based on the obslog file The median sky from the sky bias set is subtracted from each frame in the target set explain the rules of the pairing a set of dithering observation A set of dithering observation is defined as a set of sequentially observed frames 1 with the same field having the same dithering center within 10 arcsec with the same exposure time with the same object name in the FITS header among which the starting times of exposure are within 10 minutes for any seqential two frames such that a frame with RA_OFF DEC_OFF 0 0 is always at the first frame of a set in which no frame has the same RA_OFF DEC_OFF as the others If a frame having the O o A W N same RA_OFF DEC_OFF as one of the previous frames appears in a set that satisfies the above criteria then the frame is the first frame of another new set The criterion 1 and 4 are changeable in recom param The criterion 4 is adopted in order not to use sky bias frames of which sky condition can be different from that for the target frames The criterion 5 is adopted because sets of observation can be repeated with an identical object name The criterion 6 is adopted so that the end of a set can be detected when the next set does not start with RA_OFF DEC_OFF 0 0 A set of frames does not start with RA_OFF DEC_ OFF 0 0 when the first frame with RA_OFF DEC_OFF 0 0 fail
35. SIRPOL mklog py to create an obslog file from a set of raw data of a day mktwflatlist py to select pairs of rawdata frames with adequate background levels and to create a list of files from which flatfield images are created twflatcom py to create flatfield images from the list created with mktwflatlist py corrflat py to correct the non uniform component of twilight illumination to the flat fieldimages created with twflatcom py imgrecom py to register and combine frames which are already corrected for dark and sky biases and flatfield with sirius py to combine frames that sirius py failed combining or frames from different nights polrecom py sirpol version of imgrecom py sirphot py to carry out rough aperture photometry sirwcs2 py to carry out rough aperture photometry and rough photometric calibration by comparing the 2MASS catalog and to transform x y coordinate to RA DEC coordinates for each star WCS is also embedded to the FITS files 3 flatfield images Flatfield images multiplicative gain corrections are derived from the measurements of the rapidly dimming or brightening twilight sky by charting the relative change in intensity seen in every pixel in response to the changing illumination level The resulting pixel by pixel responsivity images are normalized to have a median of unity Finally a flatfield image is created by taking a median of a number of the normalized images in order to achieve a higher S N and to remov
36. al flatfield from which the master flatfield was generated and the master flatfield respectively It is not confirmed yet if the correction process is legitimate for SIRPOL and observations with the narrow band filters Use it with a caution If there is not warning during the process mktwflist py doe not create mktwfwarning txt Optional processes a warning message and the other outputs 1 optional argumemts for mktwilist py noexgap not to exclude pairs of which differential image has the central gap more than 1 See the details in 3 3 skydiff float example mktwilist py dlist skydiff 1000 A pair of brighter and fainter twilight sky frames is selected so that the difference of the background level is more than 2000 ADUs by default You can change the threshold ADU with this argument maxgood float example mktwflist py dlist maxgood 6500 Frames with the median of the pixel values less than 6000 ADUs are adopted to make flatfield images by default You can change the threshold with this argument keyword string example mktwilist py dlist keyword NB 14twflat Frames with FITS keyword of twflat are selected to make flatfield images by default you can change the keyword here band string example mktwilist py dlist band j mktwflist py dlist band h k Text files necessary for the following processes are created for all the JHK bands by default You can specify an band or two bands here
37. at frames for the flat correction in the reduction Is hmflat fits jmflat fits kmflat fits obslog obslog recom param sirius param jIhlk mflat fits are symbolic links to the master flat frames in the pyIRSF package recom param and sirius param are files to adjust parameters for the pipeline No need to edit them this time 5 Execute sirius py set in the working directory sirius py set This will create necessary files for the following process 6 Execute sirius py run in the working directory sirius py run This will start the pipeline process Messages will appear on the terminal average dark frames have been created dark subtraction and flat division done Making sky bias frames and bad pixel masks done Masking done sky subtraction done HEE E HE OE GE EOE E E E E E E E E E ol omegaCen ATE aE E E E ETE CE CE E CE OE GE E CE GE G j band yymmdd Ffoum Ffwhm ellip snum median stddev O10102 0450 4 6 0 39 144 82 1 al a 01010 0451 3 5 0 28 106 80 9 30 7 O10102 0452 3 6 0 23 i71 pea 30 5 O10102 0453 Sum 0 28 117 73 8 Alls 010102 0454 3 9 O 24 150 81 0 31 6 O10102 0455 43 4 0 24 119 83 5 zl z O10102 0456 S20 0 23 150 84 3 31 9 010102 O457 3 6 0 28 156 84 9 51 5 O10102 04538 S09 0 25 148 B22 51 1 daofind detection threshold 1471 4 sigma snum is the number of stars detected max 171 min 106 median 148 0 registrat
38. between 2000 April 25 and 2004 April 22 were dark subtracted flatfield corrected with the canonical flatfield images and sky bias subtracted Magnitudes of the point sources are measured with the aperture photometry in each frame The magnitude zero point was obtained by a regression of comparison with the 2MASS point sources in the same field for each frame Magnitude differences between the SIRIUS and 2MASS measurements were obtained for all the point sources The left of the following figure denotes the map of the Left Each dot denotes a magnitude difference Am between the SIRIUS and 2MASS measurements at the array position Red orange yellow green blue purple grey and black are assigned for Am gt 0 06 0 06 gt Am gt 0 04 0 04 gt Am gt 0 02 0 02 gt Am gt 0 00 0 00 gt Am gt 0 02 0 02 gt Am gt 0 04 0 04 gt Am gt 0 06 0 06 gt Am respectively right A median smoothed map of the left one The interval of contours is 0 01 mag 200 400 600 300 1000 200 400 600 800 1000 magnitude difference for the H band Each dot represents the magnitude difference for a star found at the array position This indicates a clear pattern of the magnitude difference and the array position Similar results are obtained for the J and K band as well Presumably the arrays are not illuminated uniformly but there is a contamination probably due to scattered light within the camera consider that this pattern represents the deviation from th
39. bine the N 0 1 4 4 1 2 0 0 J Oi G E E LA frames And that for the sixth line CenA3 was changed to 2 in order to combine the frames separately from those for CenA1 and CenA2 After editing the dithsetlist file execute sirius py comset Then text files related to registration and recombination are updated Then execute sirius py run The working directory will be like the following after the process O10L02 ffiles kmflat fits oZ omegalen obslog Sirius param hmflat fitse logs o4 CenAL obslog Jmflat fitse o1 omegalensky o4 CenAa recom param If you want to combine each of CenA1 CenA2 and CenA3 separately change the first column to 2 for their lines By modifying sirius param You can change the default rules by modifying the sirius param file before executing sirius py set Frames for the sky bias sets will be sky bias subtracted registered and combine by changing from O to 1 in comsky 0 combine sky frames O no l yes Target sets with the same exposure time and field are not combined into one image per band if you change from 1 to 0 in allcom 1 combine all the sets with the same field and itime O no l yes The other parameters in sirius param will be explained later If you change an object name in the dithsetlist file the corresponding name for the resultant directory and FITS files will be changed accordingly For example if you change from CenA1 to CenA in th
40. calculated to calibrate the magnitude of all the stars listed Also the FITS file will have wcs information in the header Options fwhm float thresh float and aprad float are the same for sirphot py jhk to process all the three bands at once For example sirwcs2 py jM42_n1 fits jhk noget2mass If you have already downloaded the 2MASS catalog for the field 2mass out you may want to use this option not to download it again This is helpful when you redo the matching with changing parameters like fwhm or thresh
41. ciu 010L0Z 0450 3 8 0 39 141 OfeL 31 3 1 0 0 00 0 00 0 00 0 00 0 0 0 0 010102 045141 3 5 eee 106 280 9 30 7 1 104 0 03 0 14 0 47 0 00 0 5 0 8 010102 0452 3 6 U S 171 faa 30 5 1 130 0 01 0 18 0 20 0 00 1 0 1 0 010102 0453 3 53 0 28 117 78 8 30 8 1 107 0 02 0 15 0 148 0 00 1 6 0 2 010102 0454 4 9 0 24 150 81 0 51 6 1 125 0 01 0 14 0 19 0 00 0 5 hee 010102 0455 3 4 0 24 119 283 5 peed 1 107 0 02 0 13 0 47 0 0L Wel 1 3 010102 0456 3 9 0 Z3 150 84 3 531 9 1 128 0 00 0 15 0 19 0 00 i 4 0 5 010102 0457 3 6 0 28 156 24 9 31 5 1 le 0 01 Deze 0 18 0 014 1 0 0 8 010102 0458 3 9 0 25 148 o2 2 51 1 1 13i 0 01 0 14 0 18 0 00 0 2 L F fwhm ellip the average of fwhm and ellipticity of the detected stars on the frame fwhm and ellipticity are measured with the psfmeasure program of IRAF snum the number of stars detected The detection threshold of the daofind program of IRAF is fixed through a set which is determined so that the number of stars does not exceed 150 on the first frame median stddev the median and standard deviation of the background good If all the conditions specified in recom param e g the number of matched stars and the fwhm value are satisfied it is set to be 1 If it is 1 the frame is included in the final combined image If it is O the frame is rejected matched The number of stars matched between each frame and the first frame dmag the difference of magnitude zero point between each frame an
42. d the first frame This is estimated by calculating the median of the magnitude difference of matched stars magnitude the first frame magnitude each frame xrms yrms the residuals of the coordinate transformation fit between each frame and the first frame by the geomap program of IRAF these are measured in pixels rot the rotation degree relative to the first frame dx dy deviation of the actual relative shift to the first frame from the dithering offset values These are measured in pixels yymmdd ffiles 010102 ffiles in this example directory will be created in the working directory after the pipeline process There are dark subtracted flat corrected and sky bias subtracted frames in the directory They are named as jlhlk fnnnn fits here nnnn is a 4 digit number They are ready for image registration and combination These frames are stored so that you are able to check the quality of each frames or to redo the image registration and combination with different parameters or to carry out image registration and combination of frames from different nights log directory will be found in the working directory too There are jlhIk skybg list in the directory The medain of the background is recorded for each sky bias frame in these files 5 2 To process multiple targets Let s see an example of processing data of four different fields NGC2024 NGC2024B NGC2024C and NGC2024D on 2001 01 03 The flow is the same as the
43. denotes the level smoothed by 16x16 pixel median The thick contour denotes the level of 1 00 while thin contours denote the other levels with the step of 0 01 1 Normally you will see only the thick contour as in the above example The following figure show clear deviated patterns with levels 2 or more If you wish to remove such pairs from flat frame combination delete or comment out the corresponding lines in jlhlk flatlist then run twflatcom py again 4 Making an obslog file with mklog py The mklog py program reads the keywords in the header of FITS files in the rawdata directory and creates an obslog file which is a table of frame number object name exposure time dithering offset in RA and Dec directions date time RA Dec and airmass mklog py is executed in a working directory created at the same level as the rawdata directory of a date and creates an obslog file in the same directory See section 5 and 6 for actual usages of mklog py There are some options for mklog py mklog py twflat object string itime float help twflat to make an obslog file without lines with object names starting with twflat object string to make an obslog file with lines with object names starting with the string case insensitive and lines for dark frames with the same exposure time as the specified object frames itime float to make an obslog file with lines with an exposure time equals to the value
44. e bad signals accidentaly caputured in some frames 3 1 Master flatfield images There are built in flatfield images in the pyIRSF package refere them as the master flatfield images These are used for the flatfield correction in the pipeline process when a user has not prepared their flatfield images for the date The master flatfield images were made from twilight sky frames from 53 nights between 2000 April 25 and 2004 April 22 and a correction using a comparison of the SIRIUS point source photometry with the 2MASS catalog When flatfield images are created it is assumed that a distribution of pixel intensity difference between a brighter and a fainter twilight sky is equivalent with a pixel intensity distribution yielded by an observation of an uniform illumination However it is not the case for SIRIUS probably due to stray light inside the camera The amplitude of the non uniformity can reach 5 percent or more near the edge of the arrays When a demanded photometric accuracy is about 0 05 mag it is enough uniform though This has been estimated by comparing the dependency on the array position of magnitude difference of several hundreds of thousand point sources between the SIRIUS and 2MASS measurements It is necessary to correct this component from flatfield frames to attain a better photometric precision A canonical flatfield image for each band was made from twilight sky frames from the 53 nights Then frames from 79 nights
45. e combined image FITS files This is also a quick look analisys Be careful when you use this result for your paper usage sirwcs2 py filename fits jhk fwhm float thresh float aprad float noget2mass To use this the computer needs to be connected to the internet sirwcs2 py jM42 nl fits This will yeild jlhlk sirohotwcs txt in the same directory Opto 5 19 09 5 12 588 0 006 757 9 10 6 5 35 11 38 35 19 12 2 12 6954 0 006 S271 24 5 5 45 11 61 5 19 12 3 145 297 0 012 528 8 25 4 5 35 08 35 5 19 14 4 15 517 0 064 20 8 29 5 5 45 05 56 5 19 21 3 15 159 0 037 129 8 46 4 5 35 42 08 35 19 74 8 12 168 0 004 244 8 50 8 5 45 13 o 5 19 25 5 15 656 0 021 401 1 51 5 5 535 11 88 35 19 26 2 11 523 0 002 558 5 54 0 toot 74 5 19 27 7 15 965 0 108 366 6 56 9 5 35 47 535 5 19 29 0 14 148 0 024 524 5 57 3 5 45 41 20 5 19 32 0 14 680 0 023 974 6 56 8 5 35 50 46 5 19 54 1 13 982 0 012 950 4 61 8 5 45 10 146 5 19 31 8 15 540 0 060 261 7 67 3 5 35 08 91 5 19 34 2 14 697 0 054 240 6 71 0 5 45 09 85 5 19 34 0 12 561 0 004 271 7 725 5 35 16 614 5 19 35 7 13 151 0 007 494 5 72 6 The columns denote RA Dec magnitude and its error and x y coordinates A part of the 2MASS catalog corresponding to the field will be downloaded and be compared to the photometry result by sirphot py Then RA and DEC will be calculated for each point sources and the median of the magnitude diffrence of matched stars will be
46. e dithsetlist and proceed the processes you will obtain 02 CenA directory and jlhlk CenA fits in the directory 5 6 Some important remarks on obslog One of the most important points described so far is that how you edit object names and how you combine sets of observations determine the pipeline process It can be modified later by editing objectskylist and dithsetlist though Followings are some important remarks on how to describe the obslog file These include some repetition of what described before 1 The lines are in the ascending order of the frame number 2 No duplicated lines in the obslog file 3 An on target set must have at least one neighboring sky set If you have observed a sequence of sets like target1 target2 target3 sky please execute the pipeline separately for target1 target2 and target3 while making separate obslog files like target1 sky target2 sky target3 sky You may need to set dtime with a larger value in sirius param for target and target2 because they were observed much earlier than the sky set was observed If you receive an error message like No sky for target1 please set dtime so that it includes the starting time of the first frame of target1 set and that of the sky set See 5 8 more for dtime and sirius param 4 The object name for the neighboring sky set does not need to include the name of the on target set The object name can even be just sky for sky set
47. e true flatfield correction that would be obtained from the uniform illumination and this pattern can be used to correct the canonical flatfield images A correction image is made by taking a median in an apeture with a radius of 40 pixels for each pixel for each band which is shown in the right The canonical flatfield images are multiplied by the correction images to produce the master flatfield images The accuracy of the master flatfield images is estimated to be less than 2 3 percent See xxxx for the details 3 2 To create your flatfield images If you think the master flatfield images are not appropriate to your data reduction you can make your own flatfield images with mktwflist py twfcom py and corrflat py in pyIRSF recommend you to use as many data as possible like 10 nights It yields a higher S N for the flatfield images and bad frames suffering from cloud on the sky or condensation on the window of SIRIUS can be removed statistically The flatfield characteristic for SIRIUS is confirmed not to change more than 1 at least in several months How to put file and directories Make a working directory at the same level as the date directories mkdir wrk S ls 030211 030214 030219 wrk Each of the date directores has a directory rawdata in accordance with the SIRIUS standard directory structure The rawdata directories have FITS files icluding rawdata The FITS files may be uncompressed ones or cfitsio
48. e used for the SIRPOL data reductions because the polarizer and the wave plates also affect the multiplicative gain correction However the SIRPOL pipeline does not prevent the master flatfield images and using the master flatfield images are an easy choice for quick look reductions Here is an example to reduce a linear polarimetry observation of M42 on 051226 S pwd data 051226 S ls rawdata There is rawdata directory in 051226 directory in accordance with the SIRIUS standard directory structure The first thing to do is 1 to make a working directory at the same level as the rawdata directory The name of the working directory can be anything wrk in this example All commands are carried out at shell command lines IRAF is used just as a library PyRAF is an interface to connect IRAF and python mklog py object M42_n1 does this automatically See the detailes in section 4 2 to make an obslog file by executing mklog py in the working directory This is carrried out at a shell command line instead of IRAF nor PyRAF S ls rawdata wrk cd wrk mklog py ls obslog obslog is a text file which contains frame number object name exposure time dithering offset values and etc for each frame mklog py reads the header of rawdata FITS files to make this At this moment we want to reduce only M42 therefore we need 3 to modify the obslog file with a text editor to remove
49. ecognised to be a set of a sky bias for the adjacent target set s SIRPOL See the details for section 5 4 The same rule as SIRIUS is adopted for 4 Prepare flatfield images and put them in the working directory Flatfield images for SIRPOL are available for some periods at the SIRPOL team web page http esppro mtk nao ac jp SIRPOL calibration html In this example download jlhlk twfJanO6 fits from the link and put them in the working directory Alternatively you can make your own flatfield images from twilight sky data observed with SIRPOL using mktwflist py and twfcom py See the details for section 3 2 5 Execute sirpol py para in the working directory ls htwfJan06 fits jtwfJan06 fits ktwfJan06 fits obslog sirpol py para yymmdd is 051226 user parepared flat frames have been detected twfname is twfJan06 Sls htwfJan06 fits ktwfJan06 fits recom param jtwfJan06 fits obslog Sirpol param FITS frames in the working directory were recognised as flatfield images If there are FITS files in the working directory and their names starts with j h and k and they have a common part in the file names other than the first letter and the extension sirpol para recognises them as flatfield images The common part is displayed as twiname is recom param and sirius param are files to adjust parameters for the pipeline No need to edit them this time 6 Execute sirpol py set in the working director
50. ed types of sets of observation A set has a special meaning when its target name ends with one of the followings sky self map std cset sset call them as a sky set a self set a map set A sky set is a set of sky bias observation and will explain the others below A set other than that is a set for pure target observation which call an on target set The pairing rule depends on the type of sets on target set If a neighboring set is a sky set the medain image of frames of the sky set is used for the sky bias subtraction for the on target set If the both neighbors are sky sets the medain image of frames from the both sets will be the sky bias image The name of object for the neighboring sky set does not need to include the name of the on target set If there is no sky set neighboring to an on target set no sky bias frame can be created for the on taget set Hence the pipeline process cannot be carried out for the set If there is no sky set for any of on target sets in the obslog file sirius py set yields an error message of No sky for xxx Sirius py run cannot be executed while you recieve this error message You need to modify the obslog file to add map or self after the object name so that the target set is adequately paired with a sky bias set or to delete the lines of the on taget set if there is no adequate sky set to be paired self set The sky bias image is made from the set of itself I
51. ed PI image O for No 1 for Yes f00im Creating the combined O degree image O for No 1 for Yes f22im Creating the combined 22 5 degree image O for No 1 for Yes f45im Creating the combined 45 degree image O for No 1 for Yes f67im Creating the combined 67 5 degree image O for No 1 for Yes f90im Creating the combined 90 degree image O for No 1 for Yes f135im Creating the combined 135 degree image O for No 1 for Yes If your polarimetry mode is not relevant to the specified images it will be just ignored For example if you set fvim 1 or f90im 1 or f135im 1 when your polarimetry mode is the linear polarimetry they are just ignored keepd Average combined dark images for dark subtraction are removed after the pipeline process by default If you set this to be 1 they will remain keeps Sky bias images for sky bias subtraction are removed after the pipeline process by default If you set this to be 1 they will remain keepm Bad pixel mask images are removed after the pipeline process by default If you set this to be 1 they will remain 6 7 Tuning the pipeline process 2 by editting recom param The recom param file created by sirpol py para contains parameters for image registration and recombination You need to finish editting it before sirpol py run Please refer the section 5 8 about how to set the parameters 6 8 Tuning the pipeline process 3 sirpol py tune Y
52. eep sky fits files O no 1L yes keepm O keep mask fits files O no 1 yes band The pipeline processes all the JHK bands by default You can specify one or two bands to be processed in the lower cases e g j hk stop The pipeline completes the whole process when this value is 0 When this is 1 the pipeline quits just after the dark subtraction and flat correction processes When this is 2 the pipeline quits just after the sky bias subtration process crremove No cosmic ray removal is done by default When this value is 1 the min max rejection is applied for the imcombine of IRAF when combining the final images linear No linearity correction is done by default When this value is 1 the linearity correction is applied to the raw data darkopt When necessary sets of dark frames were not observed for a night you need to prepare averagedly combined FITS files for dark subtraction e g jlhlk dark30 fits made from dark frames of another night Copy the FITS files to the working directory after sirpol py para Then change the value for darkopt to 1 fix Change this value to 1 when you reduce data observed without dithering e g transits of exo planet comsky By default this value is set to be O and sky bias subtraction and registration and recombination are not carried out for frames of sky bias sets Change this to 1 when you want to reduce the sky bias sets as well The self sky is applied to
53. es try the minmax algorithm by setting this value to be 1 ifwhm an initial guess of fwhm for the daofind program in IRAF The default value is 3 5 pixels When the seeing size is larger than 6 pixels set an appropriate value here Istarnum Frames with the number of matched stars less than this value will be not be combined ufwhm Frames with the average FWHM of the stars larger then this value will not be combined uellip Frames with the average ellipticity of the stars larger then this value will not be combined urms If either of xrms or yrms is larger than this value the frame will not be combined mlim Stars with magnitude errors larger than this value will not be used for the frame registration theta If the Y direction of the image does not match to the north the image regisirtion fails Give a degree measured counter clockwise from the north count If you set this value to 0 an extended image will not be included in which the pixel value denotes the number of frames with which the average was calculated after rejection of bad pixels norot The default value is 0 Rotation is taken into account when image registration registration If you set this value to 1 rotation is not taken into account and only shift transformation in the x and y directions is calculated commethod The defalt value is O and dithered images are combined with the average method of iraf imcombine 1 for the median meth
54. es for 30 dor with 5 second exposure time execute imgrecom py run 1 When there is only one number in the field index column you can omit the option for the field index in the command other options imgrecom py set object string itime float object string This option selects frames whose object name starting with the string to make imgrecom list This is case insensitive example imgrecom py set object M42 itime float This option selects frames whose exposure time equals to the value to make imgrecom list example imgrecom py set itime 5 imgrecom py para band jlhlk You can specify a band to process Alternatively you can edit the first line in sirius param after executing imgrecom py para without the option 6 SIRPOL data reduction 6 1 The simplest case Many parts in this section are common with the section 5 for SIRIUS This redundancy is not eliminated so that SIRPOL users don t have to read the section 5 However repeating the sections 5 4 5 5 5 6 and 5 8 is too redundant Read these sections when necessary The flow of data reduction is like the following in the simplest case Master flatfield images for SIRPOL are not built in in the pyIRSF package If you execute sirpol py para without any flatfield FITS files in the working directory the master flatfield images for SIRIUS will be linked to the working directory These are not supposed to b
55. help to display the usages and examples 5 SIRIUS data reduction 5 1 The simplest case mklog py object omegaCen is much easier here actually The detail is found in section 4 All commands are carried out at shell command lines IRAF is used just as a library PyRAF is an interface to connect IRAF and python The flow of data reduction is like the following in the simplest case When you reduce only omegaCen in the data of 2001 1 2 S pwd data 010102 S ls Here is an example rawdata There is rawdata directory in 010102 directory in accordance with the SIRIUS standard directory structure The first thing to do is 1 to make a working directory at the same level as the rawdata directory The name of the working directory can be anything wrk in this example 2 to make an obslog file by executing mklog py in the working directory This is carrried out at a shell command line instead of IRAF nor PyRAF S ls rawdata wrk cd wrk mklog py ls obslog Do the master flat frames work properly They work at least for data of this period will discuss it later If you want use your own flatfield images put them in the working directory before executing sirius py para obslog is a text file which contains frame number object name exposure time dithering offset values and etc for each frame mklog py reads the header of rawdata FITS files to ma
56. hering Lines for OBJECT to HUMIDITY including UT LT and airmass are for the first frame of the set The last 4 lines include the output from the pipeline NCOMBINE the number of frames combined COMMETHO the combine method used for iraf imcombine although this is fixed to average COMAREA A square area all the frames would have been combined if all 1024 x 1024 pixels were alive REJECT the reject method used for iraf imcombine Another image is included in this FITS file ds9 jiM42 nl1 fits 1 The pixel value denotes the number of frames with which the average was calculated after rejection of bad pixels Notice that the magnitude zero point is different among the areas with different number of this value when it is not a photometric night Besides the FITS files text files are also stored in this resultant directory jlhik quality txt record the average of fwhm ellipticity of stars and the median and standard deviation of background level and etc for each individual frames before combination which were displayed on the terminal during the pipeline process fwhm ellip the average of fwhm and ellipticity of the detected stars on the frame fwhm and ellipticity are measured with the psfmeasure program of IRAF snum the number of stars detected The detection threshold of the daofind program of IRAF is fixed through a set which is determined so that the number of stars does not exceed 150 on the fir
57. ion yymmdd Ffoum good matched dmag xrms yrms rot Cle dy O10102 0450 1 g 0 00 0 00 0 00 0 00 0 0 0 0 010102 0451 1 101 0 03 0 i4 0 17 0 00 0 5 0 8 0410102 O452 1 130 0 01 0 18 0 20 0 00 1 0 1 0 010102 0455 1 Lo 0 02 0 15 0 18 0 00 1 6 SO O10102 0454 1 125 0 01 0 44 0 19 0 00 0 5 ge 010102 0455 1 Log 0 02 0 13 0 17 0 01 g i 1 3 010102 0456 1 128 0 00 0 145 0 149 0 00 i 4 0 5 O10102 0457 1 126 0 01 0 22 0 18 0 04 1 0 0 8 010102 0458 1 31 0 01 0 i4 0 18 0 00 0 2 Lat kook Ok OK ok ok Ok k 400 done combining done Skip gioiloz 0453 1 LE 0 02 0 15 0 17 0 01 1 5 0 3 gioloz 0454 1 110 0 04 0 14 0 14 0 00 0 7 1 i O1010 0455 1 iia 0 01 0 15 0 05 OG O z 1 0 giol z a456 1 116 0 03 0 21 0 144 0 00 0 9 0 3 O10102 O45 1 i a De 0 0 0 17 0 15 0 00 0 5 0 9 010102 0458 1 24 0 02 0 09 0 18 0 00 0 1 es ok OR ok k ok ok Ok 400 done combining done done Cleaning the working directory done 7 View the results After the pipeline process the working directory is like the following O1L010 ffiles jmflat fits log obslog recom param hmftflat fitse kmflat fits otl omegalen obslos sirius param The combined images are in 01 0omegaCen directory homegalen fits jomegalen fits komegalen fits hquality txt jquality txt kquality txt jIhnIk jomegaCen fits are averagedly combined images of frames after dark subtraction flat correction sky bias subtraction and i
58. ion is done by default When this value is 1 the linearity correction is applied to the raw data darkopt When necessary sets of dark frames were not observed for a night you need to prepare averagedly combined FITS files for dark subtraction e g jlhlk dark30 fits made from dark frames of another night Copy the FITS files to the working directory after sirius py para Then change the value for darkopt to 1 fix Change this value to 1 when you reduce data observed without dithering e g transits of exo planet comsky By default this value is set to be O and sky bias subtraction and registration and recombination are not carried out for frames of sky bias sets Change this to 1 when you want to reduce the sky bias sets as well The self sky is applied to the sky subtration allcom By default target sets with the same exposure time and field are combined into one image per band If you change this to O frames for each set are combined separately dtime This valus is set to be 10 minutes by default If the interval of the start of exposure between a pair of segentially obtained frames is longer than this they will be separated to different sets Besides if the interval between the start of exposure of the last frame of a target set and that of the first frame of a sky bias set is longer than this value they will not be paired for the sky bias subtraction fldrad The pipeline recognises that the same field
59. ish editting it before sirius py set The following is the sirius param file with the default value for each parameter Keyword and value for each parameter are in the first and second columns followed by comments band jhk Cjlhlkl jhe stop a to stop pipeline after i darktflat sky subtraction crremove 0 cosmic ray removal O no L min max method linear O linearity correction O rno 1 yes darkopt use prepared dark frames O no Liyes fix 0 target frames fixed while observation O no L yes comsky O combine sky frames O no L yes allcom 1 combine all the sets with the same object name O rno 1 yes dtime 10 in minutes fldrad 10 in arcsec erfitsio 1 use cfitsio library O rno Liyes keepd O keep dark fits files O no 1 yes keeps a keep sky fits files Oino 1 yes keepm 0 keep mask fits files O no L yes band The pipeline processes all the JHK bands by default You can specify one or two bands to be processed in the lower cases e g j hk stop The pipeline completes the whole process when this value is 0 When this is 1 the pipeline quits just after the dark subtraction and flat correction processes When this is 2 the pipeline quits just after the sky bias subtration process crremove No cosmic ray removal is done by default When this value is 1 the min max rejection is applied for the imcombine of IRAF when combining the final images linear No linearity correct
60. ke this At this moment we want to reduce only omegaCen therefore we need 3 to modify the obslog file with a text editor to remove unnecessary lines This night omegaCen and omegaCensky a sky bias field for onegaCen were observed with an exposure time of 5 seconds for frames 0450 0458 and 0459 0467 respectively A set of 5 second dark frames were obtained for frames 0057 0067 which are necessary to process the above set of omegaCen The obslog file will be like the below FRAME OBJECT ITIME RA _OFF DEC_OFF DATE_UTC TIME_UTC DATE_LT TIME_LT JD EPOCH RA DEC AIRM 5 0 0 0058 DARK 5 0 0 0059 DARK 5 0 0 O060 DARK 5 0 0 0061 DARE 5 0 0 O062 DARK 5 0 0 0064 DARE 5 0 0 O064 DARK 5 0 0 0065 DARE 5 0 0 5 00 0450 omecale 0451 omegaCen 045 omecalen 0453 omecalen 0454 omecalen 0455 omegalen 0456 omecalen 0457 omegcalen 0458 omecalen 0459 omegalensky 0460 omecalensky O46 omegalensky 0462 omegalensky 4645 omegalensky 0464 omegalensky 0465 omegalensky 0466 omegalensky 0467 omegaCensky 0 0 0 0 2001 00 05 01 46 04 5 2001 01 05 03 46 04 3 519124 0 2000 15 26 14 6 4 9 2001 01 04 01 46 40 4 2001 01 05 04 46 40 4 519124 0 2000 14 26 7 5 15 1 z001ir01 05 01 47 15 1 200 Oly Os 05 47 15 1 Sls 20 2000 14726 45 9 14 6 2001 01 03 01 47 51 8 2001 01 0 03 47 51 8 514912 0 2000 1372 143 1 7 5 2001 01 03 01 48 26 5 zZ00 ir01 05 03 48 26 5 519124 0 Z000 Lar i4 6 3 9 2001 01 03 01 49 02 8 2001 01 03 03 49 02 8 51491
61. ll be created 2 Execute twflatcom py twflatcom py flat0302 You name the resultant flatfield frame by giving a part of it at the first argument In the above example jlhlk flatO302 fits will be created The differential image created from a pair listed in each line of jflatlist hflatlist and kflatlist will be normalized by the median of the pixel values and all the normalized images are median combined into a flatfield frame Keyword NCOMBIME in the header of the flatfield frames denotes the number of differential images used for combination 3 Run corrflat py corrflat py flat0302 nflat0302 Give the common part excluding the extension of the file names which are made by twflatcom py as the first argument and the name of the final corrected flatfield frames as the second argument In this example jlhlk nflatO302 fits will be created from jlhlk flatO302 fits This program corrects the flatfield images obtained with twflatcom py by removing the contaminating component due to the non uniform illumination It is assumed that the non uniform component has not changed since the master flatfied frames were constructed The following calculation is carried out in corrflat py nflat x y iflat x y cflat x y mflat x y Here nflat x y iflat x y cflat x y and mflat x y are the pixel value distribution of the resultant corrected flatfield the flatfield obtained by twfcom py the canonic
62. mage registration Let s take a look at one of the combined frames with ds9 ds9 jomegaCen fits Select File gt Display Headers to see the FITS header NAXIS1 and NAXIS2 are larger than 1024 because of dithering Lines for OBJECT to HUMIDITY including UT LT and airmass are for the first frame of the set The last 4 lines include the output from the pipeline NCOMBINE the number of frames combined COMMETHO the combine method used for iraf imcombine although this is fixed to average COMAREA A square area all the frames would have been combined if all 1024 x 1024 pixels were alive REJECT the reject method used for iraf imcombine Another image is included in this FITS file ds9 jomegaCen fits 1 The pixel value denotes the number of frames with which the average was calculated after rejection of bad pixels Notice that the magnitude zero point is different among the areas with different number of this value when it is not a photometric night Besides the FITS files text files are also stored in this resultant directory jlhIk quality txt record the average of fwhm ellipticity of stars and the median and standard deviation of background level and etc for each individual frames before combination which were displayed on the terminal during the pipeline process jquality txt obtained for this example is shown below yymmdd foum fwhm e llip snum median stddevy good matched dmac xrms yrms rot g
63. me separately 5 3 To process a target observed with multiple sets You can change this default value 10 arcsec in recom param You can also combine each set separately by changing a parameter in recom param even if they have the same field and exposure time One often observes a target with many sets to increase a total integration time These frames are need to be registered and combined into one frame per band A field of CenA was observed with four sets on 2001 01 02 1 Make a working directory at the same level as the rawdata directory 2 Make an obslog file by executing mklog py in the working directory 3 Modify the obslog file 0067 DARK 30 0 0 0490 CenA2 30 13 1 7 5 2001 01 03 HERE 0068 DARK 30 0 0 0491 CenA2 30 14 6 3 9 2001 01 03 02 26 06 0069 DARK 20 00 0492 CenAZ 30 7 5 13 1 2001 01 03 02 27 06 0070 DARK 30 0 0 0493 CenA2 30 3 9 14 6 2001 01 03 02 28 06 4 0071 DARK 30 0 0 0494 CenA2 30 13 1 7 5 2001 01 03 02 29 07 0072 DARK 30 00 0495 CenAZsky 30 0 0 0 0 2001 01 03 02 31 42 0073 DARK 30 00 0496 CenAZsky 30 19 4 5 2 2001 01 03 02 32 4 0074 DARK 30 00 0497 CenAZsky 30 10 0 17 4 2001 01 03 02 33 4 0075 DARK 30 0 0 0498 CenAZsky 30 5 2 19 4 2001 01 03 02 34 4 0076 DARK 30 0 0 0499 CenAZsky 30 17 4 10 0 2001 01 03 02 353 0468 Cen 1 30 0 0 0 0 2001 01 03 02 01 21 0 2001 0500 CenAzsky 30 19 4 5 2 2001 01 03 02 36 4 0469 CenA1 30 14 6 3 9 2001 01 03 02 02 22 6 200
64. n CenA1 A3 and theoir sky bias fields The same field was observed for CenA1 A2 and A3 sirius py set yields a dithsetlist file as below p9109std 20 0382 0386 omegalen 5 0450 0458 omegalensky 5 0459 0467 Ceni 40 Cen 30 Cena 40 LCenAlsky CenAZsky CenAssky 0468 0476 0486 0494 0504 0512 50 0477 0455 50 0495 0303 50 abia 0521 oa S a A an A a a a E A a E J 0 O amp E E iW mM e The first column denotes if the set is combined 1 or not O As described above frames with object name ending with sky or std are not combined by default The second column denotes an ID such that target sets with the same exposure time and field are given the same ID Because CenA1 CenA2 and CenA3 have the same exposure time and field ID of 4 is given to them Object name exposure time and starting and ending frame numbers are given in the column 3 4 5 6 respectively If you execute sirius py run with this dithsetlist file o1 omegaCen and 02 CenA1 directories will be created in which combine FITS images of jlhlk jomegaCen fits and jlhlk CenA1 fits are created respectively ow let s modify the dithsetlist like following noio9std 20 0382 03586 omegalen 5 0450 0458 omegaCensky 5 0459 046 Ceni 30 0468 0476 Cens 30 0486 0494 Cena 30 0504 0512 CenAilsky 30 O47 0485 CenAgZsky 30 0495 0503 E CenAasky 30 0514 0521 The first column for the third line omegaCensky was changed to 1 in order to com
65. od 5 10 Tuning the pipeline process 3 sirius py tune You can adjust the parameters in sirius param and recom param from the comand line After sirius py para execute Sirius py tune parameter xxx e g sirius py tune allcom 0 You can adjust any parameters in sirius param and recom param while you can adjust only the parameter band with sirius py para e g sirius py para band j 5 11 Summary of the flow create a working directory make an obslog file modify the obslog file flat correction FITS files other than the master ones necessary yes create flat correction FITS files put them at the working directory execute sirius py para uning the parameters modify sirius param recom param execute sirius py set changing how to make sky bias images and to combine with targets modify the objectskylist file execute sirius py skyset yes changing how to combine frames modify the dithsetlist file execute sirius py comset execute sirius py run 5 12 to execute only registration and recombination imgrecom py You can redo the image registration and recombination processes by using imgrecom py and frames stored in yymmdd ffiles directories when you retry them with different parameters after failure or you register and recombine frames of a feild observed in different nights Case 1 to process frames from a night
66. ou can adjust the parameters in sirpol param and recom param from the comand line After sirpol py para execute Sirpol py tune parameter xxx e g sirpol py tune allcom 0 You can adjust any parameters in sirpol param and recom param while you can adjust only the parameter band with sirpol py para e g sirpol py para band j 6 9 to execute only registration and recombination polrecom py You can redo the image registration and recombination processes by using polrecom py and frames stored in yymmdd ffiles directories when you retry them with different parameters after failure or you register and recombine frames of a feild observed in different nights How to use polrecom py is the same as imgrecom py except that you need to replace imgrecom py with polrecom py imgrecom list with polrecom list and sirius py with sirpol py in section 5 10 6 9 Summary of the flow create a working directory make an obslog file modify the obslog file flat correction FITS files other than the master ones necessary yes create flat correction FITS files put them at the working directory execute sirpol py para uning the parameters no execute sirpol py set changing how to make sky bias images and to combine with targets modify the objectskylist file execute sirpol py skyset changing how to combine frames na modify the dithsetlist file execute sirpol py comset execute si
67. position angle in degrees measured unti clockwise from the north count 4 pixel count image O noli yes norot oO prohibit rotation while matching O nol1 yes commethod 0 imcombine method O average 1 median search The pipeline uses the xyxymatch program of IRAF to match stars among two frames The pipeline tries first the tolarance algorithm in xyxymatch and sets the tolarance parameter to be 5 pixels The initial guess of shift values in the x and y directions are estimated from RA_ OFF and DEC_OFF values This works in most cases especially when processing a single set However when you observe multiple sets of a field for a target telescope pointing gradually deviates from the initial one and RA_OFF and DEC_OFF become unreliable Consequetly the macthing can fail with that algorithm and the parameter in such cases The value set here is applied to the tolarance value when the matching failed However the tolarance value can be adjusted to a smaller value than the search value when the average stellar number density is high because a large tolarance value can lead to a faulse matching When the tolerance algorithm failed in the matching the triangle algorithm will be applied The algorithm of tuning the tolerance parameter will be described somewhere else minsep The separation parameter in the xyxymatch program of IRAF reject The reject parameter in the imcombine program of IRAF When cosmic rays affect your combined imag
68. pyIRSF user s manual the English version Yasushi Nakajima Edition History 2015 07 30 updated for pyIRSF 2 0 The cover and the edition history were added The description of recom param was updated New parameters norot and commethod were added sirius py tune and sirpol py tune were added 5 6 Some important remarks on obslog and 6 6 were added 2015 06 05 The first edition for pyIRSF 2 0b 1 Introduction The pyIRSF package is constructed for the data redcution of the rawdata obtained with IRSF SIRIUS SIRPOL dark subtraction flat field correction sky bias subtraction image registration and recombination There are also some scripts for rough photometry and photomretric and astrometric WCS calibrations based on the 2MASS catalog 1 1 requirments OS Linux UNIX including MacOSX IRAF and PyRAF The latest version of IRAF and PyRAF are recommended Python 2 7 C compiler CFITSIO The rawdata of SIRIUS SIRPOL are compressed with the fpack program of CFITSIO The CFITSIO library is necessary to read the compressed data No need to uncompress the compressed rawdata before you run the pipeline matplotlib optional 1 2 How to install 1 Download the latest version of pyIRSF XXX tar gz from http sourceforge net projects irsfsoftware where XXX is a version e g pyIRSF 2 0 2 Unpack pyIRSF XXX tar gz and you will find a directory pyIRSF XXX 3 Execute make in the directory If you installed the C
69. rpol py run modify sirpol param recom param yes 7 Quick look photometry and wcs 7 1 sirphot py This carries out apeture photometry for combined FITS images created with pyIRSF programs This is a combination of daofind apphot and psfmeasure programs of IRAF This is just a rough photometry Careful inspection of point source selection or technics like aperture correction are not applied Magnitude is not calibrated Just a fixed typical zero magnitude value is applied for each band s magnitude caliculation usage sirphot py filename fwhm float thresh float aprad float sirphot py jM42 nl fits This yields a text file jsirphot txt containing x y coordinates magnitude and its error from iraf apphot fwhm and ellipcitiy from iraf psfmeasure for each point sources 757 9 10 6 12 222 0 006 4 120 ee zi 4 45 4 12 288 0 006 3 698 0 44 528 8 23 4 12 931 0 012 INDEF IHDEF 220 8 29 5 15 151 0 064 3 518 0 32 129 8 46 4 14 793 0 037 3 6052 0 22 344 8 50 8 11 802 0 004 INDEF INDEF 401 14 51 5 135 270 0 021 3 592 0 532 558 5 54 0 11 157 0 002 3 512 0 3538 566 6 56 9 15 599 0 108 3 108 0 30 oz24 5 57 5 13 784 0 024 3 396 0 52 974 6 56 8 14 314 0 023 3 744 0 14 950 4 61 8 13 615 0 012 3 800 0 13 281 7 67 3 15 174 0 060 INDEF INDEF 40 6 71 0 14 450 0 044 3 558 0 18 eri 7 72 5 12 19535 0 004 3 452 0 13 494 5 72 6 12 785 0 007 3 484 0 02 5635 5 73 9 13 341 0 016 3 572 O22 416 9 74
70. s The object name does not matter If as long as a sky Set is the neighbor of an on tagret set and the exposure time per frame is the same and the starting time of the first frame for both the sky and the on target sets are within an interval of dtime they are considered as a pair of target and sky 5 By default all frames from the sets with the same dithering center and exposure time are combined to one image for each band It does not matter if the object names are not the same with the same dithering center technically means if the dithering centers are within fldrad arcsec The value of fldrad is defined in sirius param If you want to combine frames separately for each set please set allcom in sirius param to O 5 7 Preparation of flat correction images The master flat images are used in the examples so far The master flat images are at least vaild for data from 2000 till 2004 and likely safe within 1 for dat till 2008 You can also make your flat correction images with mktwflist py twfcom py and corrflat py programs in pyIRSF See the details for the section 5 Put your flat correction images at the working directory before sirius py para sirius py para recognises FITS files in the working directory as the flat correction files 5 8 Tuning the pipeline process 1 by editting sirius param You can tune the pipeline process by editting sirius param file created by sirius py para You need to fin
71. s 0025 and 0036 on 030129 of which medians of pixel values are 3310 0 and 1254 0 respectively were selected as a pair to make a differential image jlhlk flatlist 0 are similar but they also include pairs of which differential image has the central gap more than 1 jlhlk flatlist are made by excluding such pairs from jlhlk flatlist 0 When you add noexgap as an option mktwflist py does not carry out the exclusion process and does not create jlhik flatlist O mktwflist param Parameters used in mktwilist py are recorded in it jlhik background txt The median of pixel values are recorded for all the frames 4 options for twfcom py band string example twfcom py flatO302 band j twfcom py flatO302 band h k Flatfield images are created for all the JHK bands by default You can specify an band or two bands here If you want to remove some pairs of frames edit jlhIk flatlist before executing twfcom py Delete the lines or add at the beginning of the line 3 3 Excluding differential images with a central vertical gap The HAWAII array has a characteristc of reset anomally which results in a central gap of pixel values between the 511st and 512nd columns in rawdata frames When this pattern is stable there is no gap found in a dufferential image However it becomes unstable sometimes and yields a differential image with the central vertical gap The algorithm to find the gap is the followings 1 For a normali
72. sirpol param Many parameters are common with sirius param polmode and fiim f135im are uniue in sirpol param You can tune the pipeline process by editting sirius param file created by sirpol py para You need to finish editting it before sirpol py set The following is the sirpol param file with the default value for each parameter Keyword and value for each parameter are in the first and second columns followed by comments band jhk jlhlklall stop 0 to stop pipeline after i darkt flat 2 sky subtraction crremove 0 cosmic ray removal O no 1 min max linear 0 linearity correction O no 1 yes darkopt 0 use prepared dark frames O no T iyes fix 0 target frames fixed while observation O no 1 yes comsky O combine sky frames O rno L yes allcom 1 combine all the sets with the same field and itime O rno Liyes polmode 1 1T LP 2 CP2 4 CP4 dtime 10 in minutes fldrad 10 in arcsec cfitsio 1 use cfitsio library O rno L iyes fiim 1 make I image O no 1 yes fgim 1 make Q image O no 1 yes Fuim 1 make U image O rno 1 yes fim 1 make Y image O no L yes FOOim 1 make Odeo image O rno Liyes f271m 1 make 22 5de image O no L yes F45im 1 make 45dee image O rno Liyes fofim 1 make 6 7 5deo image O no L yes F90im 1 make YOdeo image O rno L iyes fis5im 1 make 145deo image O rno 1L yes keepd a keep dark fits files O no L iyes keeps 0 k
73. st frame median stddev the median and standard deviation of the background good If all the conditions specified in recom param e g the number of matched stars and the fwhm value are satisfied it is set to be 1 If it is 1 the frame is included in the final combined image If it is O the frame is rejected matched The number of stars matched between each frame and the first frame dmag the difference of magnitude zero point between each frame and the first frame This is estimated by calculating the median of the magnitude difference of matched stars magnitude the first frame magnitude each frame xrms yrms the residuals of the coordinate transformation fit between each frame and the first frame by the geomap program of IRAF these are measured in pixels rot the rotation degree relative to the first frame dx dy deviation of the actual relative shift to the first frame from the dithering offset values These are measured in pixels yymmdd ffiles 051226 ffiles in this example directory will be created in the working directory after the pipeline process There are dark subtracted flat corrected and sky bias subtracted frames in the directory They are named as jlhlk fnnnn fits here nnnn is a 4 digit number They are ready for image registration and combination These frames are stored so that you are able to check the quality of each frames or to redo the image registration and combination with different parame
74. t is so called self sky map set The sky bias image is made from the neighboring sets and the set of itself std set This object name was used for standard stars The sky bias image is made from the set of itself as well as the self set cset sset These are used for the magellanic cloud survey observations No explanation at the moment objectskylist sirius py set yields a text file objectskylist in which results of the pairing of target and sky bias sets are written An example of the objectskylist for CenA in 3 3 is shown below 0463 0476 CenAl 0477 0485 sky 0486 0494 Cen 0477 0485 0495 0503 skyz 0504 0512 CenAs 0495 0504 0514 0521 skys The first line denotes that a sky bias image for frames 0468 0476 in a set CenA1 is made from frames 0477 0485 The second line denotes that a sky bias image for frames 0486 0494 is made from frames 0477 485 and 0495 0503 objectskylist is read in sirius py run process to make sky bias images and sky bias subtraction to change the pairing of target and sky bias You can change the pairing of target and sky bias by modifying the objectskylist file It is denoted that a sky bias image for a set CenA3 is made from frames 0495 0503 and 0513 0521 in the objectskylist above If you want to use only a set of frames 0495 0503 to make the sky bias image modify the objectskylist file as following 0513 0521 was removed from the third line Then execute 0463
75. ters or to carry out image registration and combination of frames from different nights log directory will be found in the working directory too There are jlhlk skybg list in the directory The medain of the background is recorded for each sky bias frame in these files 6 2 To process multiple targets Let s see an example of processing data of two targets 30Dor_n1 and M1_1 on 2005 12 28 The flow is the same as the previous example 1 Make a working directory at the same level as the rawdata directory 2 Make an obslog file by executing mklog py in the working directory 3 Modify the obslog file Delete lines other than those for 0121 0200 30Dor_n1 and its sky bias field 0201 0280 M1 and its sky bias field and 0983 0992 20 second dark frames FRAME OBJECT ITIME RA_OFF DEC_OFF DATE_UT Skipping here 0121 30Dor_ni 20 0 0 0 0 2005 12 28 20 3 Z ar Ay 0122 30Dor_ni 20 0 0 0 0 2005 12 28 20 3 es er a E See EF ar 0123 30Dor_n4 20 0 0 0 0 2005 12 28 20 3 0239 M44 20 13 7 6 3 2005 12 28 21 47 50 0124 30Dor_n1 20 0 0 0 0 2005 12 28 20 3 0240 M1 1 20 13 7 6 3 2005 12 28 71 48 21 0125 30Dor_n1 20 14 6 3 9 2005 12 28 20 0241 M1_1sky 20 0 0 0 0 2005 12 28 21 49 0126 30Dor_ni 20 14 6 3 9 2005 12 28 20 0242 M1_1sky 20 0 0 0 0 2005 12 28 21 49 0127 30Dor_ni 20 14 6 3 9 2005 12 28 20 0243 M1_1sky 20 0 0 0 0 2005 12 28 21 49 a ee E of ee ee 0245 M1_1sky 20 29 1 7 8 2005 12 28 21 50 0134 sODor
76. the sky subtration allcom By default target sets with the same exposure time and field are combined into one image per band If you change this to O frames for each set are combined separately polmode Select 1 for the linear polarimetry 2 for the two points circulatr polarimetry 3 for the four points polarimetry dtime This valus is set to be 10 minutes by default If the interval of the start of exposure between a pair of segentially obtained frames is longer than this they will be separated to different sets Besides if the interval between the start of exposure of the last frame of a target set and that of the first frame of a sky bias set is longer than this value they will not be paired for the sky bias subtraction fldrad The pipeline recognises that the same field is observed for two sets when the dithering center coordinates are within this limit This valus is set to be 10 arcseconds by default cfitsio Set this value to 0 when you don t have the cfitsio library installed in your computer and have uncompressed FITS files in the rawdata directory You don t need to uncompress FITS files in the rawdata directory if you have cfitsio installed fiim Creating the combined image 0 for No 1 for Yes fqim Creating the combined Q image O for No 1 for Yes fuim Creating the combined U image 0 for No 1 for Yes fvim Creating the combined V image 0 for No 1 for Yes fpim Creating the combin
77. y sirpol py set This will create necessary files for the following process 7 Execute sirpol py run in the working directory This will start the pipeline process Messages will appear on the terminal dark frames have been created dark subtraction and flat division done Making sky blas frames and bad pixel masks done Masking done sky subtraction done HEHE E HEHE HEC E HE E E E HE E HEE ol M44_n21 SEE EE E E E EE EE EE E ACK j band yymmdd foum fw snum median stddev Obi 24602871 5 ogiz26 0z92 a OSL 226 0293 5 E 051276 0294 Skip H a J Mu cos Wo Ll IJ oi 0714246 04275 1 94 0 02 0 153 Ol2 0 0 0 3 0 3 051226 0426 1 102 0 02 212 0 08 C200 i1 0 4 051446 04277 1 75 O02 0 17 0 144 0 00 0 5 0 4 ogiz2z26 0328 1 ie 0 02 0 146 0 146 0 00 0 3 Qed 0512726 0479 1 2q 0 04 0 14 0 45 0 00 0 4 0 3 051226 04340 1 el 0 00 0 11 Wats 0 0 0 5 0 7 10 20 430 40 50 60 70 80 90 100 done Making 1 q U images for each cycle gq u 1 done combining 1 g u a00 a2 a45 ab done done done 8 View the results After the pipeline process the working directory is like the following 051276 ffiles jtwfJanO6 fits log obs log recom param htwufJan 6 fits ktwftJandb fits of M42_ni obslog sirpol param The combined images are in 01 M42_n1 directory halOM42 ni fits hquality txt JiM4z_ni fits kad5M42 ni fits hav2h
78. zed differential image the program calculate a pixel value difference between adjacent pixels in the x direction dl i j I i 1 j I i j for j from 1 to 1024 and for i from 413 to 612 2 The median through the y direction M i is calculated for every i in the range 3 The madian and standard deviation sigma of M i are calculated The median is around 0 4 If M 511 is less than 0 01 or less than 3 sigma there is no gap recognised in this differential image The following figures are examples of M i The horizontal axis denotes i and the vertical M i The upper shows no sign of the central gap while the lower shows a clear sign of the central gap about 4 3 4 Eye inspection twflatview py An optional task twflatview py helps you to remove bad behaved pairs with eye inspection It sequentially displays differential images divided by the final median flat frame which tells you how each differential image deviates from the final one You need the matplotlib module for python to use this Input a list obtained by mktwiflist py and the flatfield image into twflatview py twflatview py hflatlist hflat0302 fits Then you see a figure of the differential image divided by the final median flat frame for the first pair An example is the below h 030102 0733 0726 0 200 400 600 800 1000 You will see the figures sequantialy by typing the return key The pair ID appears at the top The contour

Download Pdf Manuals

image

Related Search

Related Contents

TEXAS LP DAKOTA XP  Model 44 Syringe Pump Series User`s Manual  Samsung GT-S5200 Benutzerhandbuch  Mode d`emploi - Theis  Fantom Vacuum FM740 B Vacuum Cleaner User Manual  LaCie 320GB d2 NEXT Quadra USB Hard Drive    Manual - Delta Ohm S.r.l.  NEC NDA-30007-003 User's Manual  -キ リバス共和 干  

Copyright © All rights reserved.
Failed to retrieve file