Photometric keyword issues - 20130819
EFOSC2 imaging
Bugs for Dave/Cosimo to check/correct in purple / Bugs for Stefano to correct in next version of pipeline in red
ESO request that the EFOSC2 acquisition images are submitted as science files. Hence we need to make sure the photometric keywords are set correctly, there are a few bugs in these and in the photometric science files.
There are 1152 acquisition images in /data/psdb2data1/pessto_eso_phaseIII/validated_pessto_files/efsoc/spectra
There are also 1309 photometric science images.
Problem 1
99 files have ABMAGLIM = INF.0 or 9999.0 set
Cause : the median background (MBKG) is a negative number, hence Eqn A.7 takes sqrt of -ve number
But 80 are through slit images. Easy purge of files - if "HIERARCH ESO INS SLIT1 NAME" does not equal "Free" then a slit is used and it is a through-slit acquisition image. We don't submit these. (Dave to always do this in the future before SSDR is sent to ESO. But data reducers to check and purge during reduction process).
143 files do not have PHOTZP set, have ABMAGLIM=9999.0 and a nonsense value for ABMAGSAT
These are all unfiltered images, so we should not submit those as science files, as they are uncalibrated.
Easy purge of files :
if FILTER = Free
or
HIERARCH ESO INS FILT1 NAME = Free
than do not submit these as science files. (Dave to always do this in the future before SSDR is sent to ESO - but data reducers to check these and purge during the reduction proces ).
Problem 2
19 files have no FWHM set, and hence 9999 set for ABMAGSAT. In all of these cases the photometry failed. Hence they are not submitted as as science files, as they cannot be calibrated. (Dave to purge these, get list from Cosimo)
Problem 3
In equation A.7 (in PESSTO paper), AGMAGLIM is defined. However if the meadian background is negative, then this will be sqrt(-ve number). This equation assumes images are background limited. For short exposures the MBKG can be negative, due to bias drifts and being read noise dominated.
Solution is to replace the old equation A.7 with the general form which accounts for frames which are read noise dominated. The new version of the paper (v13 and above) has the new equation.
Dave to correct the ABMAGLIM for all the files for SSDR1
Stefano - to correct this calculation in the next version of the pipeline
SOFI imaging
213 SOFI science images.
Problem 4
There are only 191 weight images, and I would have expected the same number of weight images as science images. Where are the missing ones ? Or is there a reason why they don't exist ?
Problem 5
52 of them do not have PHOTZP set, or PSF_FWHM set. Hence ABMAGSAT and ABMAGLIM canot be calculated either.
Major problem - it looks like the astrometry fails, hence no 2MASS match, no zero point and not FWHM. But it doesn't seem to be a problem with the data. For example look at these three files :
SN2013K_20130417_H_merge_56475_1.fits
SN2013K_20130417_J_merge_56475_1.fits
SN2013K_20130417_Ks_merge_56475_1.fits
The Ks file is fine, the other two have astrometric headers but they are incorrect. Need the reductions of these checked - Cosimo
[sne@psweb imaging]$ dfits * | fitsort TEXPTIME FILTER PHOTZP | grep 9999.0
2013am_20130403_H_merge_56475_1.fits 120.0 H 9999.0
2013am_20130411_H_merge_56475_1.fits 120.0 H 9999.0
2013am_20130411_J_merge_56475_1.fits 48.0 J 9999.0
2013am_20130411_Ks_merge_56475_1.fits 128.0 Ks 9999.0
2013am_20130417_J_merge_56475_1.fits 48.0 J 9999.0
2013am_20130417_Ks_merge_56475_1.fits 128.0 Ks 9999.0
BD174708003_20120915_J_merge_56474_1.fits 24.0 J 9999.0
CSS130118105323+1646_20130103_H_merge_56475_1.fits 32.0 H 9999.0
CSS130118105323+1646_20130113_J_merge_56475_1.fits 64.0 J 9999.0
LSQ12dwl_20120908_Ks_merge_56474_1.fits 160.0 Ks 9999.0
LSQ12dwl_20120915_H_merge_56474_1.fits 144.0 H 9999.0
LSQ13fn_20130113_Ks_merge_56475_1.fits 1440.0 Ks 9999.0
LSQ13sj_20130403_H_merge_56475_1.fits 576.0 H 9999.0
LSQ13sj_20130403_Ks_merge_56475_1.fits 768.0 Ks 9999.0
SN2009ip_20121204_Ks_merge_56475_1.fits 160.0 Ks 9999.0
SN2012dy_20120916_H_merge_56474_1.fits 144.0 H 9999.0
SN2012dy_20121121_H_merge_56475_1.fits 1920.0 H 9999.0
SN2012ec_20120825_H_merge_56474_1.fits 160.0 H 9999.0
SN2012ec_20120825_J_merge_56474_1.fits 160.0 J 9999.0
SN2012ec_20120825_Ks_merge_56474_1.fits 200.0 Ks 9999.0
SN2012ec_20120924_H_merge_56474_1.fits 144.0 H 9999.0
SN2012ec_20121015_H_merge_56474_1.fits 144.0 H 9999.0
SN2012ec_20121015_J_merge_56474_1.fits 60.0 J 9999.0
SN2012ec_20121015_Ks_merge_56474_1.fits 160.0 Ks 9999.0
SN2012ec_20121204_H_merge_56475_1.fits 360.0 H 9999.0
SN2012ec_20121204_J_merge_56475_1.fits 320.0 J 9999.0
SN2012ec_20121221_Ks_merge_56475_1.fits 360.0 Ks 9999.0
SN2012ec_20130103_J_merge_56475_1.fits 400.0 J 9999.0
SN2012ec_20130103_Ks_merge_56475_1.fits 360.0 Ks 9999.0
SN2012ec_20130113_H_merge_56475_1.fits 360.0 H 9999.0
SN2012ec_20130113_Ks_merge_56475_1.fits 720.0 Ks 9999.0
SN2012ec_20130128_H_merge_56475_1.fits 360.0 H 9999.0
SN2012ec_20130128_Ks_merge_56475_1.fits 360.0 Ks 9999.0
SN2012ec_20130221_J_merge_56475_1.fits 400.0 J 9999.0
SN2012ec_20130221_Ks_merge_56475_1.fits 720.0 Ks 9999.0
SN2012fr_20121113_H_merge_56475_1.fits 32.0 H 9999.0
SN2012fr_20121113_J_merge_56475_1.fits 32.0 J 9999.0
SN2012fr_20121113_Ks_merge_56475_1.fits 60.0 Ks 9999.0
SN2012fr_20121121_Ks_merge_56475_1.fits 60.0 Ks 9999.0
SN2012fr_20121204_H_merge_56475_1.fits 32.0 H 9999.0
SN2013F_20130113_H_merge_56475_1.fits 144.0 H 9999.0
SN2013F_20130113_Ks_merge_56475_1.fits 160.0 Ks 9999.0
SN2013F_20130128_J_merge_56475_1.fits 160.0 J 9999.0
SN2013F_20130128_Ks_merge_56475_1.fits 240.0 Ks 9999.0
SN2013K_20130128_H_merge_56475_1.fits 360.0 H 9999.0
SN2013K_20130128_J_merge_56475_1.fits 400.0 J 9999.0
SN2013K_20130207_J_merge_56475_1.fits 400.0 J 9999.0
SN2013K_20130221_H_merge_56475_1.fits 360.0 H 9999.0
SN2013K_20130403_J_merge_56475_1.fits 400.0 J 9999.0
SN2013K_20130403_Ks_merge_56475_1.fits 720.0 Ks 9999.0
SN2013K_20130417_H_merge_56475_1.fits 480.0 H 9999.0
SN2013K_20130417_J_merge_56475_1.fits 360.0 J 9999.0