ePESSTO Year 1+2 - Final SOFI Imaging reduction

Summary:

SOFI images reduced with PESSTO pipeline version 2.4.0.

The final SOFI reductions resulted in 600 reduced near-IR images of which 213 in J-band, 201 in H-band, and 186 in Ks-band. Notes on the reductions below.

2017-04-22:

OGLE-2012-SN-040 Ks-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2017-06-02:

AT2016iks JHKs observations results in two sets of reduced images by the PESSTO pipeline. The H-band reductions have some sky subtraction residuals in the default PESSTO pipeline reduction. Images re-reduced without the illumination correction step, which appeared to improve the image quality.

2017-06-03:

AT2017eby J-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2017-06-03:

SN2017ejb H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2017-08-22:

AT2017gah H-band reduced images have some sky subtraction residuals in the default PESSTO pipeline reductions. Images re-reduced without the illumination correction step, which appeared to improve the image quality.

2017-08-27:

PS17egl J-band observations results by default with the PESSTO pipeline in multiple reduced images of which some are of poor quality. Improved re-reduction was achieved by modifying the HIERARCH ESO OBS ID to be the same for the last 4 sequences (100404723 to 100404726) to merge 1 high quality image from a set of 48 exposures.

PS17egl_20170827_J_merge_58795_2.fits

The PESSTO pipeline also produces from 17 earlier frames an image

PS17egl_20170827_J_merge_58795_1.fits

which is very low in quality and thus not very useful. The first 2 raw frames with their own OBS ID were completely excluded. The re-reductions were carried out without the illumination correction.

2017-08-28:

PS17egl H-band reduction by the PESSTO pipeline failed to align all the individual frames correctly by default. Improved re-reduction was achieved by excluding the first 3 raw frames of a sequence of 51 exposures, and without carrying out the illumination correction.

2017-09-03:

PS17egl Ks-band reduction by the PESSTO pipeline failed to align all the individual frames correctly by default. Improved re-reduction was achieved by excluding the first 4 raw frames of a sequence of 42 exposures.

2017-09-04:

PS17egl Ks-band reduction by the PESSTO pipeline failed to align all the individual frames correctly by default. Improved re-reduction was achieved by excluding the last 7 raw frames of a sequence of 43 exposures.

2017-09-30:

SN2016iks H and Ks-band reductions by the PESSTO pipeline failed to align all the individual frames correctly. The amount of individual raw files is somewhat large (40 and 48, respectively), however, no obvious fault in the data.

2017-10-28:

AT2017gmr H-band sequence has two extra exposures not part of the ON-OFF sequence; the ON-OFF sequence has 5 and 4 exposures, respectively; and the telescope is not always dithered between the exposures. Data reduced with a subselection of raw files.

2017-11-25:

AT2016jbu H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2017-12-27:

SN2017gmr JHKs images are heavily affected by instrumental noise in one of the detector quadrants. Images reduced with a subset of raw files.

2017-12-13:

Observations were obtained in JHKs bands without the object name placed in the OB. However, based on the coordinates the object is SN2017gax. The resulting files are:

name_20171213_H_merge_58786_1.fits

name_20171213_J_merge_58786_1.fits

name_20171213_Ks_merge_58786_1.fits

2018-01-16:

Hip-58316 J-band exposures have been obtained in FastPhotJitt mode. This is not a science target. Data not reduced, attempt to process the data results in the PESSTO pipeline crashing.

2018-01-04:

AT2017ens Ks-band observations were obtained with a dither pattern that is not following default PESSTO OB templates.

2018-01-10:

AT2017ens Ks-band observations were obtained with a dither pattern that is not following default PESSTO OB templates. The PESSTO pipeline processing results in two reduced images.

2018-01-10:

AT2017jfa H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2018-01-15:

AT2017jfv Ks-band reduced image has diagonal noise pattern. Image re-reduced by excluding the middle 8 raw exposures from a sequence of 16 frames.

2018-02-04:

SN2017jfa H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality. 

2018-02-05:

Hip-28112 and Hip-58316 J-band exposures have been obtained in FastPhotJitt mode. This is not a science target. Data not reduced, attempt to process the data results in the PESSTO pipeline crashing.

2018-02-14:

SN2018ec JHKs band images are heavily affected by instrumental noise in one of the detector quadrants.

2018-02-14:

SN2018oh H and Ks-band images appear to have an issue with the telescope tracking. The H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality. 

2018-02-16:

SN2018oh J-band images appear to have an issue with telescope tracking in the first obtained sequence. Observations were repeated with improved tracking. The PESSTO pipeline produced two reduced images.

2018-02-18:

SN2017gax J and H-band images are affected by instrumental noise in one of the detector quadrants.

2018-02-18:

SN2018hi H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality. 

2018-02-18:

SN2018ub H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2018-02-20:

SN2016jbu J-band image is heavily affected by instrumental noise in one of the detector quadrants.

2018-03-08:

SN2017jei J and Ks-band reduced images have some sky subtraction residuals in the default PESSTO pipeline reduction. Images re-reduced without the illumination correction step, which appeared to improve the image quality. 

2018-03-08:

SN2018ec H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2018-03-23:

ASASSN-18fv JHKs exposures have been obtained in FastPhotJitt mode. Data not reduced, attempt to process the data results in the PESSTO pipeline crashing. 2MASS_10360106-59371056 also observed similarly in JHKs. Same sequence repeated on 2018-03-24, 2018-03-25, 2018-03-26, 2018-03-27, 2018-04-05, 2018-04-07, and 2018-04-20. Furthermore, ASASSN-18fv was observed on 2018-05-13.

2018-03-26:

SN2018ec J-band reduced image has an elongated PSF shape.

2018-03-26:

SN2018ec Ks-band reduced image is affected by instrumental noise in one of the detector quadrants.

2018-03-26:

SN2016jbu JHKs imaging obtained with a non-default PESSTO OB template position angle of HIERARCH ESO ADA POSANG = 90.0, instead of 0.0. By default the PESSTO pipeline fails to align the frames correctly. Data re-reduced after some modification of the raw files with IRAF.

2018-03-26:

SN2017jei JHKs imaging obtained with a non-default PESSTO OB template position angle of HIERARCH ESO ADA POSANG = 180.0, instead of 0.0. By default the PESSTO pipeline fails to align the frames correctly. Data re-reduced after some modification of the raw files with IRAF.

2018-03-27:

SN2017ijn JHKs imaging obtained with a non-default PESSTO OB template position angle of HIERARCH ESO ADA POSANG = -90.0, instead of 0.0. By default the PESSTO pipeline fails to align the frames correctly. Data re-reduced after some modification of the raw files with IRAF.

2018-04-07:

SN2018ec Ks-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality. 

2018-04-08:

SN2018oh Ks-band observations included 2 extra exposures not part of a PESSTO OB template standard 4 point dithern pattern. These files were not used as part of the reduction:

SOFI.2018-04-08T00:19:47.084.fits

SOFI.2018-04-08T00:20:58.135.fits

2018-04-20:

SN2018ec has 3 J-band exposures. While the PESSTO pipeline can process the data, the result is not useful.

2018-04-20:

SN2018oh H-band observations were obtained with a non-standard PESSTO OB template 5 point dither pattern.

2018-04-21:

SN2018ec J-band reduced image is affected by instrumental noise in one of the detector quadrants.

2018-05-04:

GRB180504A J-band observations were obtained with a non-standard PESSTO OB template 5 point dither pattern. 

2018-05-04:

SN2017bzc J and H-band observations obtained with an ON-OFF pattern using an OB that does not follow a PESSTO OB template. The PESSTO pipeline aligns the reduced H-band frame poorly.

2018-05-06:

SN2018ant J and H-band observations have major quality issues in the raw data. The PESSTO pipeline produces reduced images from these, however, the data is not useful.

2018-05-12:

SN2018ec J-band ON-OFF sequence does not have a matching number of ON and OFF images. The first ON-OFF set not used in the reduction. 

2018-05-12:

SN2018oh H-band and Ks-band reduced images have some sky subtraction residuals in the default PESSTO pipeline reduction. Images re-reduced without the illumination correction step, which appeared to improve the image quality. The H-band observation sequence was obtained with a non-standard PESSTO OB template 5 point dither pattern. 

2018-05-12:

SN2018agk H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality. 

2018-08-19:

SN2018cnf H-band sequence had corrupted raw file in the tarball. Re-downloaded the following file from the ESO archive for the reductions:

SOFI.2018-08-19T05:17:01.142.fits

2018-08-11:

GRB180809A H-band observations were obtained with a non-standard PESSTO OB template dither pattern. 

2018-08-16:

SN2018eov J-band reduced image is affected by instrumental noise in one of the detector quadrants.

2018-08-18:

SN2018exb H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2018-09-02:

SN2018dza J-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, however, this improves the quality only to some extent.

2018-09-08:

SN2018dza J and H-band reduced images have some major vertical noise pattern. The observations were repeated during the following night 2018-09-09.

2018-09-08:

SN2018cnf H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2018-09-16:

SN2018cnf H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2018-09-16:

SN2018exc J and Ks-band reduced images are affected by instrumental noise in one of the detector quadrants.

2018-11-05:

SN2017ijn has a J-band sequence which does not result in a useful reduction. However, another good quality set of J-band observations was obtained during the same night.

2018-11-05:

SN2017ijn has one H-band exposure; this cannot be reduced with the PESSTO pipeline.

SOFI.2018-11-06T07:41:47.728.fits

2018-12-09:

SN2018ilu J and H-band reduced images have a very low quality in the default PESSTO pipeline reduction due to the major noise pattern that appeared during the first sequence of obtained raw frames. Detector fault reported by the observers also in the night log. Observations were repeated after the fault was fixed, however, the HIERARCH ESO OBS ID remained the same. Data re-reduced excluding the first J and H-band sequences.

2018-12-30:

SN2018ibb H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-01-13:

SN2018ivc J-band image has horizontal noise pattern. This is primarily caused by the major noise pattern that appeared in the following file. Data re-reduced excluding the second ON-OFF sequence of the two sequences.

SOFI.2019-01-14T01:17:58.205.fits

2018-01-13:

SN2019cj H and Ks-band reduced images are poor in quality. The 5 last frames of a sequence of 12 exposures in H-band and the 6 first frames of a sequence of 16 exposures are affected by major noise pattern in the raw data. Data re-reduced excluding these files. 

2019-01-16:

SN2018ibb H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-01-16:

SN2018jky H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-01-25:

GRB190114C Ks-band observations were obtained with a non-standard PESSTO OB template dither pattern. 

2019-01-25:

SN2018jmt JHKs band observations carried out without setting the object name, however the object indicated in the original file name. The H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-01-25:

SN2019gf H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality. Typo in the object name: Sn2019gf instead of SN2019gf of the whole JHKs sequence.

2019-02-25:

SN2019awq H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-02-25:

SN2019rm H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-02-25:

SN2018jmt H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-03-19:

SN2018jmt H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

2019-03-19:

SN2018atq H and Ks-band reduced images have a strong horizontal noise pattern. Majority of the raw files affected. Data re-reduced with a sub-selection of data. This improves the quality of the reduced H-band image. Only very minor improvement to the bad Ks-band image.

2019-03-19:

SN2019awq JHKs imaging obtained with a non-default PESSTO OB template position angle of HIERARCH ESO ADA POSANG = 90.0, instead of 0.0. By default the PESSTO pipeline fails to align the frames correctly. Data re-reduced after some modification of the raw files with IRAF.

2019-03-19:

SN2019cj JHKs imaging obtained with a non-default PESSTO OB template position angle of HIERARCH ESO ADA POSANG = 90.0, instead of 0.0. By default the PESSTO pipeline fails to align the frames correctly. Data re-reduced after some modification of the raw files with IRAF.

2019-03-19:

AT2019azh H-band reduced image has some sky subtraction residuals in the default PESSTO pipeline reduction. Image re-reduced without the illumination correction step, which appeared to improve the image quality.

PESSTOASTRO was used to fix the astrometry and derive the zeropoint for the following 102 images for which the PESSTO pipeline did not derive the astrometry correctly resulting e.g. in a ASTROMET header value of "990 999 0 9999.0", "990 999 1 9999.0", or "990 999 2 9999.0", and not PHOTZP or PHOTZPER header entries.

ASASSN-15ga_20170428_J_merge_58785_1.fits

ASASSN-15ga_20170603_H_merge_58786_1.fits

AT2016jbu_20170603_H_merge_58786_1.fits

AT2017eby_20170603_H_merge_58786_1.fits

AT2017eby_20170603_J_merge_58793_1.fits

AT2017fzw_20170822_Ks_merge_58786_2.fits

AT2017gah_20170822_H_merge_58802_3.fits

AT2017gah_20170822_J_merge_58786_2.fits

AT2017gah_20170828_H_merge_58786_1.fits

AT2017gah_20170920_H_merge_58786_1.fits

AT2017gah_20170920_Ks_merge_58786_1.fits

AT2017gah_20170930_Ks_merge_58786_1.fits

AT2017gah_20171010_H_merge_58786_1.fits

AT2017gww_20171109_J_merge_58786_1.fits

AT2017iks_20170822_H_merge_58786_1.fits

AT2017jfa_20180110_J_merge_58787_1.fits

AT2017jfs_20180110_H_merge_58787_1.fits

AT2017jfs_20180110_Ks_merge_58787_1.fits

ATLAS17lwk_20171110_Ks_merge_58786_1.fits

OGLE-2012-SN-040_20170422_H_merge_58785_1.fits

OGLE-2012-SN-040_20170422_Ks_merge_58793_1.fits

PS17egl_20170827_J_merge_58795_2.fits

PS17egl_20170902_Ks_merge_58786_1.fits

PS17egl_20170904_Ks_merge_58795_1.fits

SN2016iks_20170930_H_merge_58786_1.fits

SN2016iks_20170930_J_merge_58786_1.fits

SN2016jbu_20170422_J_merge_58785_1.fits

SN2016jbu_20180326_H_merge_58794_1.fits

SN2016jbu_20180326_J_merge_58794_1.fits

SN2016jbu_20180326_Ks_merge_58794_1.fits

SN2017bzc_20180504_H_merge_58788_1.fits

SN2017dfb_20170428_H_merge_58785_1.fits

SN2017dfb_20170428_Ks_merge_58785_1.fits

SN2017dfb_20170602_H_merge_58786_1.fits

SN2017ejb_20170603_H_merge_58793_1.fits

SN2017ejb_20170603_J_merge_58786_1.fits

SN2017gmr_20171227_J_merge_58786_1.fits

SN2017hcc_20171213_Ks_merge_58786_1.fits

SN2017hcc_20180818_J_merge_58788_1.fits

SN2017ijn_20180327_H_merge_58794_1.fits

SN2017ijn_20180327_J_merge_58794_1.fits

SN2017ijn_20180327_Ks_merge_58794_1.fits

SN2017ilo_20180105_Ks_merge_58787_1.fits

SN2017iuk_20171213_Ks_merge_58786_1.fits

SN2017jcu_20180220_H_merge_58787_1.fits

SN2017jei_20180326_H_merge_58794_1.fits

SN2017jei_20180326_Ks_merge_58794_1.fits

SN2017jfa_20180204_H_merge_58793_1.fits

SN2017jfa_20180218_H_merge_58801_1.fits

SN2017jfa_20180218_J_merge_58787_1.fits

SN2017jfa_20180309_H_merge_58787_1.fits

SN2017jfa_20180309_J_merge_58787_1.fits

SN2017jfs_20180206_J_merge_58787_1.fits

SN2017jfs_20180206_Ks_merge_58787_1.fits

SN2017jfs_20180216_H_merge_58787_1.fits

SN2017jfs_20180308_H_merge_58787_1.fits

SN2017jfs_20180407_Ks_merge_58787_1.fits

SN2018agk_20180407_H_merge_58787_1.fits

SN2018agk_20180407_Ks_merge_58787_1.fits

SN2018agk_20180422_H_merge_58787_1.fits

SN2018agk_20180422_J_merge_58787_1.fits

SN2018agk_20180422_Ks_merge_58787_1.fits

SN2018agk_20180512_Ks_merge_58788_1.fits

SN2018cnf_20180818_J_merge_58788_1.fits

SN2018dza_20180909_H_merge_58788_1.fits

SN2018ec_20180326_J_merge_58787_1.fits

SN2018ec_20180407_H_merge_58787_1.fits

SN2018exb_20180916_H_merge_58788_1.fits

SN2018exb_20180916_Ks_merge_58788_1.fits

SN2018exc_20180908_Ks_merge_58788_1.fits

SN2018hfm_20190115_Ks_merge_58788_1.fits

SN2018hgc_20181106_Ks_merge_58788_1.fits

SN2018hle_20181209_J_merge_58788_1.fits

SN2018ivc_20181230_H_merge_58788_1.fits

SN2018ivc_20181230_J_merge_58788_1.fits

SN2018ivc_20181230_Ks_merge_58788_1.fits

SN2018ivc_20190113_H_merge_58788_1.fits

SN2018ivc_20190113_J_merge_58795_1.fits

SN2018ivc_20190113_Ks_merge_58788_1.fits

SN2018jag_20181209_H_merge_58788_1.fits

SN2018jag_20181209_Ks_merge_58788_1.fits

SN2018jmt_20181230_H_merge_58788_1.fits

SN2018jmt_20181230_J_merge_58788_1.fits

SN2018jmt_20181230_Ks_merge_58788_1.fits

SN2018kpo_20190225_J_merge_58788_1.fits

SN2018oh_20180214_H_merge_58802_1.fits

SN2018oh_20180216_J_merge_58787_2.fits

SN2018oh_20180220_H_merge_58787_1.fits

SN2018oh_20180220_J_merge_58787_1.fits

SN2018oh_20180220_Ks_merge_58787_1.fits

SN2018oh_20180308_Ks_merge_58787_1.fits

SN2018oh_20180326_H_merge_58787_1.fits

SN2018oh_20180407_Ks_merge_58787_1.fits

SN2018oh_20180420_J_merge_58787_1.fits

SN2018oh_20180420_Ks_merge_58787_1.fits

SN2018oh_20180512_J_merge_58788_1.fits

SN2018oh_20180512_Ks_merge_58802_1.fits

SN2019awq_20190319_Ks_merge_58795_1.fits

SN2019cj_20190113_Ks_merge_58795_1.fits

SN2019cj_20190319_H_merge_58795_1.fits

SN2019cj_20190319_J_merge_58795_1.fits

SN2019cj_20190319_Ks_merge_58795_1.fits

Running PESSTOASTRO for the aforementioned files required to modifying with IRAF the RA and DEC values of the file:

SN2018exc_20180908_Ks_merge_58788_1.fits

Running PESSTOASTRO for the aforementioned files required to implement 180 degree rotations with IRAF for the files:

SN2016jbu_20180326_H_merge_58794_1.fits

SN2016jbu_20180326_J_merge_58794_1.fits

SN2016jbu_20180326_Ks_merge_58794_1.fits

SN2017ijn_20180327_H_merge_58794_1.fits

SN2017ijn_20180327_J_merge_58794_1.fits

SN2017ijn_20180327_Ks_merge_58794_1.fits

SN2019awq_20190319_Ks_merge_58795_1.fits

SN2019cj_20190319_H_merge_58795_1.fits

SN2019cj_20190319_J_merge_58795_1.fits

SN2019cj_20190319_Ks_merge_58795_1.fits

These were all the files that were obtained with a non-default PESSTO OB template position angle of HIERARCH ESO ADA POSANG = 90.0 or HIERARCH ESO ADA POSANG = -90.0, instead of 0.0, with the exception of SN2019awq_20190319_H_merge_58795_1.fits and 

SN2019awq_20190319_J_merge_58795_1.fits for which the PESSTOSOFIPHOT derived the astrometry successfully.

For the following 5 files the quality of the reduced data was not good enough to derive astrometry with PESSTOASTRO:

PS17egl_20170827_J_merge_58795_1.fits

SN2017ijn_20181105_J_merge_58788_2.fits

SN2018ant_20180506_J_merge_58788_1.fits

SN2018dza_20180908_H_merge_58788_1.fits

SN2018oh_20180214_Ks_merge_58787_1.fits