Status of runs which failed nfcalib:

States:

PASS -- This run has been allowed to pass by ignoring slightly out of
bounds errors, removing bad patches, etc.

WAIT -- Waiting for scheduled patches to be observed and/or processed.

FAIL -- This run has failed and may need a new patch.

******************************************************************************

Run 1336 (EDR)

Yanny produced a no-patch calibration for missing columns.

2001.03.20: all patches observed, not all verified yet.

******************************************************************************

Run 1339 (EDR)

Yanny produced a no-patch calibration for missing columns.

2001.03.20: all patches observed, not all verified yet.

******************************************************************************

Run 1359

2001.03.20: all patches observed, not all verified yet.

******************************************************************************

Run 1412/5

2110.04.23: This run also appears to be quite old, from December.  It
was run with nfcalib v1_7_2 so qc can not be used.  There is nothing
worriesome in the logs.  It was used to drill plates in December, see
the release notes:

   http://www.astro.princeton.edu:81/sdss-obs/msg.1701.html


******************************************************************************

Run 1449

2001.02.26: waiting on a patch

******************************************************************************

Run 1450/5

2001.04.23: This run is from last October and was calibrated with a
non-cut version of nfcalib (in the rush for a drilling run) and is too
old to have qc_nfcalib run on it.  There is nothing unusual in the log
files, so it's probably fine.  None of the columns have only one
patch, so the current nfcalib would not improve the solution.  There
are release notes for this run (see sdss-obs), nothing unusual was
noted.

******************************************************************************

Run 1453

2001.02.16: missing two patches, set to priority 5.
2001.03.20: all patches observed, not all verified yet.
2001.04.23: all patches verified, try rerunning nfcalib.

******************************************************************************

Run 1666/0

2001.07.19

Summary: Cols 5 (u and z) and 6 (z) fail, huge z band scatter
         APO patch database unavailable
         If more patches are scheduled we should wait.

Col 5 fails in u and z.  There's only one patch (86C3/00089994) and 17
stars in u, although it fails only marginally.  z band is much worse,
with huge scatter.

a(0) matches (unclipped/clipped): 17 / 17
aerr(0) 0.013942437889563234 should be <= maxaerr(0) 0.0135
a(4) matches (unclipped/clipped): 35 / 35
aerr(4) 0.015192106761656832 should be <= maxaerr(4) 0.0135

Col 6 fails in z only.  It has two patches (86D3, 00091730 and
00090014) and looks good in every filter except z, which again has
huge scatter in both patches.  (Neither alone will produce a solution
either.)

a(4) matches (unclipped/clipped): 107 / 104
aerr(4) 0.014261264693019205 should be <= maxaerr(4) 0.0135

The apo patch database is currently unavailable so I can't check on
the status of this to see if we can expect more patches soon.  The run
is long enough that we should have at least two patches.

******************************************************************************

Run 1740

2001.05.23

Steve once described this run as "carefully crafted to avoid as many
patches as possible."  Four special patches have been observed and can
be found in:
   /data/dp3.a/mt/dp/apo20/run/manual_patches/v7_2v3_2-0/TS1/86Xe,
where X=[A,B,C,D].

I got the fpObjcs out of the opdb and the special patches and ran
this.

It failed pretty badly in i2 and u5: 

----- filter 3 (i2) -----
a(3) matches (unclipped/clipped): 26 / 26
a(3) sigma clipped mean: -23.571902322022552
a(3) unclipped median: -23.588604908774371
a(3) clipped sigma: 0.087378856684047185
a(3) statistical error: 0.017136403665668615
Patch group 0 solution rejected for filter 3 because
aerr(3) 0.017136403665668615 should be <= maxaerr(3) 0.009

----- filter 0 (u5) -----
a(0) matches (unclipped/clipped): 37 / 37
a(0) sigma clipped mean: -24.446911104053612
a(0) unclipped median: -24.460339183571225
a(0) clipped sigma: 0.25199218237537346
a(0) statistical error: 0.041427259591378301
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.041427259591378301 should be <= maxaerr(0) 0.0135

Douglas, could you take a look at:

TS1:86Be patches for i band problems
TS1:86De patches for u band problems (we also get several stars from
two 86C4 patches).

******************************************************************************

Run 1749 PASS

2001.06.25:
no Exphotom file -- setQcIgnore
qc_failed for run 1749/0

******************************************************************************

Run 1891

2001.03.20

Summary: Cols 4 and 5 failed nfcalib with u band errors

db says all patches observed
calibrated with nfcalib v1_7_6 on Jan 19, consider using v1_7_8
(can't right now, no fpObjc files on disk)

col 4 -- 86C3, maybe 86C2 should overlap.
One patch found: 1891-0-kaCalObj-00089994.fit
failed because of u error:
a(0) matches (unclipped/clipped): 20 / 19
a(0) sigma clipped mean: -24.059396780101746
a(0) unclipped median: -24.072079111733004
a(0) clipped sigma: 0.06004190072471955
a(0) statistical error: 0.013774556717744949
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.013774556717744949 should be <= maxaerr(0) 0.0135

col 5 -- closest is 86D3, 86D2 also may overlap.
Patch name: 1891-0-kaCalObj-00089994.fit
Number of stars matched for this patch (szm): 16
Patch name: 1891-0-kaCalObj-00091730.fit
Number of stars matched for this patch (szm): 78
Patch name: 1891-0-kaCalObj-00090014.fit
Number of stars matched for this patch (szm): 98

----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 22 / 21
a(0) sigma clipped mean: -24.185333310792402
a(0) unclipped median: -24.225113571671322
a(0) clipped sigma: 0.0705326351048884
a(0) statistical error: 0.01539148282537384
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.01539148282537384 should be <= maxaerr(0) 0.0135

2001.05.23

Exported col 4 and 5 fpObjcs from opdb
Reran prep nfcalib -- no new patches found
Recalibrated col 4: new nfcalib did not improve the calibration
Increased default_maxaerr to 0.0140 for u to allow it to pass
Recalibrated col 5: still didn't pass
Increased default_maxaerr to 0.0160 for u to allow it to pass
We need to test these to make sure they are ok!

******************************************************************************

Run 1893

2001.03.20

Summary: col 5 failed due to u band error
 
db says all 8 patches done, verified in January
calibrated March 5 wih nfcalib v1_7_8

Patch name: 86D5     File name: 1893-0-kaCalObj-00090290.fit
Number of stars matched for this patch (szm): 106
Patch name: 86C5     File name: 1893-0-kaCalObj-00090080.fit
Number of stars matched for this patch (szm): 23
Patch name: 86D6     File name: 1893-0-kaCalObj-00090325.fit
Number of stars matched for this patch (szm): 109
Patch name: 86D6     File name: 1893-0-kaCalObj-00098334.fit
Number of stars matched for this patch (szm): 68
Patch name: 86C6     File name: 1893-0-kaCalObj-00090320.fit
Number of stars matched for this patch (szm): 30

----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 47 / 46
a(0) sigma clipped mean: -24.208663308901702
a(0) unclipped median: -24.221906194986346
a(0) clipped sigma: 0.10344953849809346
a(0) statistical error: 0.01525280231948024
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.01525280231948024 should be <= maxaerr(0) 0.0135

******************************************************************************

Run 1894 FAIL

2001.08.17

Not enough u band stars to calibrate cols 1 and 2.  SKent's sky level
balace factors say calibrations for cols 3,4,5,6 disagree by as much
as 10%.  Steve writes:

   1894: there are dark clouds to the east during the whole run.
   Nothing visible overlaps the actual area being pointed at, although
   there is one wisp that goes close.

   The patches fall at different positions in each camcol, so if there are
   clouds wandering through, it is expected that the columns would not track
   each other.

   It is my opinion that unless the QA plots look normal, we will want to
   discard these data.

2001.03.20

No fpObjc files on disk, can't run nfcalib.

Error: Error processing FITS file /data/dp3.b/data/1894/0/objcs/1/fpObjc-001894-1-0136.fit
Error opening FITS file /data/dp3.b/data/1894/0/objcs/1/fpObjc-001894-1-0136.fit

******************************************************************************

Run 1897

2001.03.20

Summary: cols 1,2,3 missing, probably because the run is short and
does not fully overlap patches in those columns.

db says all 4 patches done

----------

col 1: failed in all filters

Patch name: 11A0     File name: 1897-0-kaCalObj-00097115.fit
Number of stars matched for this patch (szm): 67

Looks like it should overlap, but it appears it doesn't overlap well.

----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 4 / 4
a(0) sigma clipped mean: -24.178786710506213
a(0) unclipped median: -24.16531929607336
a(0) clipped sigma: 2.6015339626776726
a(0) statistical error: 1.3007669813388363
Patch group 0 solution rejected for filter 0 because
ssz(0) = 4 should be >= minstars(0) 10
aerr(0) 1.3007669813388363 should be <= maxaerr(0) 0.0135
----- filter 1 (g) -----
a(1) matches (unclipped/clipped): 5 / 5
a(1) sigma clipped mean: -23.390073960563353
a(1) unclipped median: -23.559946014787176
a(1) clipped sigma: 0.4120536820740287
a(1) statistical error: 0.18427600869932292
Patch group 0 solution rejected for filter 1 because
ssz(1) = 5 should be >= minstars(1) 15
aerr(1) 0.18427600869932292 should be <= maxaerr(1) 0.009
----- filter 2 (r) -----
a(2) matches (unclipped/clipped): 20 / 20
a(2) sigma clipped mean: -24.14845774603933
a(2) unclipped median: -24.148275335091022
a(2) clipped sigma: 0.044837495464278079
a(2) statistical error: 0.010025968779896427
Patch group 0 solution rejected for filter 2 because
aerr(2) 0.010025968779896427 should be <= maxaerr(2) 0.009
----- filter 3 (i) -----
a(3) matches (unclipped/clipped): 10 / 9
a(3) sigma clipped mean: -23.707682819751749
a(3) unclipped median: -23.700262044938512
a(3) clipped sigma: 0.024334961032682356
a(3) statistical error: 0.0081116536775607852
Patch group 0 solution rejected for filter 3 because
ssz(3) = 10 should be >= minstars(3) 15
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 9 / 9
a(4) sigma clipped mean: -22.012943516114571
a(4) unclipped median: -22.012172749263314
a(4) clipped sigma: 0.07562632523689107
a(4) statistical error: 0.025208775078963689
Patch group 0 solution rejected for filter 4 because
ssz(4) = 9 should be >= minstars(4) 10
aerr(4) 0.025208775078963689 should be <= maxaerr(4) 0.0135

-----------

col 2: failed in u,g,i,z

Patch name: 11A0     File name: 1897-0-kaCalObj-00097115.fit
Number of stars matched for this patch (szm): 34
----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 5 / 5
a(0) sigma clipped mean: -23.959707609279302
a(0) unclipped median: -23.959321474126444
a(0) clipped sigma: 2.0979376995425181
a(0) statistical error: 0.93822626174731993
Patch group 0 solution rejected for filter 0 because
ssz(0) = 5 should be >= minstars(0) 10
aerr(0) 0.93822626174731993 should be <= maxaerr(0) 0.0135
----- filter 1 (g) -----
a(1) matches (unclipped/clipped): 9 / 9
a(1) sigma clipped mean: -23.332355516686341
a(1) unclipped median: -23.262198538071257
a(1) clipped sigma: 0.16325686906920561
a(1) statistical error: 0.054418956356401871
Patch group 0 solution rejected for filter 1 because
ssz(1) = 9 should be >= minstars(1) 15
aerr(1) 0.054418956356401871 should be <= maxaerr(1) 0.009
----- filter 3 (i) -----
a(3) matches (unclipped/clipped): 12 / 12
a(3) sigma clipped mean: -23.678886534774382
a(3) unclipped median: -23.678673512054225
a(3) clipped sigma: 0.041499149235248528
a(3) statistical error: 0.011979772491055595
Patch group 0 solution rejected for filter 3 because
ssz(3) = 12 should be >= minstars(3) 15
aerr(3) 0.011979772491055595 should be <= maxaerr(3) 0.009
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 10 / 10
a(4) sigma clipped mean: -21.965098972260115
a(4) unclipped median: -21.989214473029826
a(4) clipped sigma: 0.30722161035755424
a(4) statistical error: 0.09715200351546481
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.09715200351546481 should be <= maxaerr(4) 0.0135

----------

col 3:
nfcalib finds no overlaps, looked at:
Patch name: 11B0     File name: 1897-0-kaCalObj-00097131.fit
Patch name: 10D0     File name: 1897-0-kaCalObj-00096823.fit
Patch name: NULL File name: 1897-0-kaCalObj-00078606.fit

I think this run must have ended short.

******************************************************************************

Run 2078/0

2001.04.23: Logs and qc_nfcalib look fine.

******************************************************************************

Run 2127: FAIL

2001.07.03:

Stephen Kent <skent@fnal.gov> says:
Jen and I agreed that this run should be dumped.  It is completely
covered by run 2078.

2001.06.22:

Summary:
Col 3 FAIL nfcalib: no overlapping patches
Col 5 FAIL nfcalib: bad patch, ok once this patch was excluded.

Col 3: NEED A PATCH!
no overlapping patches 
(patches are off the begining of the run)
This run is only 48 fields long!
Tried:
Patch name: 36B4     File name: 2127-0-kaCalObj-00100239.fit
Patch name: 36B4     File name: 2127-0-kaCalObj-00106064.fit
Patch name: 36b3     File name: 2127-0-kaCalObj-00072104.fit

Col 5: two significanly overlapping patches, z failed:
Patch name: 36C4     File name: 2127-0-kaCalObj-00100753.fit
Patch name: 36C4     File name: 2127-0-kaCalObj-00106079.fit
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 79 / 74
a(4) sigma clipped mean: -22.342407565742633
a(4) unclipped median: -22.352746181745275
a(4) clipped sigma: 0.17722892272428492
a(4) statistical error: 0.020602443783808936
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.020602443783808936 should be <= maxaerr(4) 0.0135

Excluding patch 00100753 produces a solution, this patch may be bad.

******************************************************************************

Run 2133 PASSED

2001.06.25:
2133/0 failed qc_nfcalib
No exPhotom file -- setQcIgnore 2133 0 nfcalib

******************************************************************************

Run 2134 PASSED

2001.04.23
setQcIgnore 2134 0 nfcalib
No exPhotom -- bclee
Go ahead and stuff it.

******************************************************************************

Run 2138 FAIL

2001.03.13: Waiting for patches
database says run needs 3 patches (all at priority 4)
nfcalib says:
col 1-5 - prep says no patch
col 6 - prep ok, nfcalib ok 

******************************************************************************

Run 2140 FAIL

2001.03.13: Waiting for patches
database says run needs 4 patches (all at priority 4)
nfcalib says:
col 1-4 - prep says no patch
col 5 - prep ok, nfcalib failed (only 20 stars overlap)
col 6 - prep ok, nfcalib ok

******************************************************************************

Run 2141

2001.03.13
database says all patches (8) done
nfcalib says:
col 1-5 - prep ok, nfcalib ok
col 6 - prep ok, nfcalib failed:
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 66 / 65
a(4) sigma clipped mean: -21.934118647074985
a(4) unclipped median: -21.945486302707529
a(4) clipped sigma: 0.11559601015549761
a(4) statistical error: 0.014337920439208594
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.014337920439208594 should be <= maxaerr(4) 0.0135

******************************************************************************

Run 2298 FAIL

2001.06.25:

Summary: Col 3 z band scatter is too large for me to pass this one.
We need to reobserve the patch, get a new patch, or use an alternate
calibration.

status FAIL
Col 3: patches failed (z)
Large z-band scatter, and from the plot (q-c3-pGroup0-rejected.ps) it
does not appear that the mean of the distribution has been found.
There are enough stars in the first patch that a reobservation may be all
we need.  (Excluding the second patch makes no difference.)

Patch name: 35B3     File name: 2298-0-kaCalObj-00097910.fit (100)
stars accepted in u:23 g:64 r:78 i:51 z:44
Patch name: 35C3     File name: 2298-0-kaCalObj-00097925.fit (20)
stars accepted in u:1 g:6 r:5 i:4 z:2

----- filter 4 (z) -----
Sigma clipping converged after 3 iterations.
a(4) matches (unclipped/clipped): 46 / 44
a(4) sigma clipped mean: -21.79795774916817
a(4) unclipped median: -21.804829732363359
a(4) clipped sigma: 0.13314569732736808
a(4) statistical error: 0.020072469112959349
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.020072469112959349 should be <= maxaerr(4) 0.0135

******************************************************************************

Run 2304 PASS (CHECK QA!)

2001.06.22: 
Summary: Cols 1,2,3,5 marginally fail in u and/or z -- is there
something wrong with this run?  I raised default_maxaerr from 0.0135
to 0.0165 for u and z and allowed this to pass.  Jen can run status
and qc and stuff it and we should check sky and Zhed-point qa.

NOTE: No exPhotom file for this run!  It will fail qc, just qc ignore it.

Col 1:
Patch name: 35A4     File name: 2304-0-kaCalObj-00098908.fit (102)
Failed u and z:
----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 28 / 26
a(0) sigma clipped mean: -24.087550636103366
a(0) unclipped median: -24.093049960352367
a(0) clipped sigma: 0.082792775297319376
a(0) statistical error: 0.016236999108674391
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.016236999108674391 should be <= maxaerr(0) 0.0135
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 47 / 45
a(4) sigma clipped mean: -21.961331621912606
a(4) unclipped median: -21.951395414480476
a(4) clipped sigma: 0.096042212636451449
a(4) statistical error: 0.014317127744306315
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.014317127744306315 should be <= maxaerr(4) 0.0135

Col 2:
Patch name: 35B4     File name: 2304-0-kaCalObj-00101498.fit (100)
Failed u:
----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 19 / 19
a(0) sigma clipped mean: -23.859607212717343
a(0) unclipped median: -23.845552290772996
a(0) clipped sigma: 0.06193649181422458
a(0) statistical error: 0.014209205722928372
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.014209205722928372 should be <= maxaerr(0) 0.0135

Col 3:
Patch name: 35B4     File name: 2304-0-kaCalObj-00101498.fit (101)
Failed z:
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 36 / 36
a(4) sigma clipped mean: -21.788282336209274
a(4) unclipped median: -21.807498478702513
a(4) clipped sigma: 0.081466780177048212
a(4) statistical error: 0.013577796696174703
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.013577796696174703 should be <= maxaerr(4) 0.0135

Col 5:
Patch name: 35D4     File name: 2304-0-kaCalObj-00101503.fit (105)
Failed z:
----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 39 / 39
a(4) sigma clipped mean: -22.344640589385182
a(4) unclipped median: -22.350713390069014
a(4) clipped sigma: 0.10111039526396774
a(4) statistical error: 0.016190620924121778
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.016190620924121778 should be <= maxaerr(4) 0.0135

******************************************************************************

Run 2305 PASS (CHECK QA!)

2001.06.25:
status FAIL
Col 3: patches failed (u and z)

Note that even with three patches we only got 15 u band stars -- u
band stars are not being thrown out, they just don't appear to be
there.  I increased the allowed error to let it pass, but I suspect
the u calibration will not be great.  Another patch between these with
a lot of u band stars would help, but I'm not sure it's worth it.

NOTE: No exPhotom file.  If this one fails qc and lists only exPhotom
as the reason, please setQcIgnore.  Thanks!

Details:

Patches:
Patch name: 35C7     File name: 2305-0-kaCalObj-00107888.fit (36)
Patch name: 35B7     File name: 2305-0-kaCalObj-00091361.fit (84)
Patch name: 34D7     File name: 2305-0-kaCalObj-00089959.fit (79)

----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 15 / 14
a(0) sigma clipped mean: -23.998184058767336
a(0) unclipped median: -23.969652780305367
a(0) clipped sigma: 0.059011164993684168
a(0) statistical error: 0.015771397242911014
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.015771397242911014 should be <= maxaerr(0) 0.0135

----- filter 4 (z) -----
a(4) matches (unclipped/clipped): 40 / 40
a(4) sigma clipped mean: -21.814667550892576
a(4) unclipped median: -21.821318678506177
a(4) clipped sigma: 0.085864478885805257
a(4) statistical error: 0.013576366169129071
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.013576366169129071 should be <= maxaerr(4) 0.0135
------------------------

To pass this, I changed:
#default_maxaerr 0.0135 0.009 0.009 0.009 0.0135
default_maxaerr 0.0160 0.009 0.009 0.009 0.0140

******************************************************************************

Run 2333 FAIL

2001.07.09:

Still waiting for patch reobservation for camCol 1.

Changed max a err to allow col 2 to pass.  A quick comparison with
2327 shows that the z band zeropoint in all 5 calibrated camCols are
about 6% different (water vapor?).

2001.06.22:

Summary: 

Col 1: one patch, huge u band scatter.  (Bad patch?)  We can't
calibrate with this patch -- we need another observation, another
patch, or an alternate calibration.

Col 2: one patch, slightly out of spec z.  I could let it pass, but
I'll wait until we decide what to do with col 1.

Col 1: tried patch
Patch name: 09A5     File name: 2333-0-kaCalObj-00102041.fit
Failed in u (scatter is quite large, number count is small)
----- filter 0 (u) -----
a(0) matches (unclipped/clipped): 20 / 19
a(0) sigma clipped mean: -24.011366516046692
a(0) unclipped median: -24.007236718204197
a(0) clipped sigma: 0.10779795039616037
a(0) statistical error: 0.024730545899877544
Patch group 0 solution rejected for filter 0 because
aerr(0) 0.024730545899877544 should be <= maxaerr(0) 0.0135

Col 2: used patchs
Patch name: 09A5     File name: 2333-0-kaCalObj-00102041.fit 
(102 stars)
Patch name: 09B5     File name: 2333-0-kaCalObj-00106510.fit
(13 stars)
Failed in z:
----- filter 4 (z) -----
Sigma clipping converged after 1 iterations.
a(4) matches (unclipped/clipped): 37 / 37
a(4) sigma clipped mean: -21.957136287612357
a(4) unclipped median: -21.954159149989358
a(4) clipped sigma: 0.088629689969160361
a(4) statistical error: 0.014570631276117747
Patch group 0 solution rejected for filter 4 because
aerr(4) 0.014570631276117747 should be <= maxaerr(4) 0.0135

We could consider passing col 2 and checking later qc.

******************************************************************************

Run 2336 WAIT

2001.08.02: Patches have been processed, try again.

2001.06.22:
prep FAIL
No patches found.
Patched observed but not yet processed -- retry later.

******************************************************************************

Run 2347 WAIT

2001.06.25: Waiting for patches 
Database says the 4 patches for this run have not yet been observed.
They are already set at priority 5.

******************************************************************************

Run 2392 WAIT

2001.08.02: Waiting for patches 
Database says only 2 of 8 patches observed.  The 6 unobserved patches
have been set to priority 5.