ENR CTIO Blanco 4-m 2013-05-24

Major Problems:

At UT 04:22:52.497 we had an error while running the DECam Regression script for the southern half of the sky:

GPAN PANG response to stop command not done. Response: Connection Error.

There were then a whole slew of interlock errors that were not fixed by restarting the roles associated with the errors. After trying to reset, we restarted the whole instance, twice, but this did not fix the problem either. Alberto, Maurcio and I have tried everything we thought was safe to try to bring DECam back to it's normal state, and hope that the experts can troubleshoot the problem as soon as possible today.  Vsub is currently in an unknown state (yellow indicator light), but the block filter is in.  We have left signs all over the 4-m warning people not to enter the dome or turn any lights on until this is fixed.

Minor Problems:

At the beginning of the night, there were two problems: one with the telemetry viewer not showing any plots, and one with the Moon Avoidance Alarm being triggered for targets that were further than 10 degrees from the moon.  Ann was able to quickly fix the telemetry viewer problem (I beleive she said it was something with the URL).  Klaus found an error in the Moon Avoidance Angle code that was causing the 10 degree limit to be read in as a string, and resloved the problem in no time.