Night lost to technical/mechanical failures.

As we were observing the first science target, we encountered a problem with the DHS in which an image did not write to disk.  We used the documented method of shutting down the nocs, and removing the problems files (/tmp/.smc0_*) on the cosmosdhs machine.  The same problem occured on the next science exposure.  We closed the nocs and then used the nuke option for the dhs and pan.

Upon restarting the nocs and taking a test image, we saw that the field was out of focus.  We noticed that the camera focus value was not being set to the appropriate value and we received error messages in the NICS window.  We tried power cycling the instrument electronics box, replacing the ethernet cable to the instrument electronics box, and reseating the cable used to move the camera focus stage.

It's our current conclusion that camera stage is stuck.  The best way to diagnose this would be to remove COSMOS from the Cass cage and place it on its cart in the Coude room.  Then we can open the instrument for a better look, unless somebody has a better idea.

The error messages that we received form various tests are:

observer@cosmos-4m ~]$ /home/kosmos/src/nics/testnics.sh camfocus 1500
DITSCMD_17e0:nics:nicsDramaInit: DONE: OK
[ SUCCESS ] TASK=nics ACTION=nics_init ARGS=(none)
DITSCMD_17e1:nics:nicsDramaCamFocus: ERROR: action failed in GWC
DITSCMD_17e1:exit status:%NONAME-X-NOMSG, Message Number F1BF7FBE
[ FAILURE ] TASK=nics ACTION=nics_camfocus ARGS=1500

====

kcmid_camera.log:cameraFocusCmd>> Fri May 25 02:14:53 CLT 2018 attr=focus action=MOVE type=float value=1650.000000 debug=1 sys=ctio_4m sim=0
kcmid_camera.log:cameraFocusCmd>> ACKNOWLEDGED - MOVEing camera focus demand position to 1650.000000
kcmid_camera.log:cameraFocusCmd>> BUSY - MOVEing camera focus demand position to 1650.000000
kcmid_camera.log:cameraFocusCmd>> before ieb_setStage 0 camfoc value=1650.000000, R="", S=""
kcmid_camera.log:cameraFocusCmd>> after  ieb_setStage 0 camfoc value=1650.000000, R="", S=""
kcmid_camera.log:cameraFocusCmd>> ERROR - failed MOVEing camera focus demand to 1650.000000

====

[observer@cosmos-4m logs]$ tail kcmid_camera.log
cameraFocusCmd>> before ieb_setStage 0 camfoc value=1400.000000, R="", S=""
iebPackage::ieb_setStage entering...
iebPackage::IEB_DEBUG: iebPackage::ieb_setStage with 4 arguments
iebPackage::TCL_DEBUG: argument 1 : 0
iebPackage::TCL_DEBUG: argument 2 : camfoc
iebPackage::TCL_DEBUG: argument 3 : 1400.000000
iebPackage::ieb_setStage 0 camfoc 1400.000000
iebPackage::ERROR: -1.000000 DONE: camfoc=0 CCW limit asserted
cameraFocusCmd>> after  ieb_setStage 0 camfoc value=1400.000000, R="", S=""
cameraFocusCmd>> ERROR - failed MOVEing camera focus demand to 1400.000000

This last message may be claiming that the counter clockwise limit has been reached.

Sean, Hernan, Claudio, and Jackie (3am)