The Blanco M1 active optics (4MAP) crashed at 23:00 local. With considerable help from Omar in La Serena, Hernan T., was able to bring the system back up by 00:30 local, with a 90-minute technical downtime hit.
We also had a few problems with the SISPI/guider/hexpod systems. First, the guider was behaving eratically, every few exposures, with reports that no stars could be found, and that the AOS system was failure to complete its tasks. When I checked further, I discovered that the DONUT11 role had died, and I could bring it back up.
About the same time, the hexapod was behaving somewhat unusually, in that the X,Y,Z values seemed to nbe incrementing toward their limits of their travel (+/- 3500 microns, if I remember correctly). We tried zeroing out the trim and teak values and taking a few extra images to allow the AOS to zoom-in on the X,Y,Z, Tip/Tilt values, but the same creeping behaviour toward to the limits was noted.
Finally, I shutdown and re-started SISPI in order to recover the DONUT 11 role, and when the system came back up, SISPI seems to be unhappy, and was displaying evidence of two instances of SISPI running. I killed-off one of the instances, and re-started SISPI. When it came back up, everything worked fine again, but we have lost about 45-minutes.
None.