VNX File OE Upgrade Interrupted….

For any work you did, some easy task always turned to be tough if you were not lucky enough. I did a VNX5600 OE for File upgrade recently, while the whole process should be quite easy to follow as below:

  1. Download linux_image_cd1.iso and pkg_x.x.x.xx.tar files.
  2. Launch USM (Unisphere Service Manager) to connect the control station 0 to upgrade the File OE. (The new USM version has solved dual control station upgrade problem.)

The beginning of the process went well (health check and MD5 checksum), then began the upgrade steps. It looked good until …. the Windows 8 on my laptop crashed! When the Window boot back to normal, I restarted the USM and try to continue the upgrade process and got below error:

Can’t upgrade because another upgrade is in progress. ‘upgrade’ is already locked by (xxxx,xxxxxxxxx) and it is currently ‘running’ The upgrade/install lock is taken by another process. Wait for the other upgrade/install to complete.

I tried to login to control station to check the update.log file located at /var/tmp/upgrade.log. It appeared the upgrade pending at below activity.

hh:mm:ss [  7/88 ]  copy upgrade package                                           4 minutes

Then, I tried to do some operations on VNX control station, and the warning appeared that an upgrade progress is running.

The unlucky Windows crash bring me to a weird situation I had never met before. However, I felt some time-out mechanism should exist on the upgrade scripts, and my feeling was approved right. After waiting about 2 hours, I checked the /var/tmp/upgrade.log  again with below new information , it showed the upgrade stopped due to time out.

YYYY-MM-DD Time: Received signal to terminate at next task boundary  

=====================================SUMMARY===========================

Upgrade is still in progress. When you are ready, rerun install_mgr to resume

the operation.

Status:             Stopped

Actual Time Spent:        1 minutes

Total Number of attempts: 1

Log File:           /var/tmp/upgrade.log

=====================================END===============================

I tried to use USM to do the upgrade again, and YES, the upgrade continues from the step I stopped 2 hours before.

So, next time, anyone who met the Windows/USM crash and upgrade interrupted, please be patient to wait the current running session to expire. (Don’t hesitate to call EMC to log a support case)

The VNX I upgraded is a new one.  For online system, a DVD based upgrade should be the safest way to do the upgrade.

Leave a Reply

Your email address will not be published. Required fields are marked *