Nutanix CVM Space issues

I ran into some interesting space issues on Nutanix cluster recently, I was doing a manual download of NOS to run the upgrade and my /home folder on one of the CVM’s was hitting 95% and giving some warnings.

After a quick call with support my suspicions were confirmed and some stuff could be deleted form this directory , but what to delete as their are lots of folders under the home folder.

Lets take a look at how we got to the correct folder to delete.

First connect to each CVM to check which one is causing the issue, a hint it’s most likely in the alert that been generated in Prism.

sisk_space_scr_001

Run command –> df-h

This will list the contents on all file systems, In my case the /home folder was showing 95%

sisk_space_scr_002

Running command –> du – xsh*

Lists the size of each directory so you can see which folders have the most space

Clearly the software_downloads and software_uncompressed folders were the culprits.

sisk_space_scr_003

You can go directly to these directories and when in directory

Running command –> du-sh

Gives you the total size of the directory.

sisk_space_scr_004

Running command –> ls

Lists the contents of the folder, in my case I has three versions of NOS downloaded which until installed the binaries are not removed.

So it was safe to delete these and free up the space.

sisk_space_scr_005

Running Command –> rm -rf /home/nutanix/software_downloads/nos/*

Removes all for files in the folder /NOS

Repeat these steps to clean up the software_uncompressed folder and you will be back to normal.

Update 02/03/2020

Nutanix have now released KB What to do when /home partition or /home/nutanix directory is full 

If you use WINSCP to copy the tool to the CVM, make sure you change the permissions to execute and then run it, it will prompt you to install on all CVMs then run the cleanup tool form each CVM and it will do a proper cleanup for you.

Log onto CVM run the tool this extracts it to all CVM’s

update01Then in the same folder you will see nutanix_home_clean.sh file in same location

update02

Connect to each CVM in the cluster and run the script, this will run through and delete and unneeded files.

 

One thought on “Nutanix CVM Space issues

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s