I have often noticed that some folks reboot systems to fix stale NFS mount problems which can be disruptive. <\/p>\n
Fortunately, that often isn’t necessary. All you have to do is restart nfs and autofs services. However that sometimes fails because user processes have files open on the stale partition or users are cd’ed to the stale partition. <\/p>\n
Both conditions are easy to fix. The steps to fix stale mounts by addressing the previously described conditions are described below.
\n<\/p>\n
Use [crayon lang=”bash” toolbar=”always” title=”Step 1. Kill Processes”] % # Find the jobs that are accessing the state partition and kill them. % # Restart the NFS and AUTOFS services % # Check it Look at the current working directory of all of the users. If any of them are on the partition, that process has to be killed. <\/p>\n [crayon lang=”bash” toolbar=”always” title=”Step 2. Kill Specific Users”] % # List the users that are cd’ed to the stale partition and kill their jobs. % # umount the stale partition % # Restart the NFS and AUTOFS services % # Check it If that fails you have to kill all of the users.<\/p>\n If step 2 doesn’t work then there is something strange going on but killing all of the user processes will usually fix it. That is done as follows.<\/p>\n [crayon lang=”bash” toolbar=”always” title=”Step 3. Kill All Users”] % # Kill all user processes. % # umount the stale partition % # Restart the NFS and AUTOFS services % # Check it As you can see, it is basically the same as step 2 except that all user processes are killed.<\/p>\n If that doesn’t work you need to resort the nuclear option: rebooting.<\/p>\n This is the option of last resort but it should always work.<\/p>\n If you know of any other tips for fix stale NFS mounts I would really like to hear about them.<\/p>\n Enjoy!<\/p>\n","protected":false},"excerpt":{"rendered":" I have often noticed that some folks reboot systems to fix stale NFS mount problems which can be disruptive. Fortunately, that often isn’t necessary. All you have to do is restart nfs and autofs services. However that sometimes fails because user processes have files open on the stale partition or users are cd’ed to the … Continue reading How to fix stale NFS mounts on linux without rebooting<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[15],"tags":[],"_links":{"self":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/356"}],"collection":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=356"}],"version-history":[{"count":12,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/356\/revisions"}],"predecessor-version":[{"id":1001,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/356\/revisions\/1001"}],"wp:attachment":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=356"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=356"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=356"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}lsof <\/code> to find the processes that have files open on the partition and then kill those processes using kill<\/code> or pkill<\/code>.<\/p>\n
\n% sudo su –<\/p>\n
\n% kill -9 $(lsof |\\
\n egrep ‘\/stale\/fs|\/export\/backup’ |\\
\n awk ‘{print $2;}’ |\\
\n sort -fu )<\/p>\n
\n% service nfs stop
\n% service autofs stop
\n% service nfs start
\n% service autofs start<\/p>\n
\n% ls \/stale\/fs
\n[\/crayon]
\nTypically this is sufficient but if it fails, you need to go to step 2.<\/p>\nStep 2. Kill process that have cd’ed to the partition<\/h1>\n
\n% sudo su –<\/p>\n
\n% # NOTE: change \/stale\/fs to the path to your stale partition.
\n% kill -9 $( for u in $( who | awk ‘{print $1;}’ | sort -fu ) ; do \\
\n pwdx $(pgrep -u $u) |\\
\n grep ‘\/stale\/fs’ |\\
\n awk -F: ‘{print $1;}’ ; \\
\ndone)<\/p>\n
\n% umount -f \/state\/fs<\/p>\n
\n% service nfs stop
\n% service autofs stop
\n% service nfs start
\n% service autofs start<\/p>\n
\n% ls \/stale\/fs
\n[\/crayon]<\/p>\nStep 3. Kill all of the users<\/h3>\n
\n% sudo su –<\/p>\n
\n% for u in $( who | awk ‘{print $1;}’ | sort -fu ) ; do \\
\n kill -9 $(pgrep -u $u) |\\
\n awk -F: ‘{print $1;}’ ; \\
\ndone<\/p>\n
\n% umount -f \/state\/fs<\/p>\n
\n% service nfs stop
\n% service autofs stop
\n% service nfs start
\n% service autofs start<\/p>\n
\n% ls \/stale\/fs
\n[\/crayon]<\/p>\nStep 4. Reboot<\/h1>\n