I have some nodes and I plan to use NFS to manage file storage. However, I have high requirements for performance and stability, and I wonder if there is a more suitable shared file system recommendation.
If you are using NFS storage for job execution (scratch directory or $jobdir_root) , then it would not performant enough (IOPS, bandwidth, many jobs accessing this storage). Better to use the local disk for that and copy back the result files to NFS storage. If the NFS storage is overwhelmed then execution would be slow or affected.
Is there a more suitable shared file system alternative?
PanFS, Lustre , BeeGFS
Thanks sincerely for your recommendation，Mr adarsh.