potentially-poor-vsphere-nfs-read-io-performance-with-10gbe-vmnics

VMware released a knowledge base article about a real performance issue when using NFS with certain 10GbE network adapters in the VMware ESXi host.

In vSphere 6.0, NFS Read I/O performance (in IO/s) for large I/O sizes (of 64KB and above) with an NFS datastore may exhibit significant variations. This issue is observed when certain 10 Gigabit Ethernet (GbE) controllers are used. The performance variability reported in this KB is specific to ESXi’s NFS client and does not pertain to NFS clients in a virtual machine.

Symptoms

If you think you´re vSphere NFS performance is affected the following symptoms:

  • Varying performance (IOPS) with read workloads.
  • Physical NIC shows increasing packet error counts:ethtool -S vmnicX | grep rx_errors

You should check KB article Potentially poor NFS Read I/O performance with 10GbE vmnics (2120163)

Solution

You need to open a command line session to your vSphere ESXi Host:

  • List the NICs: esxcli network nic list
  • Check the receive ring speed (current hardware settings – "RX", default 496): ethtool -g vmnic# (# – NIC number, i. e. vmnic2)
  • Set the receive ring speed to 4096: ethtool -G vmnic# rx 4096 (# – NIC number, i. e. vmnic2)

Warp Speed for vSphere NFS

Photo courtesy of dolbinator1000(CC Attribution)

CNIL
Metrics and Logs

(formerly, Opvizor Performance Analyzer)

VMware vSphere & Cloud
PERFORMANCE MONITORING, LOG ANALYSIS, LICENSE COMPLIANCE!

Monitor and Analyze Performance and Log files:
Performance monitoring for your systems and applications with log analysis (tamperproof using immudb) and license compliance (RedHat, Oracle, SAP and more) in one virtual appliance!

Subscribe to Our Newsletter

Get the latest product updates, company news, and special offers delivered right to your inbox.
Share on twitter
Share on linkedin
Share on facebook
Share on email

Subscribe to our newsletter

White Paper — Registration

We will send you the research paper via email.

CodeNotary — Webinar

White Paper — Registration

Please let us know who you are, so we can send you the CodeNotary Trusted Software Supply Chain white paper.

Become a partner

Start Your Trial

Please enter contact information to receive an email with the virtual appliance download instructions.

Start Free Trial

Please enter contact information to receive an email with the free trial details.