My colleagues and I recently built a filer using OI 151a\/ZFS and wanted to increase the throughput by aggregating multiple NICs to a common IP address that is dedicated for data. We did it by physically adding a card with 4 NICs, aggregating the ports on server and then updating the switch to enable link aggregation (port trunking) on the 2 connections.
\n<\/p>\n
For this filer, we added a 4 NIC PCI\/e mezannine card to the server.<\/p>\n
I then logged into the server as root and aggregating the NIC’s. This process was slightly different than the what I found on the web because OI 151a is based on Solaris 11. Here is what I did.<\/p>\n
[crayon type=”bash” toolbar=”always” title=”Aggregate Server NICs”]
\n% # Turn off the automatic network management
\n% svcadm disable \/network\/physical:nwam<\/p>\n
% # Show the links
\n% ifconfig -a
\n% dladm show-link<\/p>\n
% # Unplumb the current physical devices (from show-link)
\n% ifconfig bnx0 unplumb
\n% ifconfig bnx1 unplumb<\/p>\n
% # Create the aggregation, name it “aggr1”
\n% dladm create-aggr -l bnx0 -l bnx1 aggr1<\/p>\n
% # Create the plumbing for it
\n% ifconfig aggr plumb<\/p>\n
% # Assign the IP address
\n% ifconfig aggr 192.168.1.200 netmask 255.255.255.0 up<\/p>\n
% # Verify that it is up
\n% ifconfig -a
\n% dladm show-aggr
\n[\/crayon]<\/p>\n
Finally we needed to enable link aggregation (aka Port Trunking) on the switch to make sure that it can handle multiple MACs for a single IP address. If you don’t do this, performance will degrade to be worse than a single port because the switch will keep getting confused by different MACs.<\/p>\n
This step is different for all switches. I have done it with a Cisco Catalyst 3750 and one of my colleagues did it with a Netgear GS176T. The instructions for doing it can be found in the user manuals.<\/p>\n","protected":false},"excerpt":{"rendered":"
My colleagues and I recently built a filer using OI 151a\/ZFS and wanted to increase the throughput by aggregating multiple NICs to a common IP address that is dedicated for data. We did it by physically adding a card with 4 NICs, aggregating the ports on server and then updating the switch to enable link … Continue reading OpenIndiana 151a NIC Aggregation<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[16],"tags":[19],"_links":{"self":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/627"}],"collection":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=627"}],"version-history":[{"count":8,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/627\/revisions"}],"predecessor-version":[{"id":657,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=\/wp\/v2\/posts\/627\/revisions\/657"}],"wp:attachment":[{"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=627"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=627"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/joelinoff.com\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=627"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}