Anyone know how networking for Dell M1000e with M630 nodes work?

Started by kpripper, Jun 28, 2022, 05:19 AM

Previous topic - Next topic

kpripperTopic starter

I am looking at the Dell M1000e with the M630 nodes that support up to E5-2600 v4 CPUs and i am yet to find information and/or youtube video showing how to connect networking for the server blade.

16x M630 Blade Servers
9x Cooling Fans
6x 2000W Power Supplies
2x CMC Modules
iKVM installed
2x Dell Force10 MXL 10/40Gbe switch Module with 2x QSFP+ Modules
2x Dell Force10 M I/O Aggregator switch 2x QSFP+ Modules

Do i just get a router and connect to the switches? How does networking reach the server nodes? Any way to assign specific network speed to a particular server node? et cetera
  •  

Sevad

Most people try to avoid the large blade systems due to the large power usage they require unless you really fill them up and plan to use it all.
It makes more sense in places with lower power costs as well.
  •  

gstarspas

Hi. We are running many of those systems with the Force10 MXL switches. If you have the correct daughter card in each of the M630 blades, each switch will give you a 10 Gpbs port to each blade and 2x 40 Gbps uplinks. The daughter card you need is Dell 10GbE 57810S-K, which has 2x 10Gbps ports. You'll need to place the two Force10 MXL switches in fabrics A1 and A2.

The MXL's are capable of L3. In our case we use a Clos topology so that each MXL is a leaf switch and they connect to 2x Juniper QFX5100's which act as spines. This is the MXL's shell:

xхxXX-pub-leaf#show interfaces status
Port Description Status Speed Duplex Vlan
Te 0/1 Up 10000 Mbit Full 11
Te 0/2 Up 10000 Mbit Full 11
Te 0/3 Up 10000 Mbit Full 11
Te 0/4 Up 10000 Mbit Full 11
Te 0/5 Up 10000 Mbit Full 11
Te 0/6 Up 10000 Mbit Full 11
Te 0/7 Up 10000 Mbit Full 11
Te 0/8 Up 10000 Mbit Full 11
Te 0/9 Up 10000 Mbit Full 11
Te 0/10 Up 10000 Mbit Full 11
Te 0/11 Up 10000 Mbit Full 11
Te 0/12 Up 10000 Mbit Full 11
Te 0/13 Up 10000 Mbit Full 11
Te 0/14 Up 10000 Mbit Full 11
Te 0/15 Up 10000 Mbit Full 11
Te 0/16 Up 10000 Mbit Full 11
Te 0/17 Down Auto Auto 1
Te 0/18 Down Auto Auto 1
Te 0/19 Down Auto Auto 1
[...]
Fo 0/33 "To spine1 Up 40000 Mbit Full --
Fo 0/37 "To spine2 Up 40000 Mbit Full --

0/1 to 0/16 are for the 16x M630 blades. If you use quarter-length blades (we don't) you have 0/17 to 0/32 too. 0/33 and 0/37 are the 40 Gbps uplinks.

To change interface speed:

xхxX-pub-leaf(conf)#Interface Tengigabitethernet 0/6
xхxX-pub-leaf(conf-if-te-0/6)#speed ?
100 100 Mbps
1000 1000 Mbps
10000 10000 Mbps
auto Auto negotiation (default)

The Force10 M I/O Aggregator has the same port specs as the MXL, but no L3 features. You would need an extra daughter card in each blade in fabric B if you want to use the 4 switches (2x MXL and 2x M). That will give you 4x 10Gbps to each blade.

Feel free to ask if you have additional questions.
  •  

Wiley Harding

Dell PowerEdge M630 Blade Server

Dell's PowerEdge M630 blade server is the thirteenth generation of versatile, high-performance server solutions for processing large amounts of data in workplace virtualization, real-time business intelligence and other high-load applications.
That product is designed for the PowerEdge M1000e blade server and the PowerEdge VRTX modular infrastructure. The M630 solution is distinguished by a wide range of tasks to be solved, increased reliability, as well as great scaling potential in areas such as the supply of IT resources, as well as private cloud systems and remote offices.
Technical specifications

The M630 is based on Intel Xeon E5-2600 v4 processors.
The system is equipped with two processors, each of which supports up to 22 cores.
In the latest generation of M630 systems, memory bandwidth has increased by 28% (compared to previous generations), which guarantees performance sufficient for a larger number of virtual machines.
The server provides for the installation of up to 24 DIMM RAM strips, with a capacity of 4 GB to 64 GB each, which provides up to 1.5 TB of total RAM. That amount of memory and high throughput make it possible to use Dell PowerEdge M630 systems in the production of complex research and development, as well as for high-performance computing (HPC). 
The data storage subsystem is represented by four local SSD drives made in a 1.8` form factor, which is twice as large as that of the previous generation of servers.
In addition to 1.8` solid-state drives, 2.5` form factor SSD drives (up to 2 pieces) and 2.5` Express Flash PCIe solid-state drives (up to 2 pieces) are supported. Such variability in the choice of components provides ample opportunities in the selection of configurations for specific tasks and the budget of the customer.
Optionally, Dell EMC Select modular network adapters are available, which provide access to storage resources (both NAS and SAN). With these expansion cards, you can choose the switching network, as well as its speed and the supplier of network products.
The video subsystem is represented by integrated Matrox G200 graphics with 16 MB of video memory.

Operation and management

The work on managing and automating the Dell PowerEdge M630 server is greatly facilitated by built-in algorithms. The Dell EMC Chassis Management Controller (CMC), which is a consolidated integrated interface for managing multiple chassis, allows you to manage PowerEdge M630 blade servers in groups or one at a time, as part of one or more chassis.
The integrated Dell EMC iDRAC remote access controller, as well as the Lifecycle Controller, significantly simplify the administration process due to the implemented intelligent functions.
Lifecycle Controller continuously monitors the server and local data storage in real time, and iDRAC monitors the status of servers and system performance, which eliminates the need to install additional third-party applications to perform these functions. In addition to monitoring the system status, Lifecycle Controller monitors the installation of updates and automatically installs the necessary software on newly installed hardware components.
The server is managed through the intuitive user interface of Active System Manager. That solution provides such features as: template-based server configuration; replenishment of the library of new templates; new opportunities for cloud infrastructure
The PowerEdge M630 is a serious solution that is easily scaled, quickly deployed, easy to master and cheap to operate. That product is suitable for customers both in the field of medium and large businesses, as well as large educational and scientific centers for conducting complex scientific research.
  •