NVMe-oF
Let MindShare Bring "NVMe-oF" to Life for You
NVMe-oF
Duration: 2 days
NVMe-oF eLearning Course
NVM Express 1.4 eLearning Course
NVMe-oF eLearning Course
NVM Express 1.4 eLearning Course
Overview
MindShare's NVMe-oF (Non-Volatile Memory Express – over Fabrics) course begins with a brief review of NVMe basics, discusses the forces driving the migration of NVMe into network fabrics, followed by an overview of the different fabrics NVMe-oF will work over such as Ethernet, InfiniBand and Fibre Channel. Finally, the details of NVMe over fabrics are described.
All of MindShare's classroom and virtual classroom courses can be customized to fit the needs of your group.
What You Will Learn
- An overview of the storage fabrics in use today, and their strengths and weaknesses
- The changes needed for NVMe to work in a fabric environment
- How an NVMe host discovers and accesses drives on the fabric
- How NVMe-oF provides a combination of attractive features for a storage fabric
Course Outline
- NVMe Background (as much as needed)
- NVMe basics: registers, queue management, commands and completions
- HCI shared-system-memory model
- NVMe over PCIe
- Introduction to NVMe-oF
- Motivation for moving NVMe to fabrics
- Improve storage network performance compared to legacy protocols
- Avoid limitations of PCIe, extend NVMe protocol to the fabric
- Optimize access latency across the network
- Differences from base NVMe
- Initialization Background
- Motivation for moving NVMe to fabrics
- Fabric Discovery
- Discovery Service, Discovery Controllers
- Discovery Mechanism
- NVMe-oF Initialization
- Fabrics Commands
- Device Setup
- Transport mapping/binding RDMA
- Introduction to RDMA (Remote Direct Memory Access)
- Protocol Translation
- RDMA Examples
- RDMA Concepts
- Motivation: Kernel bypass – reduce CPU involvement
- Zero-copy operation when possible
- RNIC (RDMA-aware Network Interface Card)
- Pinned remote memory and storage
- Command-based Flow Control
- Read and Write Command Examples
- NVMe-oF Details
- Controller Initialization
- Connections and Associations
- Static vs. Dynamic Controller model
- Properties instead of registers
- Authentication
- Encapsulation
- Accessing RDMA Queue pairs
- Data transfer: Command, Response, Data, Flow Control
- Fabrics Commands and Responses
- RNIC Details
- Software Layers
- RDMA Verbs
- Memory Regions and Windows
- Ethernet overview
- TCP/IP: addressing, layers, packets
- RDMA models added to it: RoCE and iWARP.
- Overview of iWARP
- Added to TCP/IP, so packets are routable and don’t need DCB
- Messages
- Layers
- Advantages and disadvantages
- Overview of RoCE
- Version 2 packets include routing information, version 1 did not
- Use of Data Center Bridging (DCB) to manage routing
- Flow control
- Soft RoCE
- Advantages and disadvantages
- Overview of iWARP
Training Materials
- PDF of course slides
- Optional add-on: NVMe-oF eLearning Course
Prerequisites
NVMe architecture knowledge and previous exposure to PCIe is needed, as is some general knowledge of PC architecture.
Related Courses
| Course Name | Classroom | Virtual Classroom | eLearning | |
| NVMe-oF - NVMe over Fabrics | 1 day | 2 half-days | Show Me | |
| NVMe - NVM Express | 4 days | 8 half-days | Show Me |