Key details for this exam, checked against the published exam outline
Each question shows the correct answer and an explanation of why it is right
If two ports must be connected, but one is SFP and one is QSFP, for example, to connect a 25 GbE HOST CHANNEL ADAPTER to a QSFP port capable of both 100 GbE and 25 GbE, which of the following solutions would best meet this requirement?
The QSA (QSFP to SFP Adapter) is a mechanical and electrical bridge that allows a single-lane SFP/SFP28 transceiver (typically 10G or 25G) to be plugged into a four-lane QSFP/QSFP28 switch port. In AI infrastructure, this is commonly used to connect low-speed management servers or legacy nodes to a high-speed backbone switch without wasting entire 100G/200G ports or requiring specialized breakout cables. The QSA adapter maps the single lane of the SFP module to the first lane of the QSFP port. This is a 'pass-through' solution that maintains the signal integrity and latency characteristics of the link. It is the verified hardware solution for port-density mismatch in NVIDIA networking environments.
During a 48-hour NeMo question-answering model burn-in test, GPU memory errors occur when processing large datasets. Which configuration strategy prevents Out-of-Memory (OOM) errors while maintaining processing efficiency?
NVIDIA NeMo and large language model (LLM) training workloads are extremely demanding on HBM (High Bandwidth Memory). Out-of-Memory (OOM) errors often occur not because the total dataset is too large, but because memory fragmentation or sudden spikes in allocation (spikes during data shuffling or batch loading) exceed the available GPU memory. To mitigate this during intensive burn-in tests, engineers utilize the RMM (RAPIDS Memory Manager) library, which provides an asynchronous allocator. Enabling RMM asynchronous allocation allows the system to pre-allocate a pool of memory and manage it more efficiently than the standard CUDA allocator, reducing the overhead of constant allocations and deallocations. Furthermore, setting a specific blocksize (e.g., 1GB) for data loading ensures that the data ingestion pipeline reads data in manageable, deterministic chunks. This prevents the system from attempting to load massive files entirely into memory at once, which is the primary cause of OOMs in question-answering tasks involving large Parquet or JSON datasets. Switching to FP32 (Option B) would actually double the memory footprint and increase the likelihood of an OOM error.
An engineer needs to validate NVLink Switch functionality on a DGX H100 system with 8 GPUs. Which NCCL command verifies intra-node NVLink bandwidth?
The NVIDIA Collective Communications Library (NCCL) 'Tests' are used to verify the maximum achievable bandwidth of the interconnects. On a DGX H100, the GPUs are connected via a dedicated high-bandwidth NVLink Switch fabric (NVLink 4), which provides significantly higher throughput than PCIe. To validate the intra-node (within a single server) performance, the all_reduce_perf test is used. The command in Option D is specifically designed to stress all 8 GPUs (-g 8) across a wide range of message sizes (8 bytes to 16G). The use of the environment variable NCCL_TESTS_SPLIT with the bitwise 'OR' or 'AND' masks allows the engineer to isolate specific traffic patterns or groups of GPUs to ensure the NVLink switches are distributing the load evenly. For a standard 8-GPU H100 tray, achieving a 'Bus Bandwidth' of ~450 GB/s to 900 GB/s (depending on the precision and message size) confirms that the NVLink fabric is operating at its theoretical peak. Using only 4 GPUs (Option B) or 1 GPU (Option C) would not provide a complete picture of the NVLink switch bisection bandwidth.
During cluster deployment, the UFM Cable Validation Tool reports "Wrong-neighbor" errors on multiple InfiniBand links. What is the most efficient way to resolve this issue?
In large-scale InfiniBand fabrics, such as those in NVIDIA DGX SuperPODs, maintaining an exact cabling topology is mandatory for the Adaptive Routing and Fat-Tree algorithms to function correctly. A 'Wrong-neighbor' error occurs when the Unified Fabric Manager (UFM) detects that a cable is connected to a port other than the one specified in the master topology map (often a .csv or .topology file). UFM uses LLDP (Link Layer Discovery Protocol) or Subnet Management packets to identify the GUIDs on both ends of a link. The most efficient remediation is to cross-reference the live LLDP data provided by UFM with the intended design. This allows the engineer to identify if the error is a physical mis-cabling (swapped ports) or a logical error in the topology file. Rebooting switches (Option A) will not fix a physical patch error, and disabling FEC (Option D) would lead to catastrophic signal loss on 400G (NDR) links without addressing the underlying routing logic issue. Correcting the physical patch or updating the topology file ensures the fabric's 'Ground Truth' is restored.
A system administrator receives an alert about a potential hardware fault on an NVIDIA DGX A100. The GPU performance seems degraded, and the system fans are operating loudly. What step should be recommended to identify and troubleshoot the hardware fault?
When a DGX system exhibits high fan speeds and performance degradation, it is typically engaging in Thermal Throttling. High-performance GPUs like the A100 or H100 will automatically reduce their clock speeds (and thus performance) if they exceed safe temperature thresholds. The first and most critical diagnostic step is to run nvidia-smi. This utility provides immediate, real-time telemetry on GPU temperatures, power draw, and 'Clocks Throttle Reasons.' By reviewing the output, an administrator can see if 'Thermal' is listed as the reason for reduced clocks. This identifies whether the issue is environmental (blocked airflow/hot aisle temperature) or hardware-specific (a failed GPU thermal interface or a dead internal fan). Running more workloads (Option A) would exacerbate the heat, while a power drain (Option C) is a 'last resort' that doesn't provide diagnostic data. nvidia-smi provides the evidentiary data needed to determine if an RMA (Return Merchandise Authorization) is required for the GPU tray.
An infrastructure engineer in an AI factory has successfully replaced a power supply unit on an NVIDIA DGX H100. After installation, both the IN and OUT LEDs on the new power supply illuminate solid green. Which NVSM CLI command should the engineer use to quickly verify the overall system status and ensure it is operating as expected?
The NVIDIA System Management (NVSM) tool is the definitive CLI utility for monitoring the health of DGX platforms. While replacing a PSU (Power Supply Unit) is a common maintenance task, verifying that the new component is correctly integrated into the system's health model is mandatory. While nvsm show power would provide specific data regarding wattage and voltage for the PSU, the most comprehensive way to ensure the replacement hasn't caused secondary issues or that the system hasn't remained in a 'Degraded' state is to run nvsm show health. This command performs a global check across all subsystems: GPUs, NVLink switches, storage, fans, and power. If the PSU replacement was successful and the system is back to full redundancy, nvsm show health will return a 'Healthy' status. In an AI factory setting, where DGX H100 nodes pull significant power, ensuring that all 6 PSUs (in an N+N or N+1 configuration) are not only physically green but logically acknowledged by the Baseboard Management Controller (BMC) is critical for preventing unexpected shutdowns during high-load training iterations.
A financial services firm is deploying an AI model for fraud detection that requires rapid inference and data retrieval across multiple sites. Which feature should their storage system prioritize?
Fraud detection in financial services is a real-time AI workload. The system must ingest transaction data, retrieve historical customer profiles, and perform inference in milliseconds. This requires a storage architecture that supports multi-protocol access (such as S3 for ingestion and POSIX/NFS for inference engines) combined with low latency. In these environments, storage latency directly impacts the 'Time to Decision'. An All-Flash storage tier is mandatory, as traditional HDD solutions (Option D) or moderate speed systems (Option B) introduce 'Tail Latency' that can cause the fraud detection model to time out during peak transaction windows. Additionally, multi-site synchronization ensures that the latest model weights and historical data are available across different geographic data centers for high availability and localized inference.
Exam domains verified against: Official NVIDIA NCP-AII exam guide, last checked October 2026.
Covers deployment sequence validation and network topology design for AI factories. Includes BMC, OOB, and TPM configuration plus firmware upgrades, power and cooling validation, GPU installation via SMI, and hardware operation verification for workloads.
Sample question from this domain above: Q5
Focuses on BlueField network platform configuration and management. Includes Multi-Instance GPU (MIG) configuration for both AI and HPC workloads.
Covers Base Command Manager (BCM) deployment with HA configuration and OS installation. Includes cluster setup with Slurm, Enroot, and Pyxis, plus GPU driver and DOCA driver installation, container toolkit deployment, and NGC CLI usage.
Largest domain covering single-node stress testing and HPL execution. Includes NCCL validation with NVLink verification, cable signal quality assessment, firmware confirmation on switches and BlueField-3, ClusterKit multifaceted assessment, and burn-in testing for NCCL, HPL, and NeMo.
Sample question from this domain above: Q4
Addresses hardware fault identification and replacement including GPUs, fans, and power supplies. Covers performance optimization for AMD and Intel servers plus storage optimization.
Sample question from this domain above: Q7
Common questions about the exam itself