Key details for this exam, checked against the published exam outline
Each question shows the correct answer and an explanation of why it is right
Which principle of Trustworthy AI primarily concerns the ethical implications of AI's impact on society and includes considerations for both potential misuse and unintended consequences?
Accountability is a core principle of Trustworthy AI that addresses the ethical implications of AI's societal impact, including potential misuse and unintended consequences. NVIDIA's guidelines on Trustworthy AI, as outlined in their AI ethics framework, emphasize accountability as ensuring that AI systems are transparent, responsible, and answerable for their outcomes. This includes mitigating risks of bias, ensuring fairness, and addressing unintended societal impacts. Option A (Certification) refers to compliance processes, not ethical implications. Option B (Data Privacy) focuses on protecting user data, not broader societal impact. Option D (Legal Responsibility) is related but narrower, focusing on liability rather than ethical considerations.
NVIDIA Trustworthy AI: https://www.nvidia.com/en-us/ai-data-science/trustworthy-ai/
In the context of transformer-based large language models, how does the use of layer normalization mitigate the challenges associated with training deep neural networks?
Layer normalization is a technique used in transformer-based large language models (LLMs) to stabilize and accelerate training by normalizing the inputs to each layer. According to the original transformer paper ('Attention is All You Need,' Vaswani et al., 2017) and NVIDIA's NeMo documentation, layer normalization reduces internal covariate shift by ensuring that the mean and variance of activations remain consistent across layers, mitigating issues like vanishing or exploding gradients in deep networks. This is particularly crucial in transformers, which have many layers and process long sequences, making them prone to training instability. By normalizing the activations (typically after the attention and feed-forward sub-layers), layer normalization improves gradient flow and convergence. Option A is incorrect, as layer normalization does not reduce computational complexity but adds a small overhead. Option C is false, as it does not add significant parameters. Option D is wrong, as layer normalization complements, not replaces, the attention mechanism.
Vaswani, A., et al. (2017). 'Attention is All You Need.'
NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/intro.html
In the Transformer architecture, which of the following statements about the Q (query), K (key), and V (value) matrices is correct?
In the transformer architecture, the Q (query), K (key), and V (value) matrices are used in the self-attention mechanism to compute relationships between tokens in a sequence. According to 'Attention is All You Need' (Vaswani et al., 2017) and NVIDIA's NeMo documentation, the query vector (Q) represents the token seeking relevant information, the key vector (K) is used to compute compatibility with other tokens, and the value vector (V) provides the information to be retrieved. The attention score is calculated as a scaled dot-product of Q and K, and the output is a weighted sum of V. Option C is correct, as Q retrieves relevant information. Option A is incorrect, as Q, K, and V are not used for positional encoding. Option B is wrong, as attention scores are computed using both Q and K, not K alone. Option D is false, as positional embeddings are separate from V.
Vaswani, A., et al. (2017). 'Attention is All You Need.'
NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/intro.html
What is the prompt ''Translate English to French: cheese =>'' an example of?
The prompt ''Translate English to French: cheese =>'' is an example of zero-shot learning, as discussed in NVIDIA's Generative AI and LLMs course. Zero-shot learning refers to a model's ability to perform a task without prior task-specific training or examples, relying solely on its pre-trained knowledge and the prompt's instructions. In this case, the prompt provides no training examples, expecting the model to translate ''cheese'' to French (''fromage'') based on its general understanding of language and translation. Option A, few-shot learning, is incorrect, as it involves providing a few examples in the prompt. Option B, fine-tuning, involves retraining the model, not prompting. Option C, one-shot learning, requires a single example, which is not provided here. The course notes: ''Zero-shot learning enables LLMs to perform tasks like translation without task-specific training, using only a descriptive prompt to leverage pre-trained knowledge.''
Which library is used to accelerate data preparation operations on the GPU?
cuDF is a GPU-accelerated data manipulation library within the RAPIDS ecosystem, designed to speed up data preparation operations such as filtering, joining, and aggregating large datasets. As highlighted in NVIDIA's Generative AI and LLMs course, cuDF provides pandas-like functionality for data preprocessing but leverages GPU parallelism to achieve significant performance improvements, making it ideal for data science workflows involving large-scale data preparation. Option A, cuML, is incorrect, as it focuses on machine learning algorithms, not data preparation. Option B, XGBoost, is a gradient boosting framework, not a data preparation library. Option D, cuGraph, is used for graph analytics, not general data preparation. The course notes: ''RAPIDS cuDF accelerates data preparation operations by enabling GPU-based processing, offering pandas-like functionality with significant speedups for tasks like data filtering and transformation.''
In the development of trustworthy AI systems, what is the primary purpose of implementing red-teaming exercises during the alignment process of large language models?
Red-teaming exercises involve systematically testing a large language model (LLM) by probing it with adversarial or challenging inputs to uncover vulnerabilities, such as biases, unsafe responses, or harmful outputs. NVIDIA's Trustworthy AI framework emphasizes red-teaming as a critical step in the alignment process to ensure LLMs adhere to ethical standards and societal values. By simulating worst-case scenarios, red-teaming helps developers identify and mitigate risks, such as generating toxic content or reinforcing stereotypes, before deployment. Option A is incorrect, as red-teaming focuses on safety, not speed. Option C is false, as it does not involve model size. Option D is wrong, as red-teaming is about evaluation, not data collection.
NVIDIA Trustworthy AI: https://www.nvidia.com/en-us/ai-data-science/trustworthy-ai/
What is the purpose of few-shot learning in prompt engineering?
Few-shot learning in prompt engineering involves providing a small number of examples (demonstrations) within the prompt to guide a large language model (LLM) to perform a specific task without modifying its weights. NVIDIA's NeMo documentation on prompt-based learning explains that few-shot prompting leverages the model's pre-trained knowledge by showing it a few input-output pairs, enabling it to generalize to new tasks. For example, providing two examples of sentiment classification in a prompt helps the model understand the task. Option B is incorrect, as few-shot learning does not involve training from scratch. Option C is wrong, as hyperparameter optimization is a separate process. Option D is false, as few-shot learning avoids large-scale fine-tuning.
NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/intro.html
Brown, T., et al. (2020). 'Language Models are Few-Shot Learners.'
Exam domains verified against: Official NVIDIA NCA-GENL exam guide, last checked October 2026.
Covers foundational principles of machine learning and neural networks that underpin large language model development. Understand the basic structure and learning mechanisms involved in training generative AI systems.
Learn how to craft effective prompts that guide LLMs to produce desired outputs. Focus on prompt strategies, formatting, and iterative refinement techniques used in both development and real-world applications.
Sample question from this domain above: Q4
Explore techniques to align LLM outputs with human intentions and values. Study safety mechanisms, ethical safeguards, and tuning strategies to reduce harmful, biased, or inaccurate results.
Learn to interpret, clean, and present data through visual storytelling. Apply visualization techniques to extract insights and evaluate model behavior, performance, and training data patterns.
Sample question from this domain above: Q2
Understand how to conduct structured experiments with LLMs. Design and execute tests that validate your approaches to model development and deployment.
Master preparing raw data into usable formats for model training and fine-tuning. Learn cleaning, normalizing, tokenizing, and feature extraction methods essential to building robust LLM pipelines.
Sample question from this domain above: Q1
Learn to strategically plan experiments that validate hypotheses and compare model variations. Design tests that examine model responses across different scenarios and use cases.
Focus on writing efficient, modular, and scalable code for AI applications. Apply software engineering practices to LLM-based systems that are maintainable and performant.
Work with Python tools and frameworks like Hugging Face Transformers. Master the libraries and utilities essential to building and fine-tuning language models.
Learn connecting LLMs with applications and services through APIs. Study secure and efficient deployment of models at scale, including production considerations and integration patterns.
Sample question from this domain above: Q5
Common questions about the exam itself
