AWS Certified AI Practitioner AIF-C01 Practice Question

Why can a transformer-based large language model usually perform inference more quickly on modern GPUs than a recurrent neural network (RNN) when both must analyze an equally long text sequence?

  • Transformers evaluate all tokens concurrently through self-attention, allowing the workload to be parallelized on the GPU.

  • Transformers cache the entire model vocabulary in GPU memory, so no additional computation is needed during inference.

  • Transformers rely mainly on convolutional layers, which require fewer floating-point operations than matrix multiplications.

  • Transformers omit positional encodings, reducing overhead compared with architectures that track token positions.

AWS Certified AI Practitioner AIF-C01
Fundamentals of Generative AI
Your Score:
Settings & Objectives
Random Mixed
Questions are selected randomly from all chosen topics, with a preference for those you haven’t seen before. You may see several questions from the same objective or domain in a row.
Rotate by Objective
Questions cycle through each objective or domain in turn, helping you avoid long streaks of questions from the same area. You may see some repeat questions, but the distribution will be more balanced across topics.

Check or uncheck an objective to set which questions you will receive.

Bash, the Crucial Exams Chat Bot
AI Bot