The Snapdragon 8 Gen 3 is the first chipset where the Qualcomm GPT tool has received "Gold Verification." This chip can run a 10-billion parameter LLM at 15 tokens per second. For context, a 10-billion parameter model is roughly equivalent to the intelligence of GPT-3.5. You can now run GPT-3.5-level intelligence offline, securely, on a device that fits in your pocket.

Current verification covers text-based GPT. The next battle is verifying the tool for GPT-4o (omni) level models that handle audio, video, and text simultaneously. Qualcomm has already demoed a verified tool running a 1.5B parameter multimodal model at 20 tokens per second on a Snapdragon X Elite laptop.

At its core, the GPT Tool (often associated with the GSM GPT Tool or similar variants) is a software utility designed to interface with Qualcomm chipsets. Its primary functions usually include: