GPUtopia
GPUtopia uses a portion of your computer’s GPU via WebGPU , a new web standard that was recently added to newer versions of Chrome. First your browser needs to download a language model. This is a ~4GB file that will be stored in your browser’s cache. This will take a few minutes to download, then ~20 seconds to load from cache on future visits. You can see how this works in the MLC WebLLM repo.
BTC
Learn More
GPUtopia uses a portion of your computer’s GPU via WebGPU , a new web standard that was recently added to newer versions of Chrome. First your browser needs to download a language model. This is a ~4GB file that will be stored in your browser’s cache. This will take a few minutes to download, then ~20 seconds to load from cache on future visits. You can see how this works in the MLC WebLLM repo.