Browser WebGPU mode (experimental)
This mode keeps compute on the visitor's machine, but OpenForecaster-8B currently does not have a public ONNX/WebGPU package.
So this Space cannot run full OpenForecaster-8B in browser WebGPU yet.
Try the in-Space browser client here:
What works today in this Space:
- Server mode with GGUF quants: IQ2_XXS / IQ3_XXS / IQ4_XS
- Server mode with BF16 when GPU/ZeroGPU is available
How to enable true browser WebGPU for Meta-Planner later:
- Export OpenForecaster-8B to an ONNX/WebGPU-compatible model repo.
- Point this mode to that ONNX model.