Skip to content

Commit d94f44e

Browse files
committed
glm5next: use ggml_prec_set_acc for the indexer weights
ggml_mul_mat_set_prec was deprecated upstream in ggml-org#26675 and the macOS prebuilt legs build with fatal warnings, so the mix stopped compiling there. Same op_params slot, same F32 accumulation.
1 parent 2af9da2 commit d94f44e

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/models/glm5next.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -409,7 +409,7 @@ ggml_tensor * llama_model_glm5next::graph::build_indexer(
409409

410410
// sign-unconstrained head weights; PREC_F32 is load-bearing, bf16 swaps near-tied pools
411411
ggml_tensor * w = ggml_mul_mat(ctx0, layer.indexer_proj, cur);
412-
ggml_mul_mat_set_prec(w, GGML_PREC_F32);
412+
ggml_prec_set_acc(w, GGML_PREC_F32);
413413
w = ggml_reshape_4d(ctx0, w, n_ihead, n_tps, 1, n_stream);
414414
w = ggml_scale(ctx0, w, 1.0f/sqrtf(float(d_idx*n_ihead)));
415415
cb(w, "indexer_weights", il);

0 commit comments

Comments
 (0)