Skip to content

Commit c101713

Browse files
committed
build: align FlashAttention with the 26.09 CUTLASS runtime
Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
1 parent 4d62eb8 commit c101713

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

‎docker/Dockerfile.ci‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -244,7 +244,11 @@ RUN --mount=type=cache,target=/var/cache/apt,sharing=locked \
244244
# its CUTLASS-backed kernels.
245245
if [ "$MBRIDGE_PRESERVE_BASE_RUNTIME" != "True" ]; then \
246246
pip uninstall -y nvidia-cutlass-dsl nvidia-cutlass-dsl-libs-base nvidia-cutlass-dsl-libs-cu13 && \
247-
pip install nvidia-cutlass-dsl[cu13]==4.8.0; \
247+
pip install nvidia-cutlass-dsl[cu13]==4.8.0 && \
248+
# FA4 includes the single-tile scheduler deadlock fix from Dao-AILab/flash-attention#2705.
249+
# Keep FA4 and Quack compatible with the installed CUTLASS 4.8 runtime.
250+
uv pip install --python /usr/bin/python3 --break-system-packages --no-deps \
251+
flash-attn-4==4.0.0b34 quack-kernels==0.6.5; \
248252
fi && \
249253
if [ "$MCORE_TRIGGERED_TESTING" = "true" ]; then \
250254
echo "⚙️ MCore testing mode: syncing the dispatched dependency delta"; \

0 commit comments

Comments
 (0)