Update autotune configuration to avoid crash on AMD devices

by ror HF Staff - opened May 23

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

+18

-16

ror

May 23

When running on an AMD device, trying to autotune with 32 warps causes a crash with RuntimeError: Triton Error [HIP]: Code: 1, Messsage: invalid argument. Thus we are removing that configuration when the device name contains "AMD", which is the case for MI250, MI300 and MI355. Tested on MI300.

Update autotune configuration to avoid crash on AMD devicesda878ae1

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

torch-ext/triton_layer_norm/layer_norm.py

· Sign up or log in to comment