Market Section - Product Pricing n Discussions [NO Price checks]

Social Off-topic & Debates
1218

Congratulations on your moving.

Unfortunately I have reasons to believe that the last query you answered was just AI hallucinating. I’d love to be wrong though. Could you please share the source? Meanwhile could you please also run the following scripts and share their output?

(Posting here so it helps other potential buyers). DMed rest of the stuff.

  1. Testing Flash Attention
git clone https://github.com/ROCm/flash-attention
cd flash-attention
git fetch
git branch -a
git checkout howiejay/navi_support
python setup.py install
python -c "import flash_attn; print(flash_attn.__version__)"
  1. Testing xFormers
# Make sure you have the ROCm version of PyTorch
pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.0
# You can double check
python -c "import torch; print(torch.version.hip)"
# Install from source
pip install ninja
pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers
pip wheel -v --no-build-isolation git+https://github.com/ROCm/xformers.git@main#egg=xformers

# Double check
python -m xformers.info
  1. Triton Compilation check
# Using nightly build:
git clone https://github.com/openai/triton.git
cd triton
pip install ninja cmake wheel; # build-time dependencies
pip install -e python
# ROCm fork 
git clone https://github.com/ROCm/triton
cd triton/python
pip install -e .
  1. And lastly check if unsloth is installing
pip install unsloth
5 Likes