Skip to main content

AutoAWQ Kernels implements the AWQ kernels.

Project description

AutoAWQ Kernels

AutoAWQ Kernels is a new package that is split up from the main repository in order to avoid compilation times.

Requirements

  • Windows: Must use WSL2.

  • NVIDIA:

    • GPU: Must be compute capability 7.5 or higher.
    • CUDA Toolkit: Must be 11.8 or higher.
  • AMD:

    • ROCm: Must be 5.6 or higher.

Install

Install from PyPi

The package is available on PyPi with CUDA 12.1.1 wheels:

pip install autoawq-kernels

Install release wheels

For ROCm and other CUDA versions, you can use the wheels published at each release:

pip install https://github.com/casper-hansen/AutoAWQ_kernels/releases/download/v0.0.2/autoawq_kernels-0.0.2+rocm561-cp310-cp310-linux_x86_64.whl

Build from source

You can also build from source:

git clone https://github.com/casper-hansen/AutoAWQ_kernels
cd AutoAWQ_kernels
pip install -e .

To build for ROCm, you need to first install the following packages rocsparse-dev hipsparse-dev rocthrust-dev rocblas-dev hipblas-dev.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

autoawq_kernels-0.0.3-cp311-cp311-win_amd64.whl (1.9 MB view hashes)

Uploaded CPython 3.11 Windows x86-64

autoawq_kernels-0.0.3-cp310-cp310-win_amd64.whl (1.9 MB view hashes)

Uploaded CPython 3.10 Windows x86-64

autoawq_kernels-0.0.3-cp39-cp39-win_amd64.whl (1.9 MB view hashes)

Uploaded CPython 3.9 Windows x86-64

autoawq_kernels-0.0.3-cp38-cp38-win_amd64.whl (1.9 MB view hashes)

Uploaded CPython 3.8 Windows x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page