RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling `cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DFALT_TENSOR_OP)`

See original GitHub issue

I found an error RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DFALT_TENSOR_OP)`` when attempting to call the run the sample code provided in the ReadMe,:

`from big_sleep import Imagine

dream = Imagine(
    text = "fire in the sky",
    lr = 5e-2,
    save_every = 50,
    save_progress = True
)

dream()`

The error seems to have occurred here: File "D:\Anaconda\lib\site-packages\torch\nn\functional.py", line 1753, in linear return torch._C._nn.linear(input, weight, bias)

Does anyone know why this would occur? I am running my code on a 64 bit Windows 10 laptop with a GeForce GTX 1660 Ti Graphics Card

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:7

Top GitHub Comments

1reaction

BassemKarouicommented, Aug 26, 2021

I had the same error, and thx to @anvarganiev I noticed that one tensor had the wrong shape

0reactions

0xBYTESHIFTcommented, Sep 6, 2021

Got this issue too, using the default CLI, not a .py file with my parameters. How to fix it?

Top Results From Across the Web

CUBLAS_STATUS_EXECUTION...

RuntimeError : CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, ...

cuda error: cublas_status_execution_failed when ... - You.com

RuntimeError : CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling `cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc)`我 ...

CUBLAS_STATUS_INVALID_VA...

RuntimeError : CUDA error: CUBLAS_STATUS_INVALID_VALUE when calling `cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ...

CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when ...

environ['CUDA_LAUNCH_BLOCKING'] = "1" command after I got RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(handle) ...

Cublas Bug - GPU-Accelerated Libraries

and it raise an error: RuntimeError: CUDA error: an illegal memory ... cublasLtDestroy(handle); cudaFree(a); cudaFree(b); cudaFree(c); ...