Skip to content

Commit

Permalink
Fix: Increase Vulkan detection timeout to 12 seconds
Browse files Browse the repository at this point in the history
The previous timeout of 1 second for detecting the Vulkan GPU using `vulkaninfo --summary` was insufficient on some systems, leading to the command timing out and the inference falling back to the CPU. This commit increases the timeout to 12 seconds to accommodate systems where `vulkaninfo` takes longer to complete.

This change addresses an issue where the Vulkan backend would frequently fall back to CPU inference due to the `vulkaninfo` command timing out before it could return the necessary information to detect the GPU. The increased timeout ensures that the command has sufficient time to complete on a wider range of systems, enabling the Vulkan backend to correctly detect and utilize the GPU for inference.
  • Loading branch information
LSXPrime authored and LSXPrime committed Sep 30, 2024
1 parent c9a9b75 commit 6df1b09
Showing 1 changed file with 4 additions and 6 deletions.
10 changes: 4 additions & 6 deletions LLama/Native/Load/SystemInfo.cs
Original file line number Diff line number Diff line change
Expand Up @@ -84,13 +84,11 @@ public static SystemInfo Get()
CreateNoWindow = true
}
};
var (exitCode, output, error, ok) = process.SafeRun(TimeSpan.FromSeconds(1));
var (exitCode, output, error, ok) = process.SafeRun(TimeSpan.FromSeconds(12));

if (!ok)
return null;

// Return the output
return output;
// If ok return the output else return null
return ok ? output :
null;
}
catch
{
Expand Down

0 comments on commit 6df1b09

Please sign in to comment.