Jon Allman | Puget Systems https://www.pugetsystems.com/bios/jonallman/ Workstations for creators. Tue, 02 Jul 2024 21:34:50 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.3 https://www.pugetsystems.com/wp-content/uploads/2022/08/Puget-Systems-2020-logomark-color-500-48x48.png Jon Allman | Puget Systems https://www.pugetsystems.com/bios/jonallman/ 32 32 Effects of CPU speed on GPU inference in llama.cpp https://www.pugetsystems.com/labs/articles/effects-of-cpu-speed-on-gpu-inference-in-llama-cpp/ https://www.pugetsystems.com/labs/articles/effects-of-cpu-speed-on-gpu-inference-in-llama-cpp/#respond Mon, 01 Jul 2024 17:20:22 +0000 https://www.pugetsystems.com/?post_type=article&p=28690 What effect, if any, does a system's CPU speed have on GPU inference with CUDA in llama.cpp?

The post Effects of CPU speed on GPU inference in llama.cpp appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/articles/effects-of-cpu-speed-on-gpu-inference-in-llama-cpp/feed/ 0 Puget Mobile 17″ vs M3 Max MacBook Pro 16″ for AI Workflows https://www.pugetsystems.com/labs/articles/puget-mobile-17-vs-m3-max-macbook-pro-16-for-ai-workflows/ https://www.pugetsystems.com/labs/articles/puget-mobile-17-vs-m3-max-macbook-pro-16-for-ai-workflows/#respond Tue, 28 May 2024 19:17:34 +0000 https://www.pugetsystems.com/?post_type=article&p=27770 How does the new Puget Mobile 17" compare to the MacBook Pro M3 Max 16" in performance across a variety of AI-powered workloads?

The post Puget Mobile 17″ vs M3 Max MacBook Pro 16″ for AI Workflows appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/articles/puget-mobile-17-vs-m3-max-macbook-pro-16-for-ai-workflows/feed/ 0 Local alternatives to Cloud AI services https://www.pugetsystems.com/labs/hpc/local-alternatives-to-cloud-ai-services/ https://www.pugetsystems.com/labs/hpc/local-alternatives-to-cloud-ai-services/#respond Thu, 11 Apr 2024 20:07:33 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=26768 Presenting local AI-powered software options for tasks such as image & text generation, automatic speech recognition, and frame interpolation.

The post Local alternatives to Cloud AI services appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/local-alternatives-to-cloud-ai-services/feed/ 0 Stable Diffusion Linux vs. Windows https://www.pugetsystems.com/labs/articles/stable-diffusion-linux-vs-windows/ https://www.pugetsystems.com/labs/articles/stable-diffusion-linux-vs-windows/#respond Mon, 01 Apr 2024 17:18:38 +0000 https://www.pugetsystems.com/?post_type=article&p=26602 How does the choice of Operating System affect image generation performance in Stable Diffusion?

The post Stable Diffusion Linux vs. Windows appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/articles/stable-diffusion-linux-vs-windows/feed/ 0 Benchmarking with TensorRT-LLM https://www.pugetsystems.com/labs/hpc/benchmarking-with-tensorrt-llm/ https://www.pugetsystems.com/labs/hpc/benchmarking-with-tensorrt-llm/#respond Fri, 16 Feb 2024 18:06:51 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=23187 Evaluating the speed of GeForce RTX 40-Series GPUs using NVIDIA's TensorRT-LLM tool for benchmarking GPU inference performance.

The post Benchmarking with TensorRT-LLM appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/benchmarking-with-tensorrt-llm/feed/ 0 Experiences with Multi-GPU Stable Diffusion Training https://www.pugetsystems.com/labs/hpc/multi-gpu-sd-training/ https://www.pugetsystems.com/labs/hpc/multi-gpu-sd-training/#respond Mon, 29 Jan 2024 23:22:19 +0000 https://www.pugetsystems.com/?post_type=hpc_post&p=22714 Results and thoughts with regard to testing a variety of Stable Diffusion training methods using multiple GPUs.

The post Experiences with Multi-GPU Stable Diffusion Training appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/hpc/multi-gpu-sd-training/feed/ 0 Stable Diffusion LoRA Training – Consumer GPU Analysis https://www.pugetsystems.com/labs/articles/stable-diffusion-lora-training-consumer-gpu-analysis/ https://www.pugetsystems.com/labs/articles/stable-diffusion-lora-training-consumer-gpu-analysis/#respond Wed, 20 Dec 2023 15:00:00 +0000 https://www.pugetsystems.com/?post_type=article&p=21971 How does performance compare across a variety of consumer-grade GPUs in regard to SDXL LoRA training?

The post Stable Diffusion LoRA Training – Consumer GPU Analysis appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/articles/stable-diffusion-lora-training-consumer-gpu-analysis/feed/ 0 Stable Diffusion LoRA Training – Professional GPU Analysis https://www.pugetsystems.com/labs/articles/stable-diffusion-lora-training-professional-gpu-analysis/ https://www.pugetsystems.com/labs/articles/stable-diffusion-lora-training-professional-gpu-analysis/#respond Tue, 12 Dec 2023 21:30:11 +0000 https://www.pugetsystems.com/?post_type=article&p=21738 How does performance compare across a variety of professional-grade GPUs in regard to SDXL LoRA training?

The post Stable Diffusion LoRA Training – Professional GPU Analysis appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/articles/stable-diffusion-lora-training-professional-gpu-analysis/feed/ 0 AI/ML Vocabulary Glossary https://www.pugetsystems.com/labs/articles/ai-ml-vocabulary-glossary/ https://www.pugetsystems.com/labs/articles/ai-ml-vocabulary-glossary/#respond Wed, 08 Nov 2023 18:34:46 +0000 https://www.pugetsystems.com/?post_type=article&p=19920 AI and Machine Learning have a large number of technical terms that can be confusing to those new to this space. This glossary features easy to understand definitions for a variety of terms related to AI and machine learning.

The post AI/ML Vocabulary Glossary appeared first on Puget Systems.

]]> https://www.pugetsystems.com/labs/articles/ai-ml-vocabulary-glossary/feed/ 0 [Updated] Watchdog DPC Violation Error with Multiple NVIDIA GPUs https://www.pugetsystems.com/support/guides/updated-watchdog-dpc/ Tue, 25 Apr 2023 18:02:17 +0000 https://www.pugetsystems.com/?post_type=support_article&p=14490 In this article, we discuss an issue we have been seeing with triple or quad NVIDIA GPU configurations. When running a GPU and CPU heavy workload, it will cause the system to crash and give the DPC_WATCHDOG_VIOLATION error or "blue screen of death". We have outlined a work around we have found to resolve this issue.

The post [Updated] Watchdog DPC Violation Error with Multiple NVIDIA GPUs appeared first on Puget Systems.

]]>