Discussions

• 13 You must be logged in to vote

  📊

  [v0.16.0] Qwen3 30B A3B Q40 on 4 x Raspberry Pi 5 8GB

  b4rtaz started Sep 5, 2025 in Results

  

  

  0
• 27 You must be logged in to vote

  📊

  [v0.12.2] Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5 8GB

  b4rtaz started Feb 15, 2025 in Results

  

  

  

  

  7
• 1 You must be logged in to vote

  📊

  chatgpt made me some install scripts im just sharing

  rportojr started Sep 3, 2025 in Results

  

  

  1
• 1 You must be logged in to vote

  📊

  [Root] Ryzen 3600, [Worker1] Ryzen 3600, [Network] 1 Gigabit

  DifferentialityDevelopment started May 8, 2024 in Results

  

  

  

  

  25
• 3 You must be logged in to vote

  📊

  [v0.11.1] 4x Mac Mini M4 Pro 24GB RAM

  b4rtaz started Jan 8, 2025 in Results

  

  

  

  

  2
• 1 You must be logged in to vote

  📊

  Does this dllama work in kubernetes environment?

  phucly01 started May 26, 2025 in Results

  

  

  2
• 2 You must be logged in to vote

  📊

  [v0.12.3] Llama 3.2 3B Q40 on 4 x Raspberry Pi 5 8GB

  b4rtaz started Feb 15, 2025 in Results

  

  

  2
• 2 You must be logged in to vote

  📊

  [v0.12.6] 4 x NVIDIA RTX 3060 12 GB

  b4rtaz started Apr 26, 2025 in Results

  

  

  1
• 1 You must be logged in to vote

  📊

  [v0.12.5] Vulkan 2 x NVIDIA GeForce RTX 4090 24 GB

  b4rtaz started Apr 19, 2025 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  [v0.13.5] Vulkan 2 x GeForce RTX 3090 24 GB

  b4rtaz started Apr 19, 2025 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  [v0.12.3] Vulkan 2 x GeForce RTX 3090 24 GB

  b4rtaz started Apr 9, 2025 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  Distributed Inference Test with 8x Qualcomm Snapdragon 8 Gen 2 Nodes

  alphadance started Mar 4, 2025 in Results

  

  

  2
• 3 You must be logged in to vote

  📊

  4x VM c3d-highcpu-30 (30 vCPU, 15 core, 59 GB memory) [Llama 2 7B/13B/70B]

  b4rtaz started Jan 28, 2024 in Results

  

  

  1
• 3 You must be logged in to vote

  📊

  [v0.12.3] Llama 3.2 1B Q40 on 4 x Raspberry Pi 5 8GB

  b4rtaz started Feb 15, 2025 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  [v0.11.1] 4x Ultimate Mac Mini M4 Pro 64GB RAM

  b4rtaz started Jan 16, 2025 in Results

  

  

  0
• 3 You must be logged in to vote

  📊

  [v0.10.4] 4 x Raspberry Pi 5 8GB + TP-Link LS1008G Switch [Llama 3.2 1B Instruct Q40]

  b4rtaz started Oct 13, 2024 in Results

  

  

  0
• 2 You must be logged in to vote

  📊

  4 x Raspberry Pi 5 8GB + TP-Link LS1008G Switch [Llama 3.2 3B Instruct Q40]

  b4rtaz started Oct 13, 2024 in Results

  

  

  0
• 3 You must be logged in to vote

  📊

  Llama 3.2 1B Instruct Q40 Benchmarks, 8 x Raspberry Pi 4B 8GB

  githuba9f5404 started Sep 26, 2024 in Results

  

  

  0
• 2 You must be logged in to vote

  📊

  Llama 3.2 3B Instruct Q40 Benchmarks, 1x, 2x, 4x, 8x Raspberry Pi 4B 8GB

  githuba9f5404 started Sep 26, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  Llama 3.2 1B F32 Benchmarks, 8 x Raspberry Pi 4B 8GB

  githuba9f5404 started Sep 29, 2024 in Results

  

  

  0
• 2 You must be logged in to vote

  📊

  Rasberry Pi 4B 8GB x 8, Netgear GS308EPP PoE 123W

  githuba9f5404 started Sep 25, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  vLLM can do this.

  entrepeneur4lyf started Aug 3, 2024 in Results · Closed

  

  

  1
• 0 You must be logged in to vote

  📊

  1x Raspberry Pi 4B 8 GB + 7x Raspberry Pi 4B 4 GB + Mercusys MS108G Switch [Llama 2 7B/13B and Llama 3 8B]

  EntusiastaIApy started Jul 23, 2024 in Results

  

  

  0
• 1 You must be logged in to vote

  📊

  n2d-highmem-16 + 3 x n2d-highmem-8, Google Cloud [Llama 3.1 405B Q40]

  b4rtaz started Jul 31, 2024 in Results

  

  

  0
• 4 You must be logged in to vote

  📊

  Raspberry Pi 4B 8 GB + TP-Link LS1008G Switch [Llama 2 7B/13B/70B]

  b4rtaz started Jan 21, 2024 in Results

  

  

  2