BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763 2.45GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 10.0.201
[Host] : .NET 10.0.5 (10.0.5, 10.0.526.15411), X64 RyuJIT x86-64-v3
ShortRun : .NET 10.0.5 (10.0.5, 10.0.526.15411), X64 RyuJIT x86-64-v3
Job=ShortRun IterationCount=3 LaunchCount=1
WarmupCount=3
| Method | ModelSpecifier | Mean | Error | StdDev | Gen0 | Gen1 | Gen2 | Allocated |
|---|
| 'SpecFlow: Stream a response for a prompt' | bitnet-b1.58-sharp | 82.92 ms | 7.373 ms | 0.404 ms | 4000.0000 | 4000.0000 | 4000.0000 | 20.58 MB |
| 'SpecFlow: Stream a response for a prompt' | traditional-local | 110.32 ms | 21.069 ms | 1.155 ms | - | - | - | 1.83 MB |