BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.3 LTS (Noble Numbat)
AMD EPYC 7763 2.45GHz, 1 CPU, 4 logical and 2 physical cores
.NET SDK 10.0.201
[Host] : .NET 10.0.5 (10.0.5, 10.0.526.15411), X64 RyuJIT x86-64-v3
ShortRun : .NET 10.0.5 (10.0.5, 10.0.526.15411), X64 RyuJIT x86-64-v3
Job=ShortRun IterationCount=3 LaunchCount=1
WarmupCount=3
| Method | ModelSpecifier | Mean | Error | StdDev | Gen0 | Gen1 | Gen2 | Allocated |
|---|
| 'SpecFlow: Generate a response for a prompt' | bitnet-b1.58-sharp | 82.86 ms | 8.540 ms | 0.468 ms | 4000.0000 | 4000.0000 | 4000.0000 | 20.57 MB |
| 'SpecFlow: Generate a response for a prompt' | traditional-local | 104.71 ms | 14.142 ms | 0.775 ms | - | - | - | 1.82 MB |