🔍 Batch Invariance Test Results
Status Column Legend
- Batch 1 Within: Are all outputs within batch 1 identical to each other?
- Batch 2 Within: Are all outputs within batch 2 identical to each other?
- Between Batches: Is the first output from batch 1 identical to the first output from batch 2?
| Backend |
Prompt # |
Prompt Preview |
Batch Sizes |
Batch 1 Within |
Batch 2 Within |
Between Batches |
Action |
| FLASH_ATTN |
0 |
Are LLM systems cool? |
2 vs 16 |
✓ Same
|
✗ Diff
|
✓ Same
|
View Diff |
| FLASH_ATTN |
0 |
Are LLM systems cool? |
2 vs 17 |
✓ Same
|
✗ Diff
|
✓ Same
|
View Diff |
| FLASH_ATTN |
0 |
Are LLM systems cool? |
16 vs 17 |
✗ Diff
|
✗ Diff
|
✓ Same
|
View Diff |