Skip to content

Commit 8453939

Browse files
Refactor Tensor slicing and unsqueeze for speed, improve generation config serialization, new Tensor methods - sum and maximum, improve whisper
1 parent 63c9348 commit 8453939

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

src/PretrainedTokenizers/PretrainedTokenizer.php

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -539,6 +539,7 @@ public function batchDecode(array $batch, bool $skipSpecialTokens = false, ?bool
539539
public function decode(array $tokenIds, bool $skipSpecialTokens = false, ?bool $cleanUpTokenizationSpaces = null): string
540540
{
541541
if (empty($tokenIds) || !is_int($tokenIds[0])) {
542+
dd($tokenIds);
542543
throw new Exception("token_ids must be a non-empty array of integers.");
543544
}
544545

0 commit comments

Comments
 (0)