Repository navigation
Commit eddd8e8
committed
fix(openai): keep n>1 stream choices separate in recorded output
_extract_streamed_openai_response used a single accumulator for every
choice in a chat completion stream, so an n>1 stream with interleaved
choices merged content and tool-call arguments from separate choices
into one corrupted output.
Accumulate per choice index and return one response per choice when
the stream carries multiple choices; single-choice streams keep the
existing output shape.1 parent 19490f1 commit eddd8e8
2 files changed
Lines changed: 135 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
760 | 760 | | |
761 | 761 | | |
762 | 762 | | |
763 | | - | |
| 763 | + | |
| 764 | + | |
| 765 | + | |
| 766 | + | |
| 767 | + | |
764 | 768 | | |
765 | 769 | | |
766 | 770 | | |
| |||
778 | 782 | | |
779 | 783 | | |
780 | 784 | | |
| 785 | + | |
| 786 | + | |
| 787 | + | |
| 788 | + | |
| 789 | + | |
781 | 790 | | |
| 791 | + | |
| 792 | + | |
| 793 | + | |
782 | 794 | | |
783 | 795 | | |
784 | 796 | | |
| |||
868 | 880 | | |
869 | 881 | | |
870 | 882 | | |
871 | | - | |
| 883 | + | |
| 884 | + | |
| 885 | + | |
872 | 886 | | |
873 | | - | |
| 887 | + | |
874 | 888 | | |
875 | 889 | | |
876 | 890 | | |
| |||
897 | 911 | | |
898 | 912 | | |
899 | 913 | | |
| 914 | + | |
| 915 | + | |
| 916 | + | |
| 917 | + | |
| 918 | + | |
| 919 | + | |
| 920 | + | |
| 921 | + | |
| 922 | + | |
| 923 | + | |
| 924 | + | |
| 925 | + | |
| 926 | + | |
| 927 | + | |
| 928 | + | |
| 929 | + | |
| 930 | + | |
900 | 931 | | |
901 | 932 | | |
902 | | - | |
| 933 | + | |
903 | 934 | | |
904 | 935 | | |
905 | 936 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
251 | 251 | | |
252 | 252 | | |
253 | 253 | | |
| 254 | + | |
| 255 | + | |
| 256 | + | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
| 265 | + | |
| 266 | + | |
| 267 | + | |
| 268 | + | |
| 269 | + | |
| 270 | + | |
| 271 | + | |
| 272 | + | |
| 273 | + | |
| 274 | + | |
| 275 | + | |
| 276 | + | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
| 281 | + | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
254 | 303 | | |
255 | 304 | | |
256 | 305 | | |
| |||
401 | 450 | | |
402 | 451 | | |
403 | 452 | | |
| 453 | + | |
| 454 | + | |
| 455 | + | |
| 456 | + | |
| 457 | + | |
| 458 | + | |
| 459 | + | |
| 460 | + | |
| 461 | + | |
| 462 | + | |
| 463 | + | |
| 464 | + | |
| 465 | + | |
| 466 | + | |
| 467 | + | |
| 468 | + | |
| 469 | + | |
| 470 | + | |
| 471 | + | |
| 472 | + | |
| 473 | + | |
| 474 | + | |
| 475 | + | |
| 476 | + | |
| 477 | + | |
| 478 | + | |
| 479 | + | |
| 480 | + | |
| 481 | + | |
| 482 | + | |
| 483 | + | |
| 484 | + | |
| 485 | + | |
| 486 | + | |
| 487 | + | |
| 488 | + | |
| 489 | + | |
| 490 | + | |
| 491 | + | |
| 492 | + | |
| 493 | + | |
| 494 | + | |
| 495 | + | |
| 496 | + | |
| 497 | + | |
| 498 | + | |
| 499 | + | |
| 500 | + | |
| 501 | + | |
| 502 | + | |
| 503 | + | |
404 | 504 | | |
405 | 505 | | |
406 | 506 | | |
| |||
0 commit comments