xming521 27d877aad3 refactor(infer): improve guided decoding error handling in online inference ...

- Replaced the previous parsing logic with enhanced error handling for JSON extraction from LLM outputs.
- Introduced detailed logging for failed requests and unexpected result types, improving traceability of issues during inference.
- Updated the import statement to reflect the new utility function for JSON extraction.

2026-01-04 18:07:37 +08:00

..

inference

refactor(infer): improve guided decoding error handling in online inference

2026-01-04 18:07:37 +08:00

PII

feat(cleaning): add batch processing for online LLM

2025-08-28 21:30:05 +08:00