Skip to content

🔧 Use ObjectPools for chat request/response schemas #262

@roma-glushko

Description

@roma-glushko

Use ObjectPools to optimize memory allocation of

  • chat request/response schema allocations
  • chat stream chunk schema allocations

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions