Skip to content

Commit 30e3dea

Browse files
rbrugaropre-commit-ci[bot]ashahba
authored
[bugfix] docsum error by HuggingFaceEndpoint (#1246)
* Fix bug iin HuggingFaceEndpoint usage 1. Upgrade langchain hugginface from community to partner (community deprecated) Added task=text-generation argument to fix error with tgi_endpoint Signed-off-by: rbrugaro <rita.brugarolas.brufau@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: rbrugaro <rita.brugarolas.brufau@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
1 parent 17306d1 commit 30e3dea

File tree

1 file changed

+2
-1
lines changed
  • comps/llms/src/doc-summarization/integrations

1 file changed

+2
-1
lines changed

comps/llms/src/doc-summarization/integrations/tgi.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44
import os
55

66
import requests
7-
from langchain_community.llms import HuggingFaceEndpoint
7+
from langchain_huggingface import HuggingFaceEndpoint
88

99
from comps import CustomLogger, GeneratedDoc, OpeaComponent, OpeaComponentRegistry, ServiceType
1010
from comps.cores.proto.api_protocol import DocSumChatCompletionRequest
@@ -71,6 +71,7 @@ async def invoke(self, input: DocSumChatCompletionRequest):
7171
repetition_penalty=input.repetition_penalty if input.repetition_penalty else 1.03,
7272
streaming=input.stream,
7373
server_kwargs=server_kwargs,
74+
task="text-generation",
7475
)
7576
result = await self.generate(input, self.client)
7677

0 commit comments

Comments
 (0)