same model dynamic selection and QoS scoring #18
Description
若同一个模型存在多个Provider时，需要支持动态选择Provider，而非只选择第一个；后续还需要考虑服务污点、异常自动切换、服务质量评分和重试等情况。
When multiple Providers exist for the same model, it is necessary to support dynamic selection of Providers, rather than just selecting the first one. Additionally, considerations such as service taint, automatic failover in case of exceptions, service quality scoring, and retries need to be taken into account subsequently.