Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
118 commits
Select commit Hold shift + click to select a range
21df122
This PR introduces evaluation support designed specifically to track …
chanzhi82020 Aug 25, 2025
69069b8
feat: Add evaluation dataset schemas for collections and data
ctlaltlaltc Aug 22, 2025
3aa78b1
feat: Add API for creating evaluation dataset collections
ctlaltlaltc Aug 22, 2025
64c6dd4
feat: Add update API for evaluation dataset collection
ctlaltlaltc Aug 22, 2025
aa67781
feat: Add endpoint to list evaluation dataset collections
ctlaltlaltc Aug 23, 2025
3ba4143
feat: Add dataset import and creation endpoints for evaluations
ctlaltlaltc Aug 23, 2025
0b9bc8d
feat: Add dataset quality assessment job handling system
ctlaltlaltc Aug 23, 2025
e2e26bd
feat: Add data quality evaluation job for dataset import
ctlaltlaltc Aug 25, 2025
fd71849
feat: Add API for updating and deleting evaluation datasets
ctlaltlaltc Aug 25, 2025
5be6425
feat: Add teamId and tmbId to evaluation dataset handlers
ctlaltlaltc Aug 26, 2025
a79f6e9
feat: Add evaluation dataset synthesis and smart generation functiona…
ctlaltlaltc Aug 27, 2025
4054cf9
feat: Add APIs for managing evaluation dataset tasks and statuses
ctlaltlaltc Aug 28, 2025
ab8cb72
feat: Add batch quality assessment API endpoint
ctlaltlaltc Aug 28, 2025
bed1c73
feat: Introduce EvalDatasetDataKeyEnum to improve data processing
ctlaltlaltc Aug 28, 2025
7022a6f
feat: Add support for evaluation files and permissions
ctlaltlaltc Sep 1, 2025
9858622
合并分支: feat: Add comprehensive evaluation dataset management system ('…
Sep 2, 2025
b8fd592
feat: Add evaluation task, dataset and dimension management features
Sep 2, 2025
82ebc6e
合并分支: feat: Add evaluation task, dataset and dimension management fea…
Sep 2, 2025
6fb7aa1
[feat]add evaluation plugin: diting
Sep 2, 2025
d3340d4
feat: Add evaluation dimension management functionality, optimize sel…
Sep 2, 2025
17be7ef
[feat] updated some English translations
Sep 2, 2025
a08488e
合并分支: [feat] updated some English translations ('update-some-english-…
Sep 2, 2025
20efb9e
合并分支: feat: Add evaluation dimension management functionality, optimi…
Sep 3, 2025
c503084
合并分支: [feat] add evaluation plugin: diting ('31202-add-diting' 到 'eva…
Sep 3, 2025
69f11d7
feat: Add evaluation dataset file import and intelligent generation f…
Sep 3, 2025
8ac52dc
合并分支: feat: Add evaluation dataset file import and intelligent genera…
Sep 3, 2025
8887e03
feat: implement comprehensive backend evaluation system
chanzhi82020 Aug 22, 2025
52fc42c
合并分支: feat: implement comprehensive backend evaluation system ('refac…
Sep 4, 2025
d80ea8e
feat(evaluation): add evaluation result editing and status management…
Sep 4, 2025
87a6ce5
合并分支: feat(evaluation): add evaluation result editing and status mana…
Sep 4, 2025
485b031
feat: Add auditlog and enhance error handling for evaluation dataset
ctlaltlaltc Sep 2, 2025
53830d0
feat: refactor evaluation module frontend and API services
lavine77 Sep 4, 2025
0db2bbb
合并分支: feat: refactor evaluation module frontend and API services ('14…
Sep 4, 2025
e41593b
[feat]add model timeout and diting project documentation
Sep 3, 2025
186f426
[feat] add evaluation metric management
SuXiangcheng Sep 4, 2025
c583497
合并分支: [feat] add evaluation metric management ('sxc-eval-dev' 到 'eval…
Sep 4, 2025
8c2a1dc
合并分支: [feat] add model timeout and diting project documentation ('312…
Sep 4, 2025
227a07c
合并分支: feat: Add audit logging for evaluation dataset APIs ('eval-data…
Sep 5, 2025
79c67d2
feat(evaluation): Add basic structure and context for the evaluation …
1348697900a Sep 4, 2025
f23e636
合并分支: feat(evaluation): Add basic structure and context for the evalu…
Sep 5, 2025
f03e391
feat: optimize i18n configuration and add manual data entry functiona…
lavine77 Sep 5, 2025
2582864
合并分支: feat: optimize i18n configuration and add manual data entry fun…
Sep 5, 2025
e92e542
feat(dataset): Add enterprise database dataset support
1348697900a Sep 3, 2025
92fcc88
feat: add icon showcase page
lavine77 Sep 5, 2025
8702e22
合并分支: feat: add icon showcase page ('14864/icon-showcase' 到 'eval-dev')
Sep 5, 2025
415313a
合并分支: feat(dataset): Add enterprise database dataset support ('76887/…
Sep 5, 2025
b3e4e07
feat: add eval summary
hellostronger Sep 4, 2025
898fa37
合并分支: feat: add eval summary ('eval_dev_0904' 到 'eval-dev')
Sep 6, 2025
284dc9e
feat: add evaluation authentication
chanzhi82020 Sep 4, 2025
41ce457
[update] add evaluator model validation logic
SuXiangcheng Sep 6, 2025
cac9269
feat(dataset): Enhance database knowledge base functionalities and in…
1348697900a Sep 6, 2025
a9c8198
合并分支: feat: add evaluation authentication ('feat-evaluation-authentic…
Sep 6, 2025
d7aafbf
合并分支: [update] add evaluator model validation logic ('sxc-eval-dev' 到…
Sep 6, 2025
617dfcc
feat: Add evaluation errorcode handling
ctlaltlaltc Sep 5, 2025
4eab669
refactor: Update evaluation item request types and cleanup logic
ctlaltlaltc Sep 5, 2025
aab0614
feat: Add synthesizer functionality for data synthesis
ctlaltlaltc Sep 5, 2025
a54df48
refactor: Update error handling and improve i18n support
ctlaltlaltc Sep 6, 2025
07ddf3d
feat(evaluation): Optimize the functionality and interaction of the e…
1348697900a Sep 6, 2025
966913b
[feat] updated some English translations
Sep 6, 2025
f288268
合并分支: [feat] updated some English translations ('eval-dev-translation…
Sep 6, 2025
157cf7b
合并分支: Add synthesizer functionality for data synthesis ('eval-dataset…
Sep 8, 2025
b1d77c4
合并分支: feat(dataset): Enhance database knowledge base functionalities …
Sep 8, 2025
de2ddad
合并分支: feat(evaluation): Optimize the functionality and interaction of…
Sep 8, 2025
34ea4aa
[add] add detail error message
SuXiangcheng Sep 7, 2025
b260f91
合并分支: [add] add detail error message ('sxc-eval-dev' 到 'eval-dev')
Sep 8, 2025
4095b8a
feat:add auditlog for eval-task
chanzhi82020 Sep 4, 2025
2ad0fac
合并分支: feat:add auditlog for eval-task ('eval-task-add-audit-log' 到 'e…
Sep 8, 2025
a38b95f
feat(evaluation): Optimize evaluation exception handling and database…
1348697900a Sep 8, 2025
88732e0
feat: Add team limits and usage tracking for evaluation system
ctlaltlaltc Sep 8, 2025
aeeb952
合并分支: feat(evaluation): Optimize evaluation exception handling and da…
Sep 9, 2025
ad53d2d
feat: add error code for eval task
chanzhi82020 Sep 8, 2025
6403360
feat: Add evaluation metric limits and fix naming consistency
ctlaltlaltc Sep 9, 2025
4ddd041
合并分支: feat: add error code for eval task ('eval-task-add-error-code' …
Sep 9, 2025
928ad49
feat: Add license-based evaluation limits and data item counts
ctlaltlaltc Sep 9, 2025
2ce92d3
合并分支: feat: Add team limits and usage tracking for evaluation system …
Sep 9, 2025
278b0e6
[feat]add auditlog and error codes
SuXiangcheng Sep 9, 2025
d47b546
合并分支: [feat] add auditlog and error codes ('sxc-eval-dev' 到 'eval-dev')
Sep 9, 2025
eaac555
feat: format code and add bill and add audit log and add eval task de…
hellostronger Sep 9, 2025
d8d8a66
合并分支: feat: format code and add bill and add audit log and add eval t…
Sep 10, 2025
d73c1fb
feat: Add team-level authentication for evaluation file uploads
ctlaltlaltc Sep 9, 2025
e5df591
refactor: Clean up evaluation dataset code and enhance audit logging
ctlaltlaltc Sep 9, 2025
6377d90
合并分支: feat: Add team-level authentication for evaluation file uploads…
Sep 10, 2025
46cff17
feat: Enhance evaluation dataset system with improved model handling
ctlaltlaltc Sep 10, 2025
29bc51f
合并分支: feat: Enhance evaluation dataset system with improved model han…
Sep 11, 2025
20599c8
feat: integrate evaluation dimension features
lavine77 Sep 11, 2025
94a7fbc
合并分支: feat: integrate evaluation dimension features ('14864/dimension…
Sep 11, 2025
c0cac49
[update] Optimize code
SuXiangcheng Sep 11, 2025
cfc27b0
feat: Add status filtering to evaluation dataset data list API
ctlaltlaltc Sep 11, 2025
40a71d0
refactor: Improve evaluation dataset API and data generation
ctlaltlaltc Sep 11, 2025
62d5ee6
合并分支: refactor: Improve evaluation dataset API and data generation ('…
Sep 11, 2025
3f3fa3d
合并分支: [update] Optimize code ('sxc-eval-dev' 到 'eval-dev')
Sep 11, 2025
606af19
feat: add task.dataItem layer API, and optimise the code standards fo…
chanzhi82020 Sep 9, 2025
8443d86
feat: add summary error code and test case
hellostronger Sep 10, 2025
501be3a
合并分支: feat: add task.dataItem layer API, and optimise the code standa…
Sep 11, 2025
b5ba47e
合并分支: feat: add summary error code and test case ('aipaas_bjq_0910' 到…
Sep 12, 2025
c00d57b
refactor: complete data quality status
ctlaltlaltc Sep 11, 2025
78f2b80
feat: Add evaluation dataset data detail and enhance dataset listing
ctlaltlaltc Sep 11, 2025
454bde8
合并分支: feat: Add evaluation dataset data detail and enhance dataset li…
Sep 12, 2025
c2d2f02
feat: refactor expected answer annotation modal
lavine77 Sep 12, 2025
afe3ef0
合并分支: feat: refactor expected answer annotation modal ('14864/files-c…
Sep 12, 2025
05b557c
feat(evaluation): Implement complete functionality for evaluation dat…
1348697900a Sep 10, 2025
73701ab
合并分支: feat(evaluation): Implement complete functionality for evaluati…
Sep 12, 2025
4efa95b
refactor: optimization param validation of eval-task
chanzhi82020 Sep 12, 2025
25dba2b
合并分支: refactor: optimization param validation of eval-task ('eval-tas…
Sep 12, 2025
5c6a710
feat: add evaluation model configuration options
lavine77 Sep 12, 2025
baf6de3
feat: adjust test run result score display to full score of 100 format
lavine77 Sep 12, 2025
7572ace
feat: enhance task creation and management
lavine77 Sep 12, 2025
e64cd64
feat: add summary error code and test case
hellostronger Sep 10, 2025
e753f9f
refactor: evaluation error handling and validation system
ctlaltlaltc Sep 12, 2025
7087c90
合并分支: refactor: Standardize evaluation error handling and validation …
Sep 13, 2025
1aeff3a
合并分支: feat: enhance task creation and management ('14864/tasks-manage…
Sep 13, 2025
106fab8
合并分支: feat: add evaluation model configuration options ('14864/sys-mo…
Sep 13, 2025
8e96300
合并分支: feat: adjust test run result score display to full score of 100…
Sep 13, 2025
b08a9d1
feat(evaluation): Enhance the dataset file import feature
1348697900a Sep 12, 2025
430aa62
合并分支: feat(evaluation): Enhance the dataset file import feature ('768…
Sep 13, 2025
7301199
feat: add collection detail API and refactor shared utilities
ctlaltlaltc Sep 13, 2025
2f3365a
合并分支: feat: add collection detail API and refactor shared utilities (…
Sep 13, 2025
28d1771
[feat]:new dataset type database in order to compatitable with Text2sql
lfkg Sep 11, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -37,4 +37,4 @@ files/helm/fastgpt/charts/*.tgz

tmp/
coverage
document/.source
document/.source
20 changes: 20 additions & 0 deletions deploy/docker/docker-compose-milvus.yml
Original file line number Diff line number Diff line change
Expand Up @@ -185,6 +185,8 @@ services:
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# AI Proxy 的 Admin Token,与 AI Proxy 中的环境变量 ADMIN_KEY
- AIPROXY_API_TOKEN=aiproxy
# diting 地址
- DITING_BASE_URL=http://diting:3000

# 数据库最大连接数
- DB_MAX_LINK=30
Expand Down Expand Up @@ -298,5 +300,23 @@ services:
interval: 5s
timeout: 5s
retries: 10

# diting
diting:
image: ghcr.io/labring/diting:v0.1.0
container_name: diting
restart: unless-stopped
networks:
- fastgpt
environment:
# 对应fastgpt中的aiproxy的AIPROXY_API_ENDPOINT
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# 对应fastgpt中的aiproxy的AIPROXY_API_TOKEN
- AIPROXY_API_TOKEN=aiproxy
healthcheck:
test: ['CMD', 'curl', '-f', 'http://localhost:3000/api/v1/healthz']
interval: 5s
timeout: 5s
retries: 10
networks:
fastgpt:
20 changes: 20 additions & 0 deletions deploy/docker/docker-compose-oceanbase/docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -160,6 +160,8 @@ services:
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# AI Proxy 的 Admin Token,与 AI Proxy 中的环境变量 ADMIN_KEY
- AIPROXY_API_TOKEN=aiproxy
# diting 地址
- DITING_BASE_URL=http://diting:3000

# 数据库最大连接数
- DB_MAX_LINK=30
Expand Down Expand Up @@ -272,5 +274,23 @@ services:
interval: 5s
timeout: 5s
retries: 10

# diting
diting:
image: ghcr.io/labring/diting:v0.1.0
container_name: diting
restart: unless-stopped
networks:
- fastgpt
environment:
# 对应fastgpt中的aiproxy的AIPROXY_API_ENDPOINT
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# 对应fastgpt中的aiproxy的AIPROXY_API_TOKEN
- AIPROXY_API_TOKEN=aiproxy
healthcheck:
test: ['CMD', 'curl', '-f', 'http://localhost:3000/api/v1/healthz']
interval: 5s
timeout: 5s
retries: 10
networks:
fastgpt:
20 changes: 20 additions & 0 deletions deploy/docker/docker-compose-pgvector.yml
Original file line number Diff line number Diff line change
Expand Up @@ -146,6 +146,8 @@ services:
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# AI Proxy 的 Admin Token,与 AI Proxy 中的环境变量 ADMIN_KEY
- AIPROXY_API_TOKEN=aiproxy
# diting 地址
- DITING_BASE_URL=http://diting:3000

# 数据库最大连接数
- DB_MAX_LINK=30
Expand Down Expand Up @@ -258,5 +260,23 @@ services:
interval: 5s
timeout: 5s
retries: 10

# diting
diting:
image: ghcr.io/labring/diting:v0.1.0
container_name: diting
restart: unless-stopped
networks:
- fastgpt
environment:
# 对应fastgpt中的aiproxy的AIPROXY_API_ENDPOINT
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# 对应fastgpt中的aiproxy的AIPROXY_API_TOKEN
- AIPROXY_API_TOKEN=aiproxy
healthcheck:
test: ['CMD', 'curl', '-f', 'http://localhost:3000/api/v1/healthz']
interval: 5s
timeout: 5s
retries: 10
networks:
fastgpt:
20 changes: 20 additions & 0 deletions deploy/docker/docker-compose-zilliz.yml
Original file line number Diff line number Diff line change
Expand Up @@ -126,6 +126,8 @@ services:
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# AI Proxy 的 Admin Token,与 AI Proxy 中的环境变量 ADMIN_KEY
- AIPROXY_API_TOKEN=aiproxy
# diting 地址
- DITING_BASE_URL=http://diting:3000

# 数据库最大连接数
- DB_MAX_LINK=30
Expand Down Expand Up @@ -240,5 +242,23 @@ services:
interval: 5s
timeout: 5s
retries: 10

# diting
diting:
image: ghcr.io/labring/diting:v0.1.0
container_name: diting
restart: unless-stopped
networks:
- fastgpt
environment:
# 对应fastgpt中的aiproxy的AIPROXY_API_ENDPOINT
- AIPROXY_API_ENDPOINT=http://aiproxy:3000
# 对应fastgpt中的aiproxy的AIPROXY_API_TOKEN
- AIPROXY_API_TOKEN=aiproxy
healthcheck:
test: ['CMD', 'curl', '-f', 'http://localhost:3000/api/v1/healthz']
interval: 5s
timeout: 5s
retries: 10
networks:
fastgpt:
164 changes: 164 additions & 0 deletions packages/global/common/error/code/database.ts
Original file line number Diff line number Diff line change
@@ -0,0 +1,164 @@
import { type ErrType } from '../errorCode';

/* database: 509000 */
export enum DatabaseErrEnum {
// 知识库相关
datasetParamsError = 'datasetParamsError',
// 客户端创建和管理错误
clientCreateError = 'databaseClientCreateError',
clientUpdateError = 'databaseClientUpdateError',
clientDestroyError = 'databaseClientDestroyError',
clientAlreadyExists = 'databaseClientAlreadyExists',
clientNotFound = 'databaseClientNotFound',

// 连接相关错误
authError = 'databaseAuthError',
nameError = 'databaseNameError',
addressError = 'databaseAddressError',
checkError = 'databaseCheckError',
connectionFailed = 'databaseConnectionFailed',
connectionTimeout = 'databaseConnectionTimeout',

// 数据库类型和支持错误
notSupportType = 'databaseNotSupportType',
notImplemented = 'databaseNotImplemented',

// API 请求和验证错误
requestValidationError = 'databaseRequestValidationError',
invalidTableName = 'databaseInvalidTableName',
fetchInfoError = 'databaseFetchInfoError',
invalidConfig = 'databaseInvalidConfig',

// 查询和操作错误
queryExecutionError = 'databaseQueryExecutionError',
tableNotFound = 'databaseTableNotFound',
columnNotFound = 'databaseColumnNotFound',
syntaxError = 'databaseSyntaxError',

// Schema相关错误
schemaIntrospectionError = 'databaseSchemaIntrospectionError',
metadataError = 'databaseMetadataError'
}

const databaseErr = [

{
statusText: DatabaseErrEnum.datasetParamsError,
message: 'core.database.error.not_support_dataset_type'
},
// 客户端管理错误
{
statusText: DatabaseErrEnum.clientCreateError,
message: 'core.database.error.client_create_failed'
},
{
statusText: DatabaseErrEnum.clientUpdateError,
message: 'core.database.error.client_update_failed'
},
{
statusText: DatabaseErrEnum.clientDestroyError,
message: 'core.database.error.client_destroy_failed'
},
{
statusText: DatabaseErrEnum.clientAlreadyExists,
message: 'core.database.error.client_already_exists'
},
{
statusText: DatabaseErrEnum.clientNotFound,
message: 'core.database.error.client_not_found'
},

// 连接错误
{
statusText: DatabaseErrEnum.authError,
message: 'core.database.error.auth_failed'
},
{
statusText: DatabaseErrEnum.nameError,
message: 'core.database.error.database_not_found'
},
{
statusText: DatabaseErrEnum.addressError,
message: 'core.database.error.connection_address_failed'
},
{
statusText: DatabaseErrEnum.checkError,
message: 'core.database.error.connection_check_failed'
},
{
statusText: DatabaseErrEnum.connectionFailed,
message: 'core.database.error.connection_failed'
},
{
statusText: DatabaseErrEnum.connectionTimeout,
message: 'core.database.error.connection_timeout'
},

// 类型支持错误
{
statusText: DatabaseErrEnum.notSupportType,
message: 'core.database.error.database_type_not_supported'
},
{
statusText: DatabaseErrEnum.notImplemented,
message: 'core.database.error.feature_not_implemented'
},

// 请求验证错误
{
statusText: DatabaseErrEnum.requestValidationError,
message: 'core.database.error.request_validation_failed'
},
{
statusText: DatabaseErrEnum.invalidTableName,
message: 'core.database.error.invalid_table_name'
},
{
statusText: DatabaseErrEnum.fetchInfoError,
message: 'core.database.error.fetch_info_failed'
},
{
statusText: DatabaseErrEnum.invalidConfig,
message: 'core.database.error.invalid_config'
},

// 查询操作错误
{
statusText: DatabaseErrEnum.queryExecutionError,
message: 'core.database.error.query_execution_failed'
},
{
statusText: DatabaseErrEnum.tableNotFound,
message: 'core.database.error.table_not_found'
},
{
statusText: DatabaseErrEnum.columnNotFound,
message: 'core.database.error.column_not_found'
},
{
statusText: DatabaseErrEnum.syntaxError,
message: 'core.database.error.sql_syntax_error'
},

// Schema错误
{
statusText: DatabaseErrEnum.schemaIntrospectionError,
message: 'core.database.error.schema_introspection_failed'
},
{
statusText: DatabaseErrEnum.metadataError,
message: 'core.database.error.metadata_error'
}
];

export default databaseErr.reduce((acc, cur, index) => {
return {
...acc,
[cur.statusText]: {
code: 509000 + index,
statusText: cur.statusText,
message: cur.message,
data: null
}
};
}, {} as ErrType<`${DatabaseErrEnum}`>);
Loading
Loading