Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
730 commits
Select commit Hold shift + click to select a range
03540ea
Merge pull request #4996 from WeDataSphere/master-ec-conf
casionone Nov 29, 2023
2347ae8
Fix flink-1.16 ClassNotFoundException bug (#5001)
ChengJie1053 Nov 29, 2023
ba773ff
Update ExceptionManagerTest.java (#5005)
yijut2 Nov 30, 2023
60aa1c9
Support nacos discovery (#5008)
wForget Dec 1, 2023
7704ed1
Optimize JDBC connection support cache by task id
peacewong Nov 29, 2023
d27a520
optimize code override toString method
peacewong Nov 29, 2023
59fb3ad
add source bash profile step
peacewong Nov 30, 2023
9fd1265
Fix datasource build assembly bug
peacewong Nov 30, 2023
484afad
add close issue step
peacewong Nov 30, 2023
33f9159
Fix datasource build assembly bug
peacewong Nov 30, 2023
4c17598
upd env conf file version (#5009)
mayinrain Dec 4, 2023
b689f88
[Bug] Fixed the problem that local Debug could not read the applicati…
peacewong Dec 6, 2023
2097920
Bump vite from 4.4.9 to 4.4.12 in /linkis-web-next (#5021)
dependabot[bot] Dec 7, 2023
2f9f9bb
flink load default configuration (#5025)
yangwenzea Dec 8, 2023
d16f6a3
[Feature][1.5.0] Load user-defined log4j.properties (#5023)
yangwenzea Dec 8, 2023
f26cf2a
Bump org.apache.avro:avro in /linkis-engineconn-plugins/sqoop (#5026)
dependabot[bot] Dec 8, 2023
87c40ec
sql field comment semicolon with escape (#4967)
sjgllgh Dec 11, 2023
d4dc8af
Fix nebula query bug (#5029)
ChengJie1053 Dec 11, 2023
08cbcfc
remove unnecessary log print
peacewong Dec 13, 2023
7766933
Fix repl get task result bug (#5036)
ChengJie1053 Dec 13, 2023
f811794
Merge pull request #5037 from WeDataSphere/master-remove-log
ChengJie1053 Dec 13, 2023
14e118a
Fix flink sql kill yarn application and getJobStatus fail (#5041)
ChengJie1053 Dec 14, 2023
b127dfa
[Bug] Fix user conf resource are not being applied (#5045)
peacewong Dec 17, 2023
a452a1e
Fix missing antlr-runtime dependency of hive engine when using nacos …
wForget Dec 17, 2023
709e594
[LINKIS-5043] Only start the eureka service if DISCOVERY is EUREKA (#…
wForget Dec 17, 2023
adb7f8e
upgrade linkis version to 1.5.0 (#5049)
GuoPhilipse Dec 19, 2023
3b01532
When reading data using JDBC, add support for the smallint and tinyin…
sjgllgh Dec 23, 2023
292cd90
[Feature] Add doris engine to linkis (#5053)
ChengJie1053 Dec 26, 2023
9823130
Spark etl supports doris (#5058)
ChengJie1053 Dec 29, 2023
52bf1e1
Fix doris databases sql password could be empty (#5059)
ChengJie1053 Dec 29, 2023
59e526d
Doris ec supports dataSources (#5060)
ChengJie1053 Dec 29, 2023
be7b820
fix: To avoid converting null to "null", skip null passwords (#5057)
chenmutime Dec 29, 2023
6736fed
Flink supports udf function (#5067)
ChengJie1053 Jan 12, 2024
e79b59d
fix the HBase command reports an error, but the client returns succes…
sjgllgh Jan 16, 2024
bf1df9f
Fix a series of problems in the s3 file system (#5072)
sjgllgh Jan 17, 2024
cdf80e1
Bump follow-redirects from 1.15.3 to 1.15.4 in /linkis-web-next (#5066)
dependabot[bot] Jan 17, 2024
20c2654
Support for storage resultSet in Parquet and Orc format (#5024)
ChengJie1053 Jan 24, 2024
3718d9e
#5080 Fix the setting ENABLE_HDFS=false, need 'hdfs' cmd
gujincheng Feb 1, 2024
a3b6efd
Bump vite from 4.4.12 to 4.5.2 in /linkis-web-next (#5076)
dependabot[bot] Feb 18, 2024
0c186f9
fix cancelled task still executed (#5074)
sjgllgh Feb 22, 2024
8b06144
Bump org.apache.solr:solr-solrj (#5091)
dependabot[bot] Mar 13, 2024
c8f9537
[FEATURE] add kanban in linkisweb (#5089)
sjgllgh Mar 13, 2024
f876a73
Spring cloud version upgraded, loadBalancer replaced ribbon (#4958)
ChengJie1053 Mar 15, 2024
ce7cf5f
FIx: check hive server status (#5097)
chenshuai1995 Mar 20, 2024
7d3970c
improve: universal the version of spark example jar (#5095)
chenshuai1995 Mar 20, 2024
7ec5ca7
add run_last_mon variable
peacewong Mar 19, 2024
ae2e352
For FS opened with public tenants, we should not perform close action
peacewong Mar 19, 2024
88eb05d
Fix duplicate try login
peacewong Mar 19, 2024
3413ce0
add default version
peacewong Mar 19, 2024
3c8f2ad
add connection pool keepalive feature
peacewong Mar 19, 2024
b61c982
add logs
peacewong Mar 19, 2024
dd782c7
Relieve memory usage
peacewong Mar 19, 2024
67bd9bf
remove akka LICENSE
peacewong Mar 20, 2024
0029e6b
Fix unit test issue
peacewong Mar 20, 2024
300e2d0
Dependencs need to reserve akka
peacewong Mar 20, 2024
1562124
Fix the eureka could not start (#5104)
ChengJie1053 Mar 22, 2024
562572a
Fix the spark could not start (#5105)
ChengJie1053 Mar 22, 2024
436195c
upgrade commons-compress and poi (#5110)
pjfanning Mar 27, 2024
23eaffd
Bump vite from 4.5.2 to 4.5.3 in /linkis-web-next (#5114)
dependabot[bot] Apr 8, 2024
d811d03
Bump org.postgresql:postgresql from 42.3.8 to 42.3.9 (#5112)
dependabot[bot] Apr 8, 2024
43cb5b2
The interface of basic data management should be judged by the admini…
peacewong May 14, 2024
8f2b674
[Feature][1.5.0] Linkis orchestrator module supports plugin configura…
yuechao24 May 21, 2024
f6617d0
refactor: data clumps (#5119)
compf May 24, 2024
15ce8f9
Linkis Clent Feature optimization, adding FSClient and enriching Link…
peacewong Jun 6, 2024
63e06aa
Engine support marking as unhealthy to exit gracefully
peacewong Jun 7, 2024
e5add91
Current Engine supports automatic exit
peacewong Jun 7, 2024
434e14b
Fix engine exit hang bug
peacewong Jun 7, 2024
787eb47
add ec HookExecuteException
peacewong Jun 7, 2024
fa1328b
add across cluster and department conf
peacewong Jun 7, 2024
988069a
optimize Configuration module
peacewong Jun 7, 2024
36f7258
shutdown hook optimize
peacewong Jun 7, 2024
23355f9
ec support add extra classpath
peacewong Jun 7, 2024
6b1a822
Fix log loss issue
peacewong Jun 7, 2024
24092c0
The result set path is changed to a unified path
peacewong Jun 7, 2024
edad487
log optimize
peacewong Jun 7, 2024
d7afbdd
Entrance memory usage optimization
peacewong Jun 7, 2024
49cd11e
HDFS kerberos support refresh ticket
peacewong Jun 7, 2024
c2c78a9
Http client support ssl
peacewong Jun 7, 2024
aa039a4
jdbc support url default db
peacewong Jun 7, 2024
198860c
add task label
peacewong Jun 7, 2024
a983634
add module utils
peacewong Jun 7, 2024
8460137
job support clear and log optimize
peacewong Jun 7, 2024
8389e40
jdbc driver support url default db
peacewong Jun 7, 2024
5831a19
Fix build issue
peacewong Jun 10, 2024
5cd2de3
Merge pull request #5126 from WeDataSphere/master-1.6.0
casionone Jun 11, 2024
ea159cf
Bump braces from 3.0.2 to 3.0.3 in /linkis-web-next (#5128)
dependabot[bot] Jun 25, 2024
134cf87
Fix Spring Cloud gateway cannot support fixed IP and port forwarding.…
peacewong Jun 25, 2024
cac834d
Merge pull request #5133 from WeDataSphere/master-1.6.0-fix-gateway
casionone Jun 25, 2024
9be69de
Upgrade version to 1.6.0 (#5142)
peacewong Jul 1, 2024
273394f
Remove redundant code (#5144)
guoshupei Jul 14, 2024
82c2f4b
[MINOR] add util for generating random strings (#5143)
pjfanning Jul 14, 2024
cc3a0f6
Dump druid version from 1.2.16 to 1.2.23 (#5146)
wForget Jul 16, 2024
2b55fe6
[LINKIS-5147][EC-JDBC] Add timeout configurations of datasource for j…
wForget Jul 16, 2024
c988fdd
Improve regenerate_konwn_dependencies_txt script (#5149)
wForget Jul 16, 2024
bb908d2
Update mirrors of centos7 (#5150)
wForget Jul 16, 2024
9a9b210
[linkis-web-next]: Modules refactoring & Bug fixing (#5145)
Jul 29, 2024
5b6f276
Dir move
peacewong Aug 13, 2024
da54921
fix: Linkis-Gateway can not work with DELETE request without request …
cwmore Aug 13, 2024
4b26ae6
add can read method for fs
peacewong Aug 14, 2024
4a15564
update module name
peacewong Aug 14, 2024
074ae7e
[PES]Move multiple PES modules to the top directory
peacewong Aug 20, 2024
0d1c3f8
fix: resource output json error (#5160)
cwmore Aug 23, 2024
7b41c5d
Bump axios from 1.6.0 to 1.7.4 in /linkis-web (#5159)
dependabot[bot] Aug 23, 2024
5a5a95f
Bump axios from 1.6.0 to 1.7.4 in /linkis-web-next (#5162)
dependabot[bot] Aug 27, 2024
9560905
Add security check for jdbc url in SecurityUtils.java (#5164)
Le1a Sep 4, 2024
b6e929a
[bugfix] close method moved to finally (#5165)
guoshupei Sep 4, 2024
09f5f22
[linkis-web-next]: Modules refactoring & Bug fixing (#5151)
Sep 9, 2024
d99f967
[Feature][Commons] Linkis Commons Function optimization (#5168)
peacewong Sep 10, 2024
2228cb4
[Feature][JDBC] JDBC driver support pull Multiple result sets (#5173)
peacewong Sep 14, 2024
b8406e1
Support resultSet direct push for SparkSqlExecutor (#5170)
ycycse Sep 24, 2024
515d114
upgrade poi and related dependencies to latest version (#5183)
pjfanning Oct 6, 2024
39bb9c8
bcprov 1.78.1 (#5180)
pjfanning Oct 6, 2024
aed8d53
[BRANCH] upgrade CI actions because old versions are no longer suppor…
pjfanning Oct 8, 2024
3f55207
[linkis-web-next]: Modules refactoring & Bug fixing (#5169)
Oct 16, 2024
a0fbc45
Upgrade to Jetty 9.4.56.v20240826 (#5189)
pjfanning Oct 16, 2024
a07e51b
CI: use latest action versions (#5190)
pjfanning Oct 16, 2024
903d2e5
Bump org.apache.avro:avro in /linkis-engineconn-plugins/sqoop (#5187)
dependabot[bot] Oct 16, 2024
887c042
Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.8.4 (#5186)
dependabot[bot] Oct 16, 2024
8ae4d68
Bump com.google.protobuf:protobuf-java from 3.16.3 to 3.25.5 (#5175)
dependabot[bot] Oct 16, 2024
87d25be
Bump com.jayway.jsonpath:json-path from 2.7.0 to 2.9.0 (#5123)
dependabot[bot] Oct 16, 2024
96fd44c
Bump com.hazelcast:hazelcast from 5.3.0 to 5.3.5 in /linkis-enginecon…
dependabot[bot] Oct 16, 2024
73b5dd3
Bump org.apache.kafka:kafka-clients from 2.7.0 to 2.7.2 in /linkis-pu…
dependabot[bot] Oct 16, 2024
3647c31
Bump rollup from 3.28.1 to 3.29.5 in /linkis-web-next (#5176)
dependabot[bot] Oct 16, 2024
9036be6
Add a new management console to modify the engine status to UnHealthy…
kinsanities Nov 5, 2024
2fdf9d3
[EnginePlugin][Spark]Turn off use secure random by default (#5197)
peacewong Nov 12, 2024
9b5a34c
feat: add support for sparkmeasure (#5202)
sjgllgh Nov 26, 2024
bca9fe2
Add a containerized mode to the ECM service (#5201)
sjgllgh Nov 27, 2024
14111f9
Fix ss3 and oss
peacewong Dec 1, 2024
6f3bb22
Fix build
peacewong Dec 2, 2024
d67847e
Fix build
peacewong Dec 2, 2024
ebc08a0
Merge pull request #5204 from WeDataSphere/master-s3
sjgllgh Dec 3, 2024
4b58ac3
Bump vue-i18n from 9.4.1 to 9.14.2 in /linkis-web-next (#5206)
dependabot[bot] Dec 4, 2024
2d0b2ad
Bump @intlify/core-base and vue-i18n in /linkis-web-next (#5205)
dependabot[bot] Dec 4, 2024
6bc388f
Enhance the functionality of s3filesystem (#5208)
sjgllgh Dec 4, 2024
40d8c1d
Bump nanoid from 3.3.6 to 3.3.8 in /linkis-web-next (#5209)
dependabot[bot] Dec 16, 2024
ec04907
release 1.7.0 (#5211)
peacewong Dec 19, 2024
c780b36
Update NOTICE year (#5213)
pjfanning Jan 16, 2025
8ac124b
Bump com.thoughtworks.xstream:xstream from 1.4.20 to 1.4.21 (#5210)
dependabot[bot] Jan 16, 2025
39e1034
Bump vite from 4.5.3 to 4.5.9 in /linkis-web-next (#5217)
dependabot[bot] Feb 6, 2025
5107e13
Bump vue-i18n from 9.14.2 to 9.14.3 in /linkis-web-next (#5219)
dependabot[bot] Mar 10, 2025
a58f39f
Bump esbuild, @vitejs/plugin-vue and vite in /linkis-web-next (#5221)
dependabot[bot] Mar 11, 2025
fea5dea
Bump axios from 1.7.4 to 1.8.2 in /linkis-web (#5220)
dependabot[bot] Mar 11, 2025
09f526a
1.8.0 release feature (#5225)
GLeXios Mar 31, 2025
71fb60f
Bump @babel/runtime from 7.22.11 to 7.27.0 in /linkis-web-next (#5227)
dependabot[bot] Apr 1, 2025
9fc6929
Bump axios from 1.7.4 to 1.8.2 in /linkis-web-next (#5226)
dependabot[bot] Apr 1, 2025
38bdd5e
Bump vite from 6.2.1 to 6.2.4 in /linkis-web-next (#5228)
dependabot[bot] Apr 1, 2025
84e037f
update readme linkis wiki (#5233)
v-kkhuang May 7, 2025
45d924b
chore: use `master` branch for snapshot (#5247)
kazutoiris Aug 13, 2025
d9a4d78
Bump vue from 2.6.12 to 3.0.0 in /linkis-web (#5192)
dependabot[bot] Aug 13, 2025
a893a58
Bump org.apache.kafka:kafka-clients from 2.7.2 to 3.7.1 in /linkis-pu…
dependabot[bot] Aug 13, 2025
19f8d5a
Bump vite from 6.2.4 to 6.3.4 in /linkis-web-next (#5232)
dependabot[bot] Aug 13, 2025
2fbe5aa
Bump commons-beanutils:commons-beanutils (#5234)
dependabot[bot] Aug 13, 2025
6e29759
Bump org.apache.zookeeper:zookeeper from 3.9.2 to 3.9.3 (#5238)
dependabot[bot] Aug 13, 2025
96c2c44
Bump commons-fileupload:commons-fileupload from 1.5 to 1.6.0 (#5239)
dependabot[bot] Aug 13, 2025
7498f8d
Bump vue-i18n from 9.14.3 to 9.14.5 in /linkis-web-next (#5242)
dependabot[bot] Aug 13, 2025
85ed804
Bump org.apache.commons:commons-lang3 from 3.12.0 to 3.18.0 (#5240)
dependabot[bot] Aug 13, 2025
e3fa11f
Bump form-data from 4.0.0 to 4.0.4 in /linkis-web-next (#5243)
dependabot[bot] Aug 13, 2025
a571911
Bump org.apache.kafka:kafka-clients (#5248)
dependabot[bot] Aug 13, 2025
d4abce7
Bump vite from 6.3.4 to 6.3.6 in /linkis-web-next
dependabot[bot] Sep 10, 2025
13896f7
Bump org.hibernate:hibernate-validator
dependabot[bot] Sep 12, 2025
673f348
Bump axios from 1.8.2 to 1.12.0 in /linkis-web-next
dependabot[bot] Sep 13, 2025
d9028be
Merge pull request #5255 from apache/dependabot/npm_and_yarn/linkis-w…
aiceflower Sep 18, 2025
c613f77
Merge pull request #5257 from apache/dependabot/maven/linkis-public-e…
aiceflower Sep 18, 2025
7dec883
Merge pull request #5258 from apache/dependabot/npm_and_yarn/linkis-w…
aiceflower Sep 18, 2025
7f3bf7e
Add urlencode check for jdbc url in SecurityUtils.java and fix passwo…
Le1a Sep 22, 2025
251c16e
Bump axios from 1.8.2 to 1.12.0 in /linkis-web (#5260)
dependabot[bot] Sep 22, 2025
5fbc4a1
Bump commons-beanutils:commons-beanutils (#5259)
dependabot[bot] Sep 22, 2025
6f77ab0
Fix split sql concatenated limit exceptions by semicolon (#5245)
huxiaojian2024 Sep 22, 2025
c0065b1
script variable replaces a number that exceeds a Long type value and …
huxiaojian2024 Sep 22, 2025
ef268fb
Optimize monitor module (#5216)
Liboyistu Sep 22, 2025
5bd72d1
Bump org.apache.zookeeper:zookeeper from 3.9.3 to 3.9.4 (#5263)
dependabot[bot] Sep 28, 2025
1996116
Release 1.8.0 code merge (#5269)
aiceflower Oct 17, 2025
7215d4e
When submitting, parameter values containing spaces are supported (#5…
sjgllgh Oct 28, 2025
1603bdf
Modify the SparkMeasure feature to be disabled by default. (#5274)
sjgllgh Oct 28, 2025
12262ad
Bump org.bouncycastle:bcpkix-jdk18on from 1.78.1 to 1.79 (#5270)
dependabot[bot] Oct 28, 2025
dba44dd
In the engineConnExec.sh script, replace the absolute path of CLASSPA…
sjgllgh Oct 28, 2025
c13975f
Bump vite from 6.3.6 to 6.4.1 in /linkis-web-next (#5277)
dependabot[bot] Oct 28, 2025
0cbe383
Release 1.8.0 rc1 (#5286)
aiceflower Nov 17, 2025
3a0e742
fix hive concurrent mode load udf error & code foramt (#5289)
aiceflower Nov 19, 2025
e3c84aa
fix kafka datasource fixerror & code format (#5291)
aiceflower Nov 19, 2025
6285de3
Master feature (#5293)
aiceflower Nov 23, 2025
8b2f670
Bump js-yaml from 4.1.0 to 4.1.1 in /linkis-web-next (#5285)
dependabot[bot] Mar 26, 2026
c582fb9
Bump qs from 6.11.2 to 6.14.1 in /linkis-web-next (#5329)
dependabot[bot] Mar 26, 2026
f80ae9b
Bump lodash-es from 4.17.21 to 4.17.23 in /linkis-web-next (#5331)
dependabot[bot] Mar 26, 2026
0c616ce
Bump lodash from 4.17.21 to 4.17.23 in /linkis-web/src/apps/PythonMod…
dependabot[bot] Mar 26, 2026
f91c71a
Bump lodash from 4.17.21 to 4.17.23 in /linkis-web-next (#5333)
dependabot[bot] Mar 26, 2026
008ff15
Bump lodash from 4.17.21 to 4.17.23 in /linkis-web (#5334)
dependabot[bot] Mar 26, 2026
2ae5f0a
Bump org.assertj:assertj-core from 3.17.2 to 3.27.7 (#5335)
dependabot[bot] Mar 26, 2026
06ae5a2
Bump axios from 1.12.0 to 1.13.5 in /linkis-web-next (#5336)
dependabot[bot] Mar 26, 2026
fe5b31f
Bump axios from 1.12.2 to 1.13.5 in /linkis-web (#5337)
dependabot[bot] Mar 26, 2026
8c9adff
Bump qs from 6.11.0 to 6.14.2 in /linkis-web (#5338)
dependabot[bot] Mar 26, 2026
efcc469
update markdown lint check (#5301)
kevinjqliu Mar 26, 2026
863b96b
Bump yaml and lint-staged in /linkis-web-next (#5346)
dependabot[bot] Mar 26, 2026
aa0676a
Bump svgo from 3.0.2 to 3.3.3 in /linkis-web (#5347)
dependabot[bot] Mar 26, 2026
3652f5b
Bump picomatch in /linkis-web-next (#5348)
dependabot[bot] Mar 26, 2026
1186c79
Bump minimatch from 3.1.2 to 3.1.5 in /linkis-web-next (#5349)
dependabot[bot] Mar 26, 2026
a9de550
Bump flatted from 3.2.7 to 3.4.2 in /linkis-web-next (#5352)
dependabot[bot] Mar 26, 2026
acf9ab2
Bump rollup from 4.35.0 to 4.60.0 in /linkis-web-next (#5353)
dependabot[bot] Mar 26, 2026
6367174
Bump lodash-es in /linkis-web/src/apps/PythonModule (#5354)
dependabot[bot] Mar 26, 2026
5df9bc3
Bump qs from 6.14.1 to 6.14.2 in /linkis-web-next (#5355)
dependabot[bot] Mar 26, 2026
ecde367
[1.9.0 release] [PES][EC][publicservice][spark] feat: ResultSet field…
aiceflower Mar 27, 2026
6c8ca7a
Bump lodash-es in /linkis-web/src/apps/PythonModule (#5394)
dependabot[bot] Apr 2, 2026
6ead030
#AI commit# 开发阶段:管理台支持展示引擎版本 (#5396)
v-kkhuang Apr 2, 2026
5fdf4a0
#AI commit# 开发阶段: 修复sr任务重试导致加载init_sql异常bug (#5399)
v-kkhuang Apr 2, 2026
cb5d91a
#AI commit# 新增功能 - spark引擎支持设置driver参数到driver端 (#5398)
v-kkhuang Apr 2, 2026
ddb649c
Bump org.apache.avro:avro (#5391)
dependabot[bot] Apr 2, 2026
df83ec0
Bump org.springframework.boot:spring-boot-actuator from 2.7.12 to 2.7…
dependabot[bot] Apr 2, 2026
bf1cb5b
[LINKIS-1.9.0] Feature toggles, dependency optimization and bug fixes…
aiceflower Apr 2, 2026
2f4d14e
Bump lodash-es from 4.17.23 to 4.18.1 in /linkis-web-next (#5401)
dependabot[bot] Apr 3, 2026
f0406cc
Bump lodash from 4.17.23 to 4.18.1 in /linkis-web (#5402)
dependabot[bot] Apr 3, 2026
cbb3ed3
Bump lodash from 4.17.23 to 4.18.1 in /linkis-web-next (#5403)
dependabot[bot] Apr 3, 2026
f18678d
Bump lodash from 4.17.23 to 4.18.1 in /linkis-web/src/apps/PythonModu…
dependabot[bot] Apr 3, 2026
0f69c9f
#AI commit# chore: Bump version from 1.9.0 to 2.0.0
aiceflower Apr 3, 2026
6648906
[fix][CGS][entrance] parallelgroup cache not updated when entrance in…
v-kkhuang Apr 7, 2026
57e014c
[feat][CGS][hive] add security control to prevent location clause usa…
v-kkhuang Apr 7, 2026
27f6b88
[feat][EC][hive] add support for yarn tag and username in hive engine…
v-kkhuang Apr 7, 2026
00a099c
[perf][COM][kerberos] optimize keytab file caching to prevent full gc…
v-kkhuang Apr 7, 2026
31bb257
[feat][COM][logging] optimize log printing and add hadoop client usag…
v-kkhuang Apr 7, 2026
297faf4
[feat][ETS][monitor] optimize monitor module with log cleanup and con…
v-kkhuang Apr 7, 2026
56478dc
#AI commit# 开发阶段: * 资源重置接口逻辑优化 (#978)
v-kkhuang Apr 7, 2026
614b0f3
[fix][CGS][entrance] fix dependency injection failure in entrance con…
v-kkhuang Apr 8, 2026
340ae29
#AI commit# fix: Restore linkis-io_file-client dependency in linkis-p…
aiceflower Apr 8, 2026
23fe635
#AI commit# [fix][PES][datasource] fix DB2 schema query to use correc…
aiceflower Apr 12, 2026
6ea5a7d
[docs] reorganize 2.0.0 feature documentation structure (#994)
v-kkhuang Apr 23, 2026
dc3897e
[feat][CGS][engineconn-manager] add support for hadoop3 engine materi…
v-kkhuang Apr 23, 2026
9b2d2d8
#AI commit# 开发阶段: 代码格式化 (#998)
v-kkhuang Apr 23, 2026
b0b5866
#AI commit# 开发阶段: 优化禁止引擎打印code隐私信息 (#1000)
v-kkhuang Apr 23, 2026
a0c9a0f
#AI commit# 开发阶段: 加密日志打印token (#1002)
v-kkhuang Apr 27, 2026
8086e26
[fix][EC][all-engines] mask user code in engine execution logs to pre…
v-kkhuang Apr 27, 2026
49fbb65
[style][CGS][core] improve code formatting for unit tests and configu…
v-kkhuang Apr 27, 2026
2e0772c
#AI commit# 开发阶段: spark scala version update (#1006)
v-kkhuang Apr 27, 2026
a0ac6f5
#AI commit# 开发阶段: add week variable support for date calculation (#1008)
v-kkhuang Apr 27, 2026
1fc405c
#AI commit# 开发阶段: add permission check for secondary queue selection …
v-kkhuang Apr 27, 2026
a2ea93b
#AI COMMIT# [fix][CGS] Add MDC jobId tracing for task-related logs (#…
aiceflower Apr 28, 2026
53b4003
#AI commit# 开发阶段: 同步flink版本 (#1013)
v-kkhuang Apr 28, 2026
cc92eeb
#AI commit# 开发阶段: 增加label service 修改entrance 服务标签触发广播 (#1017)
v-kkhuang Apr 28, 2026
8835052
[fix][ETS][et-monitor] fix log printing exception and optimize monito…
v-kkhuang Apr 28, 2026
fa31f0d
#AI commit# 开发阶段: 安全工单升级commons-lang移除,commons-lang3升级3.18.0 (#1019)
v-kkhuang Apr 29, 2026
67f0bef
#AI commit# 开发阶段: 优化引擎日志输出用户执行code (#1021)
v-kkhuang Apr 29, 2026
9c20c54
#AI commit# 开发阶段: 支持keytab环境,启动命令行增安全参数 (#1020)
v-kkhuang Apr 29, 2026
936168a
[fix][EC][JDBC] Add configurable validation query for different datab…
aiceflower May 6, 2026
39f0e37
[fix][EC][spark] fix spark and hive engine execution task error excep…
v-kkhuang May 6, 2026
04a9535
Dev 2.0.0 bug fix (#1026)
v-kkhuang May 9, 2026
dbec63e
[refactor][CGS][entrance] remove duplicate log printing code in entra…
v-kkhuang May 12, 2026
71c21ce
[fix][MGS][gateway] fix compilation errors in security filter and ada…
v-kkhuang May 12, 2026
a4d31e5
#AI commit# 开发阶段:Revert community code (#1032)
v-kkhuang May 19, 2026
a23c5c8
#AI commit# refactor:忽略Angent系统文件
v-kkhuang May 26, 2026
7962cd8
feat(setting): 为配置参数添加删除功能
v-kkhuang May 28, 2026
545dc52
feat(web): 添加用户配置管理页面删除功能
v-kkhuang Jun 1, 2026
8b61282
#AI commit# refactor:用户配置新增删除按钮
v-kkhuang Jun 1, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
188 changes: 188 additions & 0 deletions .ai/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,188 @@
# Linkis AI 开发文档导航

> **版本信息**
> - 文档版本: 1.0.0
> - 最后更新: 2025-01-28
> - 适用版本: Apache Linkis 1.17.0+

---

## 🚀 快速开始

### 新手必读(按顺序阅读)
1. **[项目核心规约](./project-context.md)** - 包含技术栈、架构设计、开发规范和模板
2. **[强制性开发规则](./rules.md)** - 必须无条件遵守的开发规则
3. **[模块文档](#模块文档索引)** - 根据你要开发的功能选择对应模块

### 常见开发场景快速跳转
- 🆕 新增 REST 接口 → [REST接口开发模板](#rest接口开发)
- ⚙️ 添加配置项 → [配置管理规范](#配置管理)
- 🗄️ 修改数据库 → [数据库变更规范](#数据库变更)
- 🐛 异常处理 → [异常处理规范](#异常处理)
- 📝 日志记录 → [日志规范](#日志规范)

---

## 📚 核心文档索引

### 🎯 开发规范文档
| 文档 | 用途 | 何时查看 |
|------|------|----------|
| [project-context.md](./project-context.md) | 项目角色定位、技术栈、架构设计、开发模板 | 开始任何开发工作前必读 |
| [rules.md](./rules.md) | 强制性开发规则、需求实现步骤 | 每次开发新需求时参考 |

### 🏗️ 模块文档索引

#### 微服务治理服务(基础设施层)
| 服务 | 文档 | 主要功能 |
|------|------|----------|
| Gateway | [gateway.md](./modules/microservice-governance/gateway.md) | API网关、路由转发、安全认证 |
| Eureka | [eureka.md](./modules/microservice-governance/eureka.md) | 服务注册与发现 |
| 概览 | [README.md](./modules/microservice-governance/README.md) | 微服务治理服务概述 |

#### 计算治理服务(核心业务层)
| 服务 | 文档 | 主要功能 |
|------|------|----------|
| Entrance | [entrance.md](./modules/computation-governance/entrance.md) | 任务提交入口、调度管理 |
| JobHistory | [jobhistory.md](./modules/computation-governance/jobhistory.md) | 任务历史记录查询 |
| Manager | [manager.md](./modules/computation-governance/manager.md) | 资源管理、应用管理 |
| ECM | [ecm.md](./modules/computation-governance/ecm.md) | 引擎连接管理 |
| 概览 | [README.md](./modules/computation-governance/README.md) | 计算治理服务概述 |

#### 公共增强服务(支撑服务层)
| 服务 | 文档 | 主要功能 |
|------|------|----------|
| PublicService | [publicservice.md](./modules/public-enhancements/publicservice.md) | 公共服务、文件管理 |
| Configuration | [configuration.md](./modules/public-enhancements/configuration.md) | 配置管理 |
| BML | [bml.md](./modules/public-enhancements/bml.md) | 大数据物料库 |
| DataSource | [datasource.md](./modules/public-enhancements/datasource.md) | 数据源管理 |
| Context | [context.md](./modules/public-enhancements/context.md) | 上下文服务 |
| Monitor | [monitor.md](./modules/public-enhancements/monitor.md) | 监控服务 |
| 概览 | [README.md](./modules/public-enhancements/README.md) | 公共增强服务概述 |

---

## 🔍 按功能快速查找

### <a name="rest接口开发"></a>REST接口开发
- **开发模板**: [project-context.md - REST接口层](./project-context.md#1-rest接口层)
- **API规范**: [project-context.md - API设计规范](./project-context.md#api设计规范)
- **参考示例**:
- Entrance接口: [entrance.md - API Interfaces](./modules/computation-governance/entrance.md#api-interfaces)
- Configuration接口: [configuration.md - API Interfaces](./modules/public-enhancements/configuration.md#api-interfaces)

### <a name="配置管理"></a>配置管理
- **配置规范**: [project-context.md - 配置管理规范](./project-context.md#配置管理规范)
- **配置示例库**: [project-context.md - 常用配置示例库](./project-context.md#常用配置示例库)
- **配置模板**: [project-context.md - 配置类](./project-context.md#4-配置类)
- **参考实现**: linkis-jobhistory/conf/JobhistoryConfiguration

### <a name="数据库变更"></a>数据库变更
- **变更规则**: [rules.md - 数据库修改原则](./rules.md#数据库修改原则)
- **DDL脚本位置**: `linkis-dist/package/db/linkis_ddl.sql`
- **DML脚本位置**: `linkis-dist/package/db/linkis_dml.sql`
- **表结构参考**: 各模块文档的 "Database Table Structures" 章节

### <a name="异常处理"></a>异常处理
- **异常规范**: [project-context.md - 异常处理规范](./project-context.md#异常处理规范)
- **统一异常**: `org.apache.linkis.common.exception.LinkisException`
- **常见错误**: [project-context.md - 常见错误及避免方法](./project-context.md#常见错误及避免方法)

### <a name="日志规范"></a>日志规范
- **日志规范**: [project-context.md - 日志规范](./project-context.md#日志规范)
- **Logger定义**: 必须使用 `LoggerFactory.getLogger(ClassName.class)`
- **日志级别**: ERROR/WARN/INFO/DEBUG 使用场景

---

## 🎨 开发模板快速复制

### 新增功能完整流程
```
1. 查看 rules.md - 需求实现步骤
2. 创建需求文档和设计文档
3. 使用 project-context.md 中的代码模板:
- REST接口层模板
- 服务层模板
- 数据访问层模板
- 配置类模板
4. 添加功能开关(默认false)
5. 记录数据库变更
6. 编写测试和文档
```

### REST接口模板快速链接
👉 [project-context.md - 新功能开发模板](./project-context.md#新功能开发模板)

### 配置类模板快速链接
👉 [project-context.md - 配置类](./project-context.md#4-配置类)

---

## ⚠️ 重要提醒

### 🚫 禁止操作(来自 rules.md)
- **数据库结构**: 除非明确指定,严禁修改现有表结构
- **第三方依赖**: 不允许引入新的第三方依赖库
- **核心接口**: 不得修改现有公共接口的签名

### ✅ 必须遵守
- **最小改动原则**: 所有功能实现必须遵循最小改动原则
- **功能可配置**: 所有功能必须增加功能开关,默认关闭
- **向后兼容**: 新增功能必须考虑向后兼容性

---

## 💡 开发技巧

### 编程语言选择
- **Java**: REST API、Service层、Entity类、配置类
- **Scala**: 计算逻辑、RPC通信、复杂业务处理、配置对象

### 字符编码
统一使用 `StandardCharsets.UTF_8`,禁止使用字符串 `"UTF-8"`

### 统一返回体
所有REST接口返回 `org.apache.linkis.server.Message`

---

## 📖 如何使用这些文档

### 场景1: 我要在 Entrance 服务中新增一个接口
1. 阅读 [entrance.md](./modules/computation-governance/entrance.md) 了解服务结构
2. 查看 [project-context.md - REST接口层模板](./project-context.md#1-rest接口层)
3. 参考 entrance.md 中现有接口实现
4. 遵循 [rules.md](./rules.md) 中的开发规则
5. 添加功能开关配置

### 场景2: 我需要添加一个新的配置项
1. 查看 [project-context.md - 配置管理规范](./project-context.md#配置管理规范)
2. 参考 [project-context.md - 配置类模板](./project-context.md#4-配置类)
3. 查看 `JobhistoryConfiguration` 实现示例
4. 在当前模块的 conf 目录下的 Configuration 类中添加

### 场景3: 我需要修改数据库表
1. 查看 [rules.md - 数据库修改原则](./rules.md#数据库修改原则)
2. 确认是否能通过新增字段实现(优先选择)
3. 将变更记录到 `linkis-dist/package/db/linkis_ddl.sql`
4. 如有初始化数据,记录到 `linkis-dist/package/db/linkis_dml.sql`

---

## 🔄 文档更新记录

| 版本 | 日期 | 更新内容 | 更新人 |
|------|------|----------|--------|
| 1.0.0 | 2025-01-28 | 创建导航文档,优化文档结构 | AI |

---

## 📞 帮助与反馈

如果文档中有不清楚的地方,请:
1. 先查看对应模块的详细文档
2. 查看 project-context.md 中的开发模板和示例
3. 参考现有代码实现

**记住**: 遵循规范比快速开发更重要!
157 changes: 157 additions & 0 deletions .ai/modules/computation-governance/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,157 @@
# Computation Governance Services

The computation governance services handle the core computation task lifecycle management in Linkis.

## Service Modules

- [Entrance Service](./entrance.md) - Task submission and entrance point
- [Manager Service](./manager.md) - Resource and application management
- [ECM Service](./ecm.md) - Engine Connection Manager
- [JobHistory Service](./jobhistory.md) - Task execution history tracking

## Overview

These services form the core of Linkis' computation governance capabilities, managing the complete lifecycle of computation tasks from submission to execution and monitoring.

## Common Features

### Task Lifecycle Management
- Task submission and validation
- Task scheduling and resource allocation
- Task execution monitoring
- Task result management
- Task error handling and recovery

### Engine Management
- Dynamic engine connection creation
- Engine lifecycle management
- Engine resource monitoring
- Engine scaling capabilities

### Resource Governance
- Multi-tenant resource isolation
- Load balancing across engines
- Resource usage tracking
- Quota management

## API Interface Summary

### Entrance Service APIs
- Task submission: `POST /api/entrance/submit`
- Task status query: `GET /api/entrance/{id}/status`
- Task progress: `GET /api/entrance/{id}/progress`
- Task log retrieval: `GET /api/entrance/{id}/log`
- Task cancellation: `GET /api/entrance/{id}/kill`

### Manager Service APIs
- Engine instance management
- Resource allocation and monitoring
- Node status querying
- Engine creation requests

### ECM Service APIs
- Engine connection management
- Engine lifecycle operations
- Resource reporting
- Engine metrics collection

### JobHistory Service APIs
- Job history querying
- Job detail retrieval
- Job statistics reporting

## Database Schema Summary

### Job History Group Table
```sql
CREATE TABLE `linkis_ps_job_history_group_history` (
`id` bigint(20) NOT NULL AUTO_INCREMENT COMMENT 'Primary Key, auto increment',
`job_req_id` varchar(64) DEFAULT NULL COMMENT 'job execId',
`submit_user` varchar(50) DEFAULT NULL COMMENT 'who submitted this Job',
`execute_user` varchar(50) DEFAULT NULL COMMENT 'who actually executed this Job',
`source` text DEFAULT NULL COMMENT 'job source',
`labels` text DEFAULT NULL COMMENT 'job labels',
`params` text DEFAULT NULL COMMENT 'job params',
`progress` varchar(32) DEFAULT NULL COMMENT 'Job execution progress',
`status` varchar(50) DEFAULT NULL COMMENT 'Script execution status, must be one of the following: Inited, WaitForRetry, Scheduled, Running, Succeed, Failed, Cancelled, Timeout',
`log_path` varchar(200) DEFAULT NULL COMMENT 'File path of the job log',
`error_code` int DEFAULT NULL COMMENT 'Error code. Generated when the execution of the script fails',
`error_desc` varchar(1000) DEFAULT NULL COMMENT 'Execution description. Generated when the execution of script fails',
`created_time` datetime(3) DEFAULT CURRENT_TIMESTAMP(3) COMMENT 'Creation time',
`updated_time` datetime(3) DEFAULT CURRENT_TIMESTAMP(3) COMMENT 'Update time',
`instances` varchar(250) DEFAULT NULL COMMENT 'Entrance instances',
`metrics` text DEFAULT NULL COMMENT 'Job Metrics',
`engine_type` varchar(32) DEFAULT NULL COMMENT 'Engine type',
`execution_code` text DEFAULT NULL COMMENT 'Job origin code or code path',
`result_location` varchar(500) DEFAULT NULL COMMENT 'File path of the resultsets',
`observe_info` varchar(500) DEFAULT NULL COMMENT 'The notification information configuration of this job',
PRIMARY KEY (`id`),
KEY `idx_created_time` (`created_time`),
KEY `idx_submit_user` (`submit_user`)
);
```

### Job History Detail Table
```sql
CREATE TABLE `linkis_ps_job_history_detail` (
`id` bigint(20) NOT NULL AUTO_INCREMENT COMMENT 'Primary Key, auto increment',
`job_history_id` bigint(20) NOT NULL COMMENT 'ID of JobHistory',
`result_location` varchar(500) DEFAULT NULL COMMENT 'File path of the resultsets',
`execution_content` text DEFAULT NULL COMMENT 'The script code or other execution content executed by this Job',
`result_array_size` int(4) DEFAULT 0 COMMENT 'size of result array',
`job_group_info` text DEFAULT NULL COMMENT 'Job group info/path',
`created_time` datetime(3) DEFAULT CURRENT_TIMESTAMP(3) COMMENT 'Creation time',
`updated_time` datetime(3) DEFAULT CURRENT_TIMESTAMP(3) COMMENT 'Update time',
`status` varchar(32) DEFAULT NULL COMMENT 'status',
`priority` int(4) DEFAULT 0 COMMENT 'order of subjob',
PRIMARY KEY (`id`)
);
```

### Common Lock Table
```sql
CREATE TABLE `linkis_ps_common_lock` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`lock_object` varchar(255) COLLATE utf8_bin DEFAULT NULL,
`locker` VARCHAR(255) CHARSET utf8mb4 COLLATE utf8mb4_bin DEFAULT NULL COMMENT 'locker',
`time_out` longtext COLLATE utf8_bin,
`update_time` datetime DEFAULT CURRENT_TIMESTAMP,
`create_time` datetime DEFAULT CURRENT_TIMESTAMP,
PRIMARY KEY (`id`),
UNIQUE KEY `uniq_lock_object` (`lock_object`)
);
```

## RPC Methods Summary

### Entrance Service RPCs
- `submitTask(TaskRequest request)`
- `getTaskStatus(String taskId)`
- `cancelTask(String taskId)`
- `getTaskResult(String taskId)`

### Manager Service RPCs
- `requestEngine(EngineRequest request)`
- `releaseEngine(String engineId)`
- `getEngineStatus(String engineId)`
- `getNodeMetrics(String nodeId)`

### ECM Service RPCs
- `createEngineConnection(EngineCreateRequest request)`
- `terminateEngineConnection(String engineId)`
- `reportEngineResourceUsage(String engineId, ResourceUsage usage)`
- `getEngineMetrics(String engineId)`

### JobHistory Service RPCs
- `saveJobHistory(JobHistory history)`
- `queryJobHistory(JobHistoryQuery query)`
- `getJobDetails(Long jobId)`
- `updateJobStatus(Long jobId, String status)`

## Dependencies

- linkis-commons - Shared utilities
- linkis-protocol - Communication protocols
- linkis-rpc - Remote procedure calls
- Various engine connection plugins
- Spring Cloud ecosystem
Loading
Loading