Skip to main content
版本：1.6.0

库表结构

1. linkis_cg_ec_resource_info_record​

历史引擎信息记录表 ec 为engine conn 缩写 ecm为 engineconn manager 服务缩写

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_valueec 的label标签 stringValue 如 userCreator, engineType->hadoop-LINKISCLI,shell-1varchar(255)NO
3create_userec 的创建用户varchar(128)NO
4service_instanceec 实例信息 如 bdpdev01dss02:19756varchar(128)YES
5ecm_instanceecm 实例信息 如bdpdev01dss02:9102varchar(128)YES
6ticket_idec 的 ticket idvarchar(100)MULNO
7log_dir_suffixec 日志log所在的路径varchar(128)YES
8request_times资源请求次数int(8)YES
9request_resource请求的资源varchar(1020)YES
10used_times资源使用次数int(8)YES
11used_resource使用的资源信息varchar(1020)YES
12release_times释放资源次数int(8)YES
13released_resource释放的资源varchar(1020)YES
14release_time释放的时间datetimeYES
15used_time使用时间datetimeYES
16create_time创建时间datetimeYESCURRENT_TIMESTAMP

示例数据

idlabel_valuecreate_userservice_instanceecm_instanceticket_idstatuslog_dir_suffixrequest_timesrequest_resourceused_timesused_resourcerelease_timesreleased_resourcerelease_timeused_timecreate_time
1hadoop-LINKISCLI,shell-1hadoopbdpdev01dss02:19756bdpdev01dss02:9102fc0d442d-7e18-49f6-a01e-a4f4685f0155ShuttingDownhadoop/20221025/shell/fc0d442d-7e18-49f6-a01e-a4f4685f0155/logs1{"instance":1,"memory":"1024.0 MB","cpu":1}1{"instance":1,"memory":"1024.0 MB","cpu":1}1{"instance":1,"memory":"1024.0 MB","cpu":1}2022-10-25 17:55:412022-10-25 17:53:092022-10-25 17:52:56
2hadoop-LINKISCLI,hive-2.3.3hadoopbdpdev01dss02:20903bdpdev01dss02:910263ea31dc-65b1-42c4-8963-5fe4468f0ae0ShuttingDownhadoop/20221025/hive/63ea31dc-65b1-42c4-8963-5fe4468f0ae0/logs1{"instance":1,"memory":"1024.0 MB","cpu":1}1{"instance":1,"memory":"1024.0 MB","cpu":1}1{"instance":1,"memory":"1024.0 MB","cpu":1}2022-10-25 17:55:522022-10-25 17:54:362022-10-25 17:54:20
3hadoop-LINKISCLI,python-python2hadoopbdpdev01dss02:21320bdpdev01dss02:91023f8a4f73-fdbb-407e-ae1b-0b14b9d08bcfShuttingDownhadoop/20221025/python/3f8a4f73-fdbb-407e-ae1b-0b14b9d08bcf/logs1{"instance":1,"memory":"1024.0 MB","cpu":1}1{"instance":1,"memory":"1024.0 MB","cpu":1}1{"instance":1,"memory":"1024.0 MB","cpu":1}2022-10-25 17:57:412022-10-25 17:55:552022-10-25 17:55:44

索引说明

序号名称描述类型字段
1idx_tid将ticket_id 列设置为普通索引INDEXticket_id
2uniq_tid_lv将ticket_id,label_value列设置为唯一索引UNIQUE KEYticket_id,label_value

2. linkis_cg_engine_conn_plugin_bml_resources​

引擎物料存储信息表 主要用于引擎实例启动时，根据对应的物料资源的进行下载，以及进行引擎物料刷新时会使用到。

序号名称描述类型键为空额外默认值
1idPrimary keybigint(20)PRINOauto_increment
2engine_conn_type引擎名 如 hivevarchar(100)NO
3version物料版本varchar(100)YES
4file_name文件名 conf.zip/lib.zipvarchar(255)YES
5file_size大小 bytebigint(20)NO0
6last_modified最新修改时间bigint(20)YES
7bml_resource_idbml物料idvarchar(100)NO
8bml_resource_versionbml物料版本varchar(200)NO
9create_timecreated timedatetimeNOCURRENT_TIMESTAMP
10last_update_timeupdated timedatetimeNOCURRENT_TIMESTAMP

示例数据

idengine_conn_typeversionfile_namefile_sizelast_modifiedbml_resource_idbml_resource_versioncreate_timelast_update_time
3hive2.3.3conf.zip236316666834010008f9879b4-9950-43c9-8eca-5f570211e784v0000012022-10-25 15:42:082022-10-25 15:42:08
4hive2.3.3lib.zip1063191161666683401000ac77aa15-e873-4f5f-9ed1-17435cad390fv0000012022-10-25 15:42:132022-10-25 15:42:13
5elasticsearch7.6.2conf.zip19811666683401000f17874ca-54fa-4153-8edb-a4d31268847bv0000012022-10-25 15:42:142022-10-25 15:42:14
6elasticsearch7.6.2lib.zip1593501616666834010002f340471-a495-4b93-a197-b8eb362d04bbv0000012022-10-25 15:42:152022-10-25 15:42:15

3. linkis_cg_manager_engine_em​

引擎实例engine conn 和归属的ecm(engine conn manager)实例的关系表

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2engine_instanceec 实例信息varchar(128)YES
3em_instanceecm 实例信息varchar(128)YES
4update_timedatetimeYESCURRENT_TIMESTAMP
5create_timedatetimeYESCURRENT_TIMESTAMP

示例数据

idengine_instanceem_instanceupdate_timecreate_time
223localhost110003:10394localhost110003:91022022-11-12 23:30:092022-11-12 23:30:09
224localhost110003:33483localhost110003:91022022-11-12 23:30:482022-11-12 23:30:48
226localhost110003:19782localhost110003:91022022-11-13 01:48:052022-11-13 01:48:05

4. linkis_cg_manager_label​

标签记录表

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_key标签 labelvarchar(32)MULNO
3label_value标签值 json格式varchar(255)NO
4label_featurevarchar(16)NO
5label_value_size标签存储的元素个数int(20)NO
6update_timedatetimeNOCURRENT_TIMESTAMP
7create_timedatetimeNOCURRENT_TIMESTAMP

示例数据

idlabel_keylabel_valuelabel_featurelabel_value_sizeupdate_timecreate_time
19combined_userCreator_engineType*-nodeexecution,python-python2OPTIONAL22021-06-08 20:25:282021-06-08 20:25:28
21serverAlias{"alias":"linkis-cg-engineconnmanager"}OPTIONAL12021-06-08 20:27:072021-06-08 20:27:07
24combined_userCreator_engineType{"creator":"IDE","user":"hadoop","engineType":"hive","version":"2.3.3"}OPTIONAL42021-06-08 20:42:002021-06-08 20:42:00
26userCreator{"creator":"IDE","user":"hadoop"}OPTIONAL22021-06-08 20:42:072021-06-08 20:42:07
27engineType{"engineType":"hive","version":"2.3.3"}OPTIONAL22021-06-08 20:42:072021-06-08 20:42:07
28serverAlias{"alias":"EngineConn"}OPTIONAL12021-06-08 20:42:072021-06-08 20:42:07
29codeType{"codeType":"hql"}OPTIONAL12021-06-08 20:42:162021-06-08 20:42:16
30combined_userCreator_engineType{"creator":"IDE","user":"root","engineType":"io_file","version":"1.0"}OPTIONAL42021-06-08 20:50:472021-06-08 20:50:47
32userCreator{"creator":"IDE","user":"root"}OPTIONAL22021-06-08 20:50:522021-06-08 20:50:52
33concurrentEngineConn{}OPTIONAL02021-06-08 20:50:522021-06-08 20:50:52
34engineType{"engineType":"io_file","version":"1.0"}OPTIONAL22021-06-08 20:50:522021-06-08 20:50:52
35codeType{"codeType":"io_file"}OPTIONAL12021-06-08 20:50:592021-06-08 20:50:59
36combined_userCreator_engineTypejohnnwang-,-*OPTIONAL22021-06-08 22:07:072021-06-08 22:07:07
37combined_userCreator_engineType{"creator":"IDE","user":"johnnwang","engineType":"flink","version":"1.11.1"}OPTIONAL42021-06-08 22:07:202021-06-08 22:07:20
39userCreator{"creator":"IDE","user":"johnnwang"}OPTIONAL22021-06-08 22:07:262021-06-08 22:07:26
40engineType{"engineType":"flink","version":"1.11.1"}OPTIONAL22021-06-08 22:07:262021-06-08 22:07:26
41combined_userCreator_engineType{"creator":"IDE","user":"johnnwang","engineType":"spark","version":"2.4.3"}OPTIONAL42021-06-08 22:07:372021-06-08 22:07:37

索引说明

序号名称描述类型字段
1uniq_lk_lv将label_key,label_value 列设置为唯一索引UNIQUE KEYlabel_key,label_value

5. linkis_cg_manager_label_resource​

标签id 和资源id 的关联关系表

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_idlinkis_cg_manager_label的idint(20)UNIYES
3resource_idlinkis_cg_manager_linkis_resources对应的idint(20)YES
4update_timedatetimeYESCURRENT_TIMESTAMP
5create_timedatetimeYESCURRENT_TIMESTAMP

示例数据

idlabel_idresource_idupdate_timecreate_time
1421713266142182022-11-12 23:09:362022-11-12 23:09:36
1421824142192022-11-12 23:30:092022-11-12 23:30:09
1421913267142202022-11-12 23:30:092022-11-12 23:30:09

索引说明

序号名称描述类型字段
1uniq_label_id将label_id 列设置为唯一索引UNIQUE KEYlabel_id

6. linkis_cg_manager_label_service_instance​

引擎实例engine conn/ecm(engine conn manager)实例 标签记录表

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_idlinkis_cg_manager_label的idint(20)MULYES
3service_instance实例信息varchar(128)YES
4update_timedatetimeYESCURRENT_TIMESTAMP
5create_timedatetimeYESCURRENT_TIMESTAMP

示例数据

idlabel_idservice_instanceupdate_timecreate_time
20094bdpdev01dss02:337552022-11-14 17:11:262022-11-14 17:11:26
201105bdpdev01dss02:91022022-11-15 14:54:562022-11-15 14:54:56
20223bdpdev01dss02:91022022-11-15 14:54:562022-11-15 14:54:56

索引说明

序号名称描述类型字段
1idx_lid_instance将label_id,service_instance 列设置为普通索引INDEXlabel_id,service_instance

7. linkis_cg_manager_label_user​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2usernamevarchar(255)YES
3label_idint(20)YES
4update_timedatetimeYESCURRENT_TIMESTAMP
5create_timedatetimeYESCURRENT_TIMESTAMP

8. linkis_cg_manager_label_value_relation​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_value_keyvarchar(255)MULNO
3label_value_contentvarchar(255)YES
4label_idint(20)YES
5update_timedatetimeYESCURRENT_TIMESTAMP
6create_timedatetimeYESCURRENT_TIMESTAMP

索引说明

序号名称描述类型字段
1uniq_lvk_lid将label_value_key,label_id 列设置为唯一索引UNIQUE KEYlabel_value_key,label_id

示例数据

label_value_keylabel_value_contentlabel_idupdate_timecreate_time
creatorIDE75892022-05-16 19:31:132022-05-16 19:31:13
userowenxu75892022-05-16 19:31:132022-05-16 19:31:13
creatormide75112022-05-12 10:40:272022-05-12 10:40:27
userdavidhua75112022-05-12 10:40:272022-05-12 10:40:27

9. linkis_cg_manager_linkis_resources​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2max_resourcevarchar(1020)YES
3min_resourcevarchar(1020)YES
4used_resourcevarchar(1020)YES
5left_resourcevarchar(1020)YES
6expected_resourcevarchar(1020)YES
7locked_resourcevarchar(1020)YES
8resourceTypevarchar(255)YES
9ticketIdvarchar(255)YES
10update_timedatetimeYESCURRENT_TIMESTAMP
11create_timedatetimeYESCURRENT_TIMESTAMP
12updatorvarchar(255)YES
13creatorvarchar(255)YES

示例数据

idmax_resourcemin_resourceused_resourceleft_resourceexpected_resourcelocked_resourceresourceTypeticketIdupdate_timecreate_timeupdatorcreator
14219{"memory":21474836480,"cores":10,"instance":10}{"memory":0,"cores":0,"instance":0}{"memory":1073741824,"cores":1,"instance":1}{"memory":20401094656,"cores":9,"instance":9}\N{"memory":0,"cores":0,"instance":0}LoadInstance\N\N2022-11-12 23:30:09hadoop-IDE,hive-2.3.3hadoop-IDE,hive-2.3.3
14220{"memory":1073741824,"cores":1,"instance":1}{"memory":1073741824,"cores":1,"instance":1}{"memory":1073741824,"cores":1,"instance":1}{"memory":0,"cores":0,"instance":0}\N{"memory":0,"cores":0,"instance":0}LoadInstance24f8c8a8-d481-4976-a11a-5765f81d9795\N2022-11-12 23:30:09hadoop-IDE,hive-2.3.3hadoop-IDE,hive-2.3.3
14221{"DriverAndYarnResource":{"loadInstanceResource":{"memory":21474836480,"cores":10,"instances":5},"yarnResource":{"queueMemory":322122547200,"queueCores":150,"queueInstances":30,"queueName":"dws","applicationId":""}}}{"DriverAndYarnResource":{"loadInstanceResource":{"memory":0,"cores":0,"instances":0},"yarnResource":{"queueMemory":0,"queueCores":0,"queueInstances":0,"queueName":"default","applicationId":""}}}{"DriverAndYarnResource":{"loadInstanceResource":{"memory":1073741824,"cores":1,"instances":1},"yarnResource":{"queueMemory":6442450944,"queueCores":4,"queueInstances":0,"queueName":"dws","applicationId":""}}}{"DriverAndYarnResource":{"loadInstanceResource":{"memory":20401094656,"cores":9,"instances":4},"yarnResource":{"queueMemory":315680096256,"queueCores":146,"queueInstances":30,"queueName":"dws","applicationId":""}}}\N{"DriverAndYarnResource":{"loadInstanceResource":{"memory":0,"cores":0,"instances":0},"yarnResource":{"queueMemory":0,"queueCores":0,"queueInstances":0,"queueName":"dws","applicationId":""}}}DriverAndYarn\N\N2022-11-12 23:30:47hadoop-IDE,spark-2.4.3hadoop-IDE,spark-2.4.3

10. linkis_cg_manager_lock​

通用的用于实现分布式锁

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2lock_objectvarchar(255)UNIYES
3time_outlongtextYES
4update_timedatetimeYESCURRENT_TIMESTAMP
5create_timedatetimeYESCURRENT_TIMESTAMP

11. linkis_cg_manager_metrics_history​

//todo 可以移除？

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2instance_statusint(20)YES
3overloadvarchar(255)YES
4heartbeat_msgvarchar(255)YES
5healthy_statusint(20)YES
6create_timedatetimeYESCURRENT_TIMESTAMP
7creatorvarchar(255)YES
8ticketIDvarchar(255)YES
9serviceNamevarchar(255)YES
10instancevarchar(255)YES

12. linkis_cg_manager_service_instance​

引擎服务实例/引擎资源管理服务实例 信息表

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2instance实例信息 localhost110004:9102varchar(128)UNIYES
3name服务名 linkis-cg-engineconnmanager/linkis-cg-engineconnvarchar(32)YES
4owner服务实例的启动用户varchar(32)YES
5mark//todovarchar(32)YES
6update_timedatetimeYESCURRENT_TIMESTAMP
7create_timedatetimeYESCURRENT_TIMESTAMP
8updatorvarchar(32)YES
9creatorvarchar(32)YES

示例数据

idinstancenameownermarkupdate_timecreate_timeupdatorcreator
121637localhost110004:9102linkis-cg-engineconnmanagerhadoopprocess2022-11-08 09:52:082022-11-08 09:52:08hadoophadoop
121640localhost110002:9102linkis-cg-engineconnmanagerhadoopprocess2022-11-08 09:52:162022-11-08 09:52:16hadoophadoop
121686gz.xg.localhost110001.webank:35932linkis-cg-engineconnneiljianliuprocess2022-11-08 10:40:392022-11-08 10:40:23neiljianliuneiljianliu

索引说明

序号名称描述类型字段
1uniq_instance将instance 列设置为唯一索引UNIQUE KEYinstance

13. linkis_cg_manager_service_instance_metrics​

引擎服务实例/引擎资源管理服务的内存等信息 指标表

序号名称描述类型键为空额外默认值
1instance实例varchar(128)PRINO
2instance_status状态int(11)YES
3overload资源过载情况varchar(255)YES
4heartbeat_msg心跳信息textYES
5healthy_status心跳状态varchar(255)YES
6update_timedatetimeYESCURRENT_TIMESTAMP
7create_timedatetimeYESCURRENT_TIMESTAMP

示例数据

instanceinstance_statusoverloadheartbeat_msghealthy_statusupdate_timecreate_time
localhost110003:91025{"maxMemory":67385790464,"usedMemory":3662913536,"systemCPUUsed":null,"systemLeftMemory":63722876928}{"nodeHealthy":"Healthy","msg":""}2022-11-16 14:29:562022-11-15 15:59:17
localhost110004:107811{"maxMemory":1073741824,"usedMemory":175014896,"systemCPUUsed":6.29,"systemLeftMemory":2746556416}\N{"nodeHealthy":"Healthy","msg":""}2022-11-16 14:30:182022-11-16 11:53:48
localhost110004:128451{"maxMemory":1073741824,"usedMemory":104839664,"systemCPUUsed":6.29,"systemLeftMemory":2800877568}\N{"nodeHealthy":"Healthy","msg":""}2022-11-16 14:30:172022-11-16 12:03:20

14. linkis_cg_rm_external_resource_provider​

资源扩展信息配置表 目前主要用于yarn资源信息的配置

序号名称描述类型键为空额外默认值
1idint(10)PRINOauto_increment
2resource_type资源类型 Yarnvarchar(32)NO
3name名称varchar(32)NO
4labels标签varchar(32)YES
5config连接信息textNO
//默认使用的为default  通过配置项wds.linkis.rm.default.yarn.cluster.name 控制
  val DEFAULT_YARN_CLUSTER_NAME = CommonVars("wds.linkis.rm.default.yarn.cluster.name", "default")
  val DEFAULT_YARN_TYPE = CommonVars("wds.linkis.rm.default.yarn.cluster.type", "Yarn")

示例数据

idresource_typenamelabelsconfig
1Yarnsit\N{"rmWebAddress": "http://127.0.0.1:8088","hadoopVersion": "2.7.2","authorEnable":true,"user":"hadoop","pwd":"123456"}
2YarnDEV\N{"rmWebAddress": "http://127.0.0.1:8088","hadoopVersion": "2.7.2","authorEnable":true,"user":"hadoop","pwd":"123456"}
3YarnPROD\N{"rmWebAddress": "http://127.0.0.1:8088","hadoopVersion": "2.7.2","authorEnable":true,"user":"hadoop","pwd":"123456"}

15. linkis_cg_rm_resource_action_record​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_valuevarchar(100)MULNO
3ticket_idvarchar(100)NO
4request_timesint(8)YES
5request_resource_allvarchar(100)YES
6used_timesint(8)YES
7used_resource_allvarchar(100)YES
8release_timesint(8)YES
9release_resource_allvarchar(100)YES
10update_timedatetimeYESCURRENT_TIMESTAMP
11create_timedatetimeYESCURRENT_TIMESTAMP

示例数据

idlabel_valueticket_idrequest_timesrequest_resource_allused_timesused_resource_allrelease_timesrelease_resource_allupdate_timecreate_time
6leebai-IDE,hive-2.3.30dff1547-6867-4e5c-8baa-4bb561d586e31{"memory":1073741824,"cores":2,"instance":1}0{"memory":0,"cores":0,"instance":0}0{"memory":0,"cores":0,"instance":0}2021-12-30 19:29:212021-12-30 19:29:21
7hadoop-Schedulis,spark-2.4.3e3a1aeeb-c04a-44cb-a94b-d84e54e551851{"memory":2147483648,"cores":1,"instance":1}0{"memory":0,"cores":0,"instance":0}0{"memory":0,"cores":0,"instance":0}2021-12-30 19:47:372021-12-30 19:47:37

16. linkis_mg_gateway_auth_token​

gateway 的token方式认证的 token令牌信息记录表

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2token_nametoken 名varchar(128)UNINO
3legal_users合法可使用用户 * 为所有textYES
4legal_hosts合法可请求的源ip * 为所有textYES
5business_owner业务归属方varchar(32)YES
6create_timedateYES
7update_timedateYES
8elapse_day过期天数 -1 为永久有效bigint(20)YES
9update_byvarchar(32)YES

示例数据

idtoken_namelegal_userslegal_hostsbusiness_ownercreate_timeupdate_timeelapse_dayupdate_by
2BML-AUTH**BDP2021-09-152021-09-15-1LINKIS
3WS-AUTH**BDP2021-09-152021-09-15-1LINKIS
4dss-AUTH**BDP2021-09-152021-09-15-1LINKIS

索引说明

序号名称描述类型字段
1uniq_token_name将token_name 列设置为唯一索引UNIQUE KEYtoken_name

17. linkis_ps_bml_project​

bml 物料管理工程项目记录 主要提供给dss 工程空间的项目列表

序号名称描述类型键为空额外默认值
1idint(10)PRINOauto_increment
2name项目名varchar(128)UNIYES
3system使用系统varchar(64)NOdss
4sourcevarchar(1024)YES
5descriptionvarchar(1024)YES
6creatorvarchar(128)NO
7enabledtinyint(4)YES1
8create_timedatetimeYESCURRENT_TIMESTAMP

示例数据

idnamesystemsourcedescriptioncreatorenabledcreate_time
2524metabase_test_ywz_1234dss\Njinyangrao 在bml创建的工程jinyangrao12022-11-16 09:36:58
2523metabase_test_tjg_345dss\Njinyangrao 在bml创建的工程jinyangrao12022-11-16 09:11:08
2522test_1114_54_copynulldss\Nstacyyan 在bml创建的工程stacyyan12022-11-15 10:44:27

索引说明

序号名称描述类型字段
1uniq_name将name 列设置为唯一索引UNIQUE KEYname

18. linkis_ps_bml_project_resource​

bml项目和对应的资源id关系表

序号名称描述类型键为空额外默认值
1idint(10)PRINOauto_increment
2project_id项目idint(10)NO
3resource_id资源存储的resource idvarchar(128)YES

示例数据

idproject_idresource_id
11103cb0cc-e12b-4c2e-b8de-a8f58ad17d75
2186bcd05d-4ed9-46be-ab26-d8a76433138b
3101697abe-7658-4d3f-b49b-bac4c809a7ba

19. linkis_ps_bml_project_user​

bml项目和用户关系表

序号名称描述类型键为空额外默认值
1idint(10)PRINOauto_increment
2project_id项目idint(10)NO
3usernamevarchar(64)MULYES
4privrwx 421 权限值为7。8为管理员，可以授权其他用户int(10)NO7
5creator创建者varchar(128)NO
6create_timedatetimeYESCURRENT_TIMESTAMP
7expire_timedatetimeYES

示例数据

idproject_idusernameprivcreatorcreate_timeexpire_time
2221jianfuzhang7jianfuzhang2021-05-10 15:20:48\N
2322neiljianliu7neiljianliu2021-05-10 15:26:23\N
2422jianfuzhang5neiljianliu2021-05-10 15:26:23\N

索引说明

序号名称描述类型字段
1uniq_name_pid将username, project_id 列设置为唯一索引UNIQUE KEYusername, project_id

20. linkis_ps_bml_resources​

bml 物料资源存储信息表

序号名称描述类型键为空额外默认值
1idPrimary keybigint(20)PRINOauto_increment
2resource_id资源的 uuidvarchar(50)NO
3is_private资源是否私有，0表示私有，1表示公共tinyint(1)YES0
4resource_header分类，0表示未分类，1表示分类tinyint(1)YES0
5downloaded_file_name下载时的文件名varchar(200)YES
6sys归属系统varchar(100)NO
7create_time创建时间datetimeNOCURRENT_TIMESTAMP
8owner资源所有则varchar(200)NO
9is_expire是否过期，0表示未过期，1表示过期tinyint(1)YES0
10expire_type到期类型，date指的是在指定的日期到期，TIME指的是时间varchar(50)YES
11expire_time过期时间，默认一天varchar(50)YES
12max_version默认为10，表示保留最新的10个版本int(20)YES10
13update_timeUpdated timedatetimeNOCURRENT_TIMESTAMP
14updatorupdatorvarchar(50)YES
15enable_flag状态，1：正常，0：冻结tinyint(1)NO1

示例数据

idresource_idis_privateresource_headerdownloaded_file_namesyscreate_timeowneris_expireexpire_typeexpire_timemax_versionupdate_timeupdatorenable_flag
33280072eac098-0d71-42c9-962c-e9580ac5ac0b1\N72eac098-0d71-42c9-962c-e9580ac5ac0bWTSS2022-07-27 09:47:06hadoop0\N\N102022-07-27 09:47:06\N1
398336273611e6-e1be-480e-8556-c2534910e8551\N273611e6-e1be-480e-8556-c2534910e855WTSS2022-07-29 06:31:44hadoop0\N\N102022-07-29 06:31:44\N1
463872a111ab00-bafd-4341-a17b-ab9101970abd1\Na111ab00-bafd-4341-a17b-ab9101970abdWTSS2022-08-03 06:18:32hadoop0\N\N102022-08-03 06:18:32\N1

21. linkis_ps_bml_resources_permission​

// todo 未使用？

序号名称描述类型键为空额外默认值
1idPrimary keybigint(20)PRINOauto_increment
2resource_idResource uuidvarchar(50)NO
3permissionpermissionvarchar(10)NO
4create_timecreated timedatetimeNOCURRENT_TIMESTAMP
5systemcreatorvarchar(50)YESdss
6update_timeupdated timedatetimeNOCURRENT_TIMESTAMP
7updatorupdatorvarchar(50)NO

22. linkis_ps_bml_resources_task​

bml 物料资源操作记录表

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2resource_id资源uuidvarchar(50)YES
3version当前操作的资源版本号varchar(20)YES
4operation操作类型。 上传 = 0，更新 = 1varchar(20)NO
5state任务当前状态:Schduled, Running, Succeed, Failed,Cancelledvarchar(20)NOSchduled
6submit_user作业提交用户名varchar(20)NO
7system系统名称 如: wtssvarchar(20)YESdss
8instance提供服务的实例varchar(128)NO
9client_ip请求方ipvarchar(50)YES
10extra_params附加关键信息。 比如批量删除的资源ID和版本，资源下的所有版本都被删除textYES
11err_msg任务失败信息。e.getMessagevarchar(2000)YES
12start_time开始时间datetimeNOCURRENT_TIMESTAMP
13end_time结束时间datetimeYES
14last_update_time最后更新时间datetimeNO

示例数据

idresource_idversionoperationstatesubmit_usersysteminstanceclient_ipextra_paramserr_msgstart_timeend_timelast_update_time
183039873513f8-9ad0-4473-b7b9-1cc2500abab7\NcopyResourcesuccessstacyyan\Nlocalhost11ide01:9107127.0.0.1\N\N2022-03-24 20:11:182022-03-24 20:11:192022-03-24 20:11:19
2598467ae110d2-5649-4c57-9e4c-b48bb62f3382\NdeleteResourcesuccessstacyyanWTSSlocalhost11ide01:9107127.0.0.1delete resourceId:7ae110d2-5649-4c57-9e4c-b48bb62f3382, and delete versions is :v000001\N2022-06-01 14:38:422022-06-01 14:38:432022-06-01 14:38:43
125518678bbd5-cfc7-411b-a838-1b145dab8473\NdeleteResourcesuccessneiljianliuWTSSlocalhost11ide01:9107127.0.0.1delete resourceId:8678bbd5-cfc7-411b-a838-1b145dab8473, and delete versions is :v000001\N2021-07-16 14:47:152021-07-16 14:47:152021-07-16 14:47:15
36360eadc8908-e00c-4604-ab30-6671f33e753e\NdeleteResourcesuccessneiljianliuWTSSlocalhost11ide01:9107127.0.0.1delete resourceId:eadc8908-e00c-4604-ab30-6671f33e753e, and delete versions is :v000001\N2021-10-26 17:46:152021-10-26 17:46:152021-10-26 17:46:15
549888dfbd7603-d513-413a-b491-d79a62a25407v000001uploadsuccesshadoopdsslocalhost11ide01:9107127.0.0.1\N\N2022-07-29 00:26:432022-07-29 00:26:432022-07-29 00:26:43
51775ba304c46-ab63-404e-b2aa-69f522ef3baav000004rollbackVersionsuccessjohnnwang\Nlocalhost11ide01:9107127.0.0.1\N\N2021-11-27 17:04:282021-11-27 17:04:282021-11-27 17:04:28
28d07d8636-5415-418f-9aff-dde1b3a69569v000005updatesuccesshadoopWTSSlocalhost11ide01:9107127.0.0.1\N\N2021-04-29 14:24:362021-04-29 14:24:362021-04-29 14:24:36

23. linkis_ps_bml_resources_version​

资源和对应的版本信息关联表

序号名称描述类型键为空额外默认值
1idPrimary keybigint(20)PRINOauto_increment
2resource_id资源uuidvarchar(50)MULNO
3file_md5文件的md5摘要varchar(32)NO
4version资源版本（v 后面加五位数字）varchar(20)NO
5size文件大小int(10)NO
6start_byte开始字节bigint(20) unsignedNO0
7end_byte结束字节bigint(20) unsignedNO0
8resource资源内容（文件信息包括路径和文件名）varchar(2000)NO
9description说明varchar(2000)YES
10start_time开始时间datetimeNOCURRENT_TIMESTAMP
11end_time停止时间datetimeNOCURRENT_TIMESTAMP
12client_ip客户端ipvarchar(200)NO
13updatorupdatorvarchar(50)YES
14enable_flag状态，1：正常，0：冻结tinyint(1)NO1

示例数据

idresource_idfile_md5versionsizestart_byteend_byteresourcedescriptionstart_timeend_timeclient_ipupdatorenable_flag
1863846e2-bd31-49ba-babe-9a2b96616d71b8fd956fd8f83d09d203bf9e4b40543fv000001166811668hdfs:///apps-data/hadoop/bml/20210429/863846e2-bd31-49ba-babe-9a2b96616d71\N2021-04-29 12:21:072021-04-29 12:21:07127.0.0.1\N1
29d39cb8e-1447-46d5-a11d-b597b2e3200f46bf4ff26651c448efb85ffa9c54907fv00000158965932158965932hdfs:///apps-data/hadoop/bml/20210429/9d39cb8e-1447-46d5-a11d-b597b2e3200f\N2021-04-29 12:21:102021-04-29 12:21:10127.0.0.1\N1
3bc620bfd-d3f4-4fa5-84f7-1c484fac22418e13ba687fa1ee04e113bff50290a5c6v000001174511745hdfs:///apps-data/hadoop/bml/20210429/bc620bfd-d3f4-4fa5-84f7-1c484fac2241\N2021-04-29 12:21:142021-04-29 12:21:14127.0.0.1\N1

索引说明

序号名称描述类型字段
1uniq_rid_version将resource_id, version 列设置为唯一索引UNIQUE KEYresource_id, version

24. linkis_ps_common_lock​

通用的用于实现分布式锁

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2lock_objectvarchar(255)UNIYES
3time_outlongtextYES
4update_timedatetimeYESCURRENT_TIMESTAMP
5create_timedatetimeYESCURRENT_TIMESTAMP

25. linkis_ps_configuration_category​

参数配置目录树表 对应于管理台的参数配置页面

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_idlinkis_cg_manager_label 标签的idint(20)UNINO
3level1为应用类型级别 2 为引擎类型级别int(20)NO
4descriptionvarchar(200)YES
5tagvarchar(200)YES
6update_timedatetimeNOCURRENT_TIMESTAMP
7create_timedatetimeNOCURRENT_TIMESTAMP

索引说明

序号名称描述类型字段
1uniq_lock_object将lock_object 列设置为唯一索引UNIQUE KEYlock_object

示例数据

idlabel_idleveldescriptiontagupdate_timecreate_time
101465861\N2021-08-19 20:07:092021-08-19 20:07:09
102465872\N2021-08-19 20:07:202021-08-19 20:07:20
103473401\N2021-08-23 10:50:022021-08-23 10:50:02

索引说明

序号名称描述类型字段
1uniq_label_id将label_id 列设置为唯一索引UNIQUE INDEXlabel_id

26. linkis_ps_configuration_config_key​

引擎相关参数的配置表

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2key配置项的key 如 spark.executor.instancesvarchar(50)YES
3description描述varchar(200)YES
4name名称varchar(50)YES
5default_value当用户未进行设置时，使用默认值varchar(200)YES
6validate_type验证类型，以下之一：None、NumInterval、FloatInterval、Include、Regex、OPF、Custom Rulesvarchar(50)YES
7validate_range验证范围varchar(50)YES
8engine_conn_type引擎类型，如 spark、hive 等varchar(50)YES
9is_hidden是否对用户隐藏。 如果设置为 1(true)，则用户不能修改，但仍然可以在后端使用tinyint(1)YES
10is_advanced是否为高级参数。 如果设置为 1(true)，参数将仅在用户选择【显示高级参数】时显示tinyint(1)YES
11level前端显示排序的依据。 级别越高，参数优先显示tinyint(1)YES
12treeName配置项的engineType的子目录分类varchar(20)YES

示例数据

idkeydescriptionnamedefault_valuevalidate_typevalidate_rangeengine_conn_typeis_hiddenis_advancedleveltreeName
1wds.linkis.rm.yarnqueueyarn队列名yarn队列名defaultNone\N\N001队列资源
2wds.linkis.rm.yarnqueue.instance.max取值范围：1-128，单位：个yarn队列实例最大个数30Regex^(?:[1-9]\d?[1234]\d{2}200)$\N10
3wds.linkis.rm.yarnqueue.cores.max取值范围：1-1500，单位：个队列CPU使用上限150Regex^(?:[1-9]\d{0,2}1[0-4]\d{2}1500)$\N00
4wds.linkis.rm.yarnqueue.memory.max取值范围：1-5000，单位：G队列内存使用上限300GRegex^([1-9]\d{0,2}[1-4]\d{3}5000)(Gg)$\N0

27. linkis_ps_configuration_config_value​

参数配置项key对应的配置值表

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2config_key_idlinkis_ps_configuration_config_key的idbigint(20)MULYES
3config_value设置的值varchar(200)YES
4config_label_id对应的linkis_cg_manager_label 的idint(20)YES
5update_timedatetimeNOCURRENT_TIMESTAMP
6create_timedatetimeNOCURRENT_TIMESTAMP

示例数据

idconfig_key_idconfig_valueconfig_label_idupdate_timecreate_time
571dws257162022-04-08 16:35:372021-06-08 16:07:49
6130python2308192022-07-04 11:17:252021-06-08 16:35:23
621dws5192022-11-07 19:13:292021-06-08 17:19:44
6419python233002022-08-09 17:38:152021-06-08 20:15:04
65550G13482022-05-16 15:39:442021-06-10 17:55:11

索引说明

序号名称描述类型字段
1uniq_kid_lid将 config_key_id, config_label_id 列设置为唯一索引UNIQUE INDEXconfig_key_id, config_label_id

28. linkis_ps_configuration_key_engine_relation​

配置项和引擎的关联关系，设置引擎配置参数模板

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2config_key_idconfig key idbigint(20)MULNO
3engine_type_label_id对应的linkis_cg_manager_label 的idbigint(20)NO

示例数据

idconfig_key_idengine_type_label_id
115
73146586
80147340
225
74246586
81247340

索引说明

序号名称描述类型字段
1uniq_kid_lid将config_key_id, engine_type_label_id 列设置为唯一索引UNIQUE INDEXconfig_key_id, engine_type_label_id

29. linkis_ps_cs_context_history​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2context_idint(11)YES
3sourcetextYES
4context_typevarchar(32)YES
5history_jsontextYES
6keywordvarchar(255)MULYES
7update_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP
8create_timecreate timedatetimeNOCURRENT_TIMESTAMP
9access_timelast access timedatetimeNOCURRENT_TIMESTAMP

索引说明

序号名称描述类型字段
1idx_keyword将keyword 列设置为普通索引INDEXkeyword

30. linkis_ps_cs_context_id​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2uservarchar(32)YES
3applicationvarchar(32)YES
4sourcevarchar(255)YES
5expire_typevarchar(32)YES
6expire_timedatetimeYES
7instancevarchar(128)MULYES
8backup_instancevarchar(255)MULYES
9update_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP
10create_timecreate timedatetimeNOCURRENT_TIMESTAMP
11access_timelast access timedatetimeNOCURRENT_TIMESTAMP

示例数据

iduserapplicationsourceexpire_typeexpire_timeinstancebackup_instanceupdate_timecreate_timeaccess_time
62131jinyangrao\N{"className":"org.apache.linkis.cs.common.entity.source.LinkisHAWorkFlowContextID","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}\N\Ncs_1_devcs_1_dev2022-11-16 14:48:582022-11-16 14:48:582022-11-16 14:48:58
62126alexwu\N{"className":"org.apache.linkis.cs.common.entity.source.LinkisHAWorkFlowContextID","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}\N\Ncs_1_devcs_1_dev2022-11-16 14:45:492022-11-16 14:45:492022-11-16 14:45:49
62122stacyyan\N{"className":"org.apache.linkis.cs.common.entity.source.LinkisHAWorkFlowContextID","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}\N\Ncs_2_devcs_1_dev2022-11-16 14:43:542022-11-16 14:43:542022-11-16 14:43:54
62120alexwu\N{"className":"org.apache.linkis.cs.common.entity.source.LinkisHAWorkFlowContextID","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}\N\Ncs_2_devcs_1_dev2022-11-16 14:32:162022-11-16 14:32:162022-11-16 14:32:16

索引说明

序号名称描述类型字段
1idx_instance将instance 列设置为普通索引INDEXinstance
2idx_backup_instance将backup_instance 列设置为普通索引INDEXbackup_instance
3idx_instance_bin将instance(128),backup_instance 列设置为普通索引INDEXinstance(128),backup_instance

31. linkis_ps_cs_context_listener​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2listener_sourcevarchar(255)YES
3context_idint(11)YES
4update_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP
5create_timecreate timedatetimeNOCURRENT_TIMESTAMP
6access_timelast access timedatetimeNOCURRENT_TIMESTAMP

32. linkis_ps_cs_context_map​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2keyvarchar(128)MULYES
3context_scopevarchar(32)YES
4context_typevarchar(32)YES
5propstextYES
6valuemediumtextYES
7context_idint(11)YES
8keywordsvarchar(255)MULYES
9update_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP
10create_timecreate timedatetimeNOCURRENT_TIMESTAMP
11access_timelast access timedatetimeNOCURRENT_TIMESTAMP

示例数据

idkeycontext_scopecontext_typepropsvaluecontext_idkeywordsupdate_timecreate_timeaccess_time
45node.sql_1742.jobIDPUBLICDATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisJobData","value":"{\"jobID\":3735}"}1["node.sql_1742.jobID"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
51node.widget_1508.jobIDPUBLICDATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisJobData","value":"{\"jobID\":5167}"}1["node.widget_1508.jobID"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
170node.display_3009.jobIDPUBLICDATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisJobData","value":"{\"jobID\":3738}"}1["node.display_3009.jobID"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
172node.dashboard_7941.jobIDPUBLICDATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisJobData","value":"{\"jobID\":3740}"}1["node.dashboard_7941.jobID"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
166node.sql_1742.table.cs_tmp_sql_1742_rs1PUBLICMETADATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"CSTable","value":"{\"name\":\"cs_tmp_sql_1742_rs1\",\"alias\":null,\"creator\":\"jianfuzhang\",\"comment\":\"cs temp table\",\"createTime\":\"2021-05-15T19:18:05+0800\",\"productName\":null,\"projectName\":null,\"usage\":null,\"lifecycle\":null,\"useWay\":null,\"isImport\":false,\"modelLevel\":null,\"isExternalUse\":true,\"isPartitionTable\":false,\"isAvailable\":true,\"isView\":true,\"location\":\"hdfs:///tmp/linkis/jianfuzhang/linkis/20210515_191700/nodeexecution/3735/_0.dolphin\",\"columns\":[{\"name\":\"id\",\"alias\":null,\"type\":\"int\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"name\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"sex\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"age\",\"alias\":null,\"type\":\"int\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"class\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"lesson\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"city\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"teacher\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"score\",\"alias\":null,\"type\":\"double\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"fee\",\"alias\":null,\"type\":\"double\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"birthday\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"exam_date\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null}],\"partitions\":null,\"db\":null}"}1["cs_tmp_sql_1742_rs1","hdfs:///tmp/linkis/jianfuzhang/linkis/20210515_191700/nodeexecution/3735/_0.dolphin","node.sql_1742.table.cs_tmp_sql_1742_rs1"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
1744node.widget_1508.table.cs_tmp_widget_1508_rs1PUBLICMETADATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"CSTable","value":"{\"name\":\"cs_tmp_widget_1508_rs1\",\"alias\":null,\"creator\":\"jianfuzhang\",\"comment\":\"cs temp table\",\"createTime\":\"2021-05-18T11:38:47+0800\",\"productName\":null,\"projectName\":null,\"usage\":null,\"lifecycle\":null,\"useWay\":null,\"isImport\":false,\"modelLevel\":null,\"isExternalUse\":true,\"isPartitionTable\":false,\"isAvailable\":true,\"isView\":true,\"location\":\"hdfs:///tmp/linkis/jianfuzhang/linkis/20210518_113844/nodeexecution/5167/_0.dolphin\",\"columns\":[{\"name\":\"birthday\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null}],\"partitions\":null,\"db\":null}"}1["hdfs:///tmp/linkis/jianfuzhang/linkis/20210518_113844/nodeexecution/5167/_0.dolphin","cs_tmp_widget_1508_rs1","node.widget_1508.table.cs_tmp_widget_1508_rs1"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
173flow.variable.user.to.proxyPUBLICOBJECT{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisVariable","value":"{\"key\":\"user.to.proxy\",\"value\":\"jianfuzhang\"}"}1["user.to.proxy","flow.variable.user.to.proxy"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
174flow.infosPUBLICOBJECT{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"CSFlowInfos","value":"{\"infos\":{\"parent\":\"null\",\"id_nodeName\":{\"3c72ebe1-6fa1-4093-9da6-c3d8b0fe26f1\":\"sql_1742\",\"a1dfd377-32a1-4b34-b70c-7123a9890bd8\":\"widget_1508\",\"fa7334ed-5811-48a4-9a26-7498e83348dd\":\"display_3009\",\"c5cc7633-a3ef-42dc-8103-550ca4a3d3ce\":\"dashboard_7941\"},\"edges\":[{\"source\":\"3c72ebe1-6fa1-4093-9da6-c3d8b0fe26f1\",\"target\":\"a1dfd377-32a1-4b34-b70c-7123a9890bd8\",\"sourceLocation\":\"bottom\",\"targetLocation\":\"top\"},{\"source\":\"a1dfd377-32a1-4b34-b70c-7123a9890bd8\",\"target\":\"fa7334ed-5811-48a4-9a26-7498e83348dd\",\"sourceLocation\":\"bottom\",\"targetLocation\":\"top\"},{\"source\":\"fa7334ed-5811-48a4-9a26-7498e83348dd\",\"target\":\"c5cc7633-a3ef-42dc-8103-550ca4a3d3ce\",\"sourceLocation\":\"bottom\",\"targetLocation\":\"top\"}]}}"}1["flow.infos"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
42node.sql_1742.resource.3c72ebe1-6fa1-4093-9da6-c3d8b0fe26f1.sqlPUBLICRESOURCE{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"linkisBMLResource","value":"{\"resourceId\":\"850d6dc7-4489-4b06-90f4-1d2b5b65d0b7\",\"version\":\"v000001\",\"isPrivate\":null,\"resourceHeader\":null,\"downloadedFileName\":\"3c72ebe1-6fa1-4093-9da6-c3d8b0fe26f1.sql\",\"sys\":null,\"createTime\":null,\"isExpire\":null,\"expireType\":null,\"expireTime\":null,\"updateTime\":null,\"updator\":null,\"maxVersion\":null,\"user\":null,\"system\":null,\"enableFlag\":null}"}1["v000001","3c72ebe1-6fa1-4093-9da6-c3d8b0fe26f1.sql","850d6dc7-4489-4b06-90f4-1d2b5b65d0b7","node.sql_1742.resource.3c72ebe1-6fa1-4093-9da6-c3d8b0fe26f1.sql"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
79flow.infosPUBLICRESOURCE{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"CSFlowInfos","value":"{\"infos\":{\"parent\":\"flow2\",\"id_nodeName\":{\"90a6ee94-4bd6-47d9-a536-f92660c4c051\":\"sql\",\"90a6ee94-4bd6-47d9-a536-f92660c4c052\":\"hql\"},\"edges\":[{\"sourceLocation\":\"bottom\",\"source\":\"sql \",\"targetLocation\":\"top\",\"target\":\"hql\"}]}}"}2["flow.infos"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
199node.sql_3999.jobIDPUBLICDATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisJobData","value":"{\"jobID\":344064}"}3["node.sql_3999.jobID"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
210node.widget_654.jobIDPUBLICDATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisJobData","value":"{\"jobID\":3808}"}3["node.widget_654.jobID"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
31327node.sql_3999.table.cs_tmp_sql_3999_rs1PUBLICMETADATA{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"CSTable","value":"{\"name\":\"cs_tmp_sql_3999_rs1\",\"alias\":null,\"creator\":\"hadoop\",\"comment\":\"cs temp table\",\"createTime\":\"2021-07-28T17:55:56+0800\",\"productName\":null,\"projectName\":null,\"usage\":null,\"lifecycle\":null,\"useWay\":null,\"isImport\":false,\"modelLevel\":null,\"isExternalUse\":true,\"isPartitionTable\":false,\"isAvailable\":true,\"isView\":true,\"location\":\"hdfs:///apps-data/hadoop/linkis/20210728_175555/nodeexecution/344064/_0.dolphin\",\"columns\":[{\"name\":\"database\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"tableName\",\"alias\":null,\"type\":\"string\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null},{\"name\":\"isTemporary\",\"alias\":null,\"type\":\"boolean\",\"comment\":null,\"express\":null,\"rule\":null,\"isPrimary\":null,\"length\":null}],\"partitions\":null,\"db\":null}"}3["node.sql_3999.table.cs_tmp_sql_3999_rs1","hdfs:///apps-data/hadoop/linkis/20210728_175555/nodeexecution/344064/_0.dolphin","cs_tmp_sql_3999_rs1"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
31325flow.variable.user.to.proxyPUBLICOBJECT{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"LinkisVariable","value":"{\"key\":\"user.to.proxy\",\"value\":\"alexyang\"}"}3["user.to.proxy","flow.variable.user.to.proxy"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42
31326flow.infosPUBLICOBJECT{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKeyValue","subs":[{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextKey","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]},{"className":"com.webank.wedatasphere.linkis.cs.common.entity.source.CommonContextValue","subs":[],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}],"fieldNames":[],"fieldValues":[],"fieldTypes":[]}{"type":"CSFlowInfos","value":"{\"infos\":{\"parent\":\"null\",\"id_nodeName\":{\"b08c3f5e-f5d7-4209-866b-f4f963196b3d\":\"sql_3999\",\"4b9b446b-304d-451f-90b6-67d9ad5d3e49\":\"widget_654\"},\"edges\":[{\"source\":\"b08c3f5e-f5d7-4209-866b-f4f963196b3d\",\"target\":\"4b9b446b-304d-451f-90b6-67d9ad5d3e49\",\"sourceLocation\":\"right\",\"targetLocation\":\"left\"}]}}"}3["flow.infos"]2022-06-01 11:38:302022-06-01 11:38:322022-06-06 15:37:42

索引说明

序号名称描述类型字段
1uniq_key_cid_ctype将key,context_id,context_type列设置为唯一索引UNIQUE INDEXkey,context_id,context_type
2idx_keywords将keywords列设置为普通索引INDEXkeywords

33. linkis_ps_cs_context_map_listener​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2listener_sourcevarchar(255)YES
3key_idint(11)YES
4update_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP
5create_timecreate timedatetimeNOCURRENT_TIMESTAMP
6access_timelast access timedatetimeNOCURRENT_TIMESTAMP

34. linkis_ps_datasource_access​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2table_idbigint(20)NO
3visitorvarchar(16)NO
4fieldsvarchar(255)YES
5application_idint(4)NO
6access_timedatetimeNO

35. linkis_ps_datasource_field​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2table_idbigint(20)NO
3namevarchar(64)NO
4aliasvarchar(64)YES
5typevarchar(64)NO
6commentvarchar(255)YES
7expressvarchar(255)YES
8rulevarchar(128)YES
9is_partition_fieldtinyint(1)NO
10is_primarytinyint(1)NO
11lengthint(11)YES

示例数据

idtable_idnamealiastypecommentexpressruleis_partition_fieldis_primarylengthmode_info
4396216dsstring\N\N108\N
4395216bstring\N00\N\N
4394216astring\N00\N\N
4393215dsstring\N\N108\N
4392215col_3string00\N\N
4391215col_2string00\N\N
4390215col_1string00\N\N

36. linkis_ps_datasource_import​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2table_idbigint(20)NO
3import_typeint(4)NO
4argsvarchar(255)NO

示例数据

idtable_idimport_typeargs
942151{"exportPath":"/mnt/bdap/stacyyan/aa/aaa125.csv","type":"share","separator":",","chartset":"utf-8","quote":"","isHasHeader":"false"}
932140{"database":"stacyyan_ind","table":"00153d26da1a11eb8c30813d0f05b1af1"}
922132{"exportPath":"/mnt/bdap/stacyyan/aa/studentInfo.xlsx","type":"share","isHasHeader":"false"}
881701{"exportPath":"/mnt/bdap/janicegong/file测试/上传文件/orc.csv","type":"share","separator":",","chartset":"utf-8","quote":"","isHasHeader":"false"}
871691{"exportPath":"/mnt/bdap/johnnwang/test1_hql__1652150994191.csv","type":"share","separator":",","chartset":"utf-8","quote":"","isHasHeader":"false"}

37. linkis_ps_datasource_lineage​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2table_idbigint(20)YES
3source_tablevarchar(64)YES
4update_timedatetimeYES

示例数据

idtable_idsource_tableupdate_time
40214stacyyan_ind.00153d26da1a11eb8c30813d0f05b1af12022-11-08 21:14:41
39162janicegong_ind.aa2022-09-04 17:28:46
38156jin_ind.test_0902j2022-09-02 19:47:20

38. linkis_ps_datasource_table​

序号名称描述类型键为空额外默认值
1idbigint(255)PRINOauto_increment
2databasevarchar(64)MULNO
3namevarchar(64)NO
4aliasvarchar(64)YES
5creatorvarchar(16)NO
6commentvarchar(255)YES
7create_timedatetimeNO
8product_namevarchar(64)YES
9project_namevarchar(255)YES
10usagevarchar(128)YES
11lifecycleint(4)NO
12use_wayint(4)NO
13is_importtinyint(1)NO
14model_levelint(4)NO
15is_external_usetinyint(1)NO
16is_partition_tabletinyint(1)NO
17is_availabletinyint(1)NO

示例数据

iddatabasenamealiascreatorcommentcreate_timeproduct_nameproject_nameusagelifecycleuse_wayis_importmodel_levelis_external_useis_partition_tableis_available
216stacyyan_indaa_1109表别名_1109stacyyan2022-11-09 16:15:030000011
215jin_indtest_1109aaatest_1109aaastacyyan2022-11-09 09:51:410010011
214stacyyan_indtest_1108artest_1108arstacyyan2022-11-08 21:14:410010011

索引说明

序号名称描述类型字段
1uniq_db_name将database,name 列设置为唯一索引UNIQUE INDEXdatabase,name

39. linkis_ps_datasource_table_info​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2table_idbigint(20)NO
3table_last_update_timedatetimeNO
4row_numbigint(20)NO
5file_numint(11)NO
6table_sizevarchar(32)NO
7partitions_numint(11)NO
8update_timedatetimeNO
9field_numint(11)NO

40. linkis_ps_dm_datasource​

配置的数据源信息表

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2datasource_name数据源名称varchar(255)NO
3datasource_desc数据源描述varchar(255)YES
4datasource_type_id数据源类型ID linkis_ps_dm_datasource_type对应的idint(11)NO
5create_identify标识varchar(255)YES
6create_system创建数据源的系统varchar(255)YES
7parameter数据源参数,注意 不做存储，实体类parameter字段通过linkis_ps_dm_datasource_version的parameter获取varchar(255)YES
8create_timedatetimeYESCURRENT_TIMESTAMP
9modify_timedatetimeYESCURRENT_TIMESTAMP
10create_uservarchar(255)YES
11modify_uservarchar(255)YES
12labels数据源标签varchar(255)YES
13version_id数据源版本IDint(11)YES
14expire数据源是否过期tinyint(1)YES0
15published_version_id数据源发布版本号int(11)YES

示例数据

iddatasource_namedatasource_descdatasource_type_idcreate_identifycreate_systemparametercreate_timemodify_timecreate_usermodify_userlabelsversion_idexpirepublished_version_id
243mongodb_test_20221020101428create6\NLinkis{"dataSourceTypeId":"6","host":"127.0.0.1","port":"20500","params":"{\"connectTimeout\":\"100\"}","database":"dpvcs-dev","username":"dpvcsopr","password":"dpvcsopr"}2022-10-20 10:14:362022-10-20 10:14:36janicegong\Nauto_test20220801201
244elasticsearch_test__20221020101428create7\NLinkis{"dataSourceTypeId":"7","username":"test","password":"123456","elasticUrls":"[\"http://127.0.0.1:9101\"]"}2022-10-20 10:14:382022-10-20 10:14:38janicegong\Nauto_test20220801211
245mysql_test_1027mysql1MYSQL{"host":"127.0.0.1","port":"15304","params":"{\"tinyInt1isBit\":\"false\"}","username":"test","password":"123456"}2022-10-27 20:35:052022-10-27 20:35:05stacyyan\Ndemo，勿删101
246hive_test_sitdemo，勿删4HIVE{"envId":"2"}2022-10-27 20:35:552022-10-27 20:35:55stacyyan\N101

41. linkis_ps_dm_datasource_env​

数据源环境信息 主要用户hive类型数据源的配置 通过hive集群环境进行数据源连接配置的选择

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2env_name环境名varchar(32)NO
3env_desc环境描述varchar(255)YES
4datasource_type_id数据源类型ID linkis_ps_dm_datasource_type对应的idint(11)NO
5parameter数据源环境参数varchar(255)YES
6create_timedatetimeNOCURRENT_TIMESTAMP
7create_uservarchar(255)YES
8modify_timedatetimeNOCURRENT_TIMESTAMP
9modify_uservarchar(255)YES

示例数据

idenv_nameenv_descdatasource_type_idparametercreate_timecreate_usermodify_timemodify_user
1BDP-UATBDP-UAT测试环境4{"uris":"thrift://localhost100001:9083", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}2022-04-12 22:34:11\N2022-04-12 22:34:11\N
2BDAP-UATBDAP-UAT测试环境4{"uris":"thrift://localhost110001:9083", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}2022-04-12 22:34:11\N2022-04-12 22:34:11\N

索引说明

序号名称描述类型字段
1uniq_env_name将env_name 列设置为唯一索引UNIQUE KEYenv_name
2uniq_name_dtid将env_name, datasource_type_id 列设置为唯一索引UNIQUE INDEXenv_name, datasource_type_id

42. linkis_ps_dm_datasource_type​

数据源类型表

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2name数据源类型名称varchar(32)NO
3description数据源类型描述varchar(255)YES
4option数据源所属类型varchar(32)YES
5classifier数据源类型分类词varchar(32)NO
6icon数据源图片显示路径varchar(255)YES
7layers数据源类型层次int(3)NO

示例数据

idnamedescriptionoptionclassifiericonlayers
1mysqlmysql数据库mysql数据库关系型数据库(Relational DB)3
2kafkakafkakafka消息队列(Message DB)2
3prestopresto SQLpresto大数据存储(BigData)3
4hivehive数据库hive大数据存储(BigData)3
6mongodbmongodb 数据源mongodb半结构化数据库\N3
7elasticsearchES descriptiones无结构存储分布式全文索引\N3
8oracleThis is oracle datasourceoracle关系型数据库关系型数据库\N3

43. linkis_ps_dm_datasource_type_key​

不同数据源类型所需要进行配置的参数

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2data_source_type_id数据源类型ID linkis_ps_dm_datasource_type对应的idint(11)NO
3key数据源参数key值varchar(32)NO
4name数据源参数名称 用于前端展示varchar(32)NO
5name_en数据源参数名称 英文 用于前端展示varchar(32)NO
6default_value数据源参数默认值varchar(50)YES
7value_type数据源参数类型varchar(50)NO
8scope数据源参数范围 一般未使用到varchar(50)YES
9require数据源参数是否必须tinyint(1)YES0
10description数据源参数描述 用于前端展示varchar(200)YES
11description_en数据源参数描述 英文 用于前端展示varchar(200)YES
12value_regex数据源参数正则varchar(200)YES
13ref_idbigint(20)YES
14ref_valuevarchar(50)YES
15data_source数据来源 可以从是一个接口获取varchar(200)YES
16update_timedatetimeNOCURRENT_TIMESTAMP
17create_timedatetimeNOCURRENT_TIMESTAMP

示例数据

iddata_source_type_idkeynamedefault_valuevalue_typescoperequiredescriptionvalue_regexref_idref_valuedata_sourceupdate_timecreate_time
11hostHost\NTEXT\N1mysql Host\N\N\N\N2022-04-12 22:34:112022-04-12 22:34:11
21port端口\NTEXT\N1端口\N\N\N\N2022-04-12 22:34:112022-04-12 22:34:11
31params连接参数\NTEXT\N0输入JSON格式: {"param":"value"}\N\N\N\N2022-04-12 22:34:112022-04-12 22:34:11
41username用户名\NTEXT\N1用户名^[0-9A-Za-z_-]+$\N\N\N2022-04-12 22:34:112022-04-12 22:34:11
51password密码\NPASSWORD\N1密码\N\N\N2022-04-12 22:34:112022-04-12 22:34:11
64envId集群环境\NSELECT\N1集群环境\N\N\N/data-source-manager/env-list/all/type/42022-04-12 22:34:112022-04-12 22:34:11

索引说明

序号名称描述类型字段
1uniq_dstid_key将data_source_type_id, key 列设置为唯一索引UNIQUE KEYdata_source_type_id, key

44. linkis_ps_dm_datasource_version​

数据源版本信息表

序号名称描述类型键为空额外默认值
1version_id数据源版本IDint(11)PRINOauto_increment
2datasource_id数据源ID linkis_ps_dm_datasourc 对应的idint(11)PRINO
3parameter数据源该版本参数varchar(2048)YES
4commentvarchar(255)YES
5create_timedatetimeYESCURRENT_TIMESTAMP
6create_uservarchar(255)YES

示例数据

version_iddatasource_idparametercommentcreate_timecreate_user
141{"envId":"2"}初始化版本2022-05-25 12:26:44neiljianliu
142{"password":"1234123213","subSystem":"","port":"123","appid":null,"host":"123","authType":null,"objectid":null,"username":"123","mkPrivate":null,"timestamp":null}qualitis2022-05-27 19:56:41allenzhou
143{"host":"333","port":"333","username":"333","password":"1234123213"}初始化版本2022-05-30 12:31:42janicegong

45. linkis_ps_error_code​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2error_codevarchar(50)NO
3error_descvarchar(1024)NO
4error_regexvarchar(1024)YES
5error_typeint(3)YES0

示例数据

iderror_codeerror_descerror_regexerror_type
101001您的任务没有路由到后台ECM，请联系管理员The em of labels0
201002Linkis服务负载过高，请联系管理员扩容Unexpected end of file from server0
301003Linkis服务负载过高，请联系管理员扩容failed to ask linkis Manager Can be retried SocketTimeoutException0
401004引擎在启动时被Kill，请联系管理员[0-9]+ Killed0

46. linkis_ps_instance_info​

序号名称描述类型键为空额外默认值
1idint(11)PRINOauto_increment
2instancestructure like ${host|machine}:${port}varchar(128)UNIYES
3nameequal application name in registryvarchar(128)YES
4update_timeupdate unix timestampdatetimeYESCURRENT_TIMESTAMP
5create_timecreate unix timestampdatetimeYESCURRENT_TIMESTAMP

索引说明

序号名称描述类型字段
1uniq_instance将instance 列设置为唯一索引UNIQUE KEYinstance

47. linkis_ps_instance_label​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_keystring keyvarchar(32)MULNO
3label_valuestring valuevarchar(255)NO
4label_featurestore the feature of label, but it may be redundantvarchar(16)NO
5label_value_sizesize of key -> value mapint(20)NO
6update_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP
7create_timeupdate unix timestampdatetimeNOCURRENT_TIMESTAMP

示例数据

idlabel_keylabel_valuelabel_featurelabel_value_sizeupdate_timecreate_time
68routeofflineOPTIONAL02022-11-15 12:51:482022-11-08 21:58:36
64routecs_1_devOPTIONAL02022-11-08 09:51:262022-02-16 17:28:31
5routecs_2_devOPTIONAL02022-11-08 09:51:232021-05-26 14:46:00
58routeauto_testOPTIONAL02022-11-04 16:51:042021-09-08 14:19:23
67routecs_1_dev1OPTIONAL02022-10-31 15:58:072022-10-31 15:58:07
66routeet1OPTIONAL02022-08-07 21:39:552022-08-07 21:39:55
65routetest114OPTIONAL02022-07-05 00:18:522022-07-05 00:18:52
39routetestOPTIONAL02022-06-28 13:24:192021-08-02 15:30:03
62routegjy_testOPTIONAL02022-02-24 19:25:112022-01-05 17:27:46
6routecs_3_devOPTIONAL02022-02-17 14:20:332021-05-26 14:57:12
63routetest_AOPTIONAL02022-01-06 15:04:352022-01-06 15:04:35
61userCreatorauto-testOPTIONAL22021-12-22 14:36:332021-12-22 14:36:33

索引说明

序号名称描述类型字段
1uniq_lk_lv将label_key,label_value 列设置为唯一索引UNIQUE KEYlabel_key,label_value

示例数据

idinstancenameupdate_timecreate_time
1527localhost110004:8008visualis-prod2022-06-28 14:14:362022-06-28 14:14:36
1537localhost110004:9008visualis-dev2022-06-30 15:39:192022-06-30 15:39:18
1702localhost110004:9108linkis-ps-cs2022-11-08 09:51:232022-11-08 09:51:23

48. linkis_ps_instance_label_relation​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_idid reference linkis_ps_instance_label -> idint(20)MULYES
3service_instancestructure like ${host|machine}:${port}varchar(128)NO
4update_timeupdate unix timestampdatetimeYESCURRENT_TIMESTAMP
5create_timecreate unix timestampdatetimeYESCURRENT_TIMESTAMP

示例数据

idlabel_idservice_instanceupdate_timecreate_time
5622localhost110002:91082022-02-14 11:58:572022-02-14 11:58:57
8755localhost110004:91082022-11-08 09:51:232022-11-08 09:51:23
87664localhost11ide01:91082022-11-08 09:51:262022-11-08 09:51:26

索引说明

序号名称描述类型字段
1uniq_lid_instance将label_id,service_instance 列设置为唯一索引UNIQUE KEYlabel_id,service_instance

49. linkis_ps_instance_label_value_relation​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2label_value_keyvalue keyvarchar(255)MULNO
3label_value_contentvalue contentvarchar(255)YES
4label_idid reference linkis_ps_instance_label -> idint(20)YES
5update_timeupdate unix timestampdatetimeYESCURRENT_TIMESTAMP
6create_timecreate unix timestampdatetimeYESCURRENT_TIMESTAMP

示例数据

label_value_keylabel_value_contentlabel_idupdate_timecreate_time
creatortest612021-12-22 14:36:332021-12-22 14:36:33
userauto612021-12-22 14:36:332021-12-22 14:36:33
creatora502021-08-03 19:40:482021-08-03 19:40:48
usera502021-08-03 19:40:482021-08-03 19:40:48

索引说明

序号名称描述类型字段
1uniq_lvk_lid将label_value_key,label_id 列设置为唯一索引UNIQUE KEYlabel_value_key,label_id

50. linkis_ps_job_history_detail​

序号名称描述类型键为空额外默认值
1idPrimary Key, auto incrementbigint(20)PRINOauto_increment
2job_history_idID of JobHistorybigint(20)NO
3result_locationFile path of the resultsetsvarchar(500)YES
4execution_contentThe script code or other execution content executed by this JobtextYES
5result_array_sizesize of result arrayint(4)YES0
6job_group_infoJob group info/pathtextYES
7created_timeCreation timedatetime(3)YESCURRENT_TIMESTAMP(3)
8updated_timeUpdate timedatetime(3)YESCURRENT_TIMESTAMP(3)
9statusstatusvarchar(32)YES
10priorityorder of subjobint(4)YES0

示例数据

idjob_history_idresult_locationexecution_contentresult_array_sizejob_group_infocreated_timeupdated_timestatuspriority
17000011561337hdfs:///apps-data/neiljianliu/linkis/20211225_201252/nodeexecution/1561337select * from default.dwc_vsbi_students_demo limit 500012021-12-25 20:12:522021-12-25 20:12:54Succeed0
17000021561339\N{"configuration":{},"variable":{"user.to.proxy":"neiljianliu","run_date":"20211224"},"run_date":"20211224","labels":{"labels":"{\"route\":\"prod\"}"}}\N2021-12-25 20:15:512021-12-25 20:15:52Failed0
17000031561338hdfs:///apps-data/neiljianliu/linkis/20211225_201551/nodeexecution/1561338{"config":"","description":"","id":380.0,"model":"","name":"view_3142","projectId":864.0,"roles":"","source":{"id":318.0,"name":"hiveDataSource"},"sourceId":318.0,"sql":"","variable":""}12021-12-25 20:15:512021-12-25 20:15:55Succeed0
17000041561340hdfs:///apps-data/neiljianliu/linkis/20211225_201552/nodeexecution/1561340select * from default.dwc_vsbi_students_demo limit 500012021-12-25 20:15:522021-12-25 20:15:54Succeed0
17000051561341hdfs:///apps-data/neiljianliu/linkis/20211225_201852/nodeexecution/1561341{"config":"","description":"","id":380.0,"model":"","name":"view_3142","projectId":864.0,"roles":"","source":{"id":318.0,"name":"hiveDataSource"},"sourceId":318.0,"sql":"","variable":""}12021-12-25 20:18:522021-12-25 20:18:56Succeed0
17000061561342\N{"configuration":{},"variable":{"user.to.proxy":"neiljianliu","run_date":"20211224"},"run_date":"20211224","labels":{"labels":"{\"route\":\"prod\"}"}}\N2021-12-25 20:18:522021-12-25 20:18:52Failed0

51. linkis_ps_job_history_group_history​

序号名称描述类型键为空额外默认值
1idPrimary Key, auto incrementbigint(20)PRINOauto_increment
2job_req_idjob execIdvarchar(64)YES
3submit_userwho submitted this Jobvarchar(50)MULYES
4execute_userwho actually executed this Jobvarchar(50)YES
5sourcejob sourcetextYES
6labelsjob labelstextYES
7paramsjob paramstextYES
8progressJob execution progressvarchar(32)YES
9statusScript execution status, must be one of the following: Inited, WaitForRetry, Scheduled, Running, Succeed, Failed, Cancelled, Timeoutvarchar(50)YES
10log_pathFile path of the job logvarchar(200)YES
11error_codeError code. Generated when the execution of the script failsint(11)YES
12error_descExecution description. Generated when the execution of script failsvarchar(1000)YES
13created_timeCreation timedatetime(3)MULYESCURRENT_TIMESTAMP(3)
14updated_timeUpdate timedatetime(3)YESCURRENT_TIMESTAMP(3)
15instancesEntrance instancesvarchar(250)YES
16metricsJob MetricstextYES
17engine_typeEngine typevarchar(32)YES
18execution_codeJob origin code or code pathtextYES
19result_locationFile path of the resultsetsvarchar(500)YES

示例数据

idjob_req_idsubmit_userexecute_usersourcelabelsparamsprogressstatuslog_patherror_codeerror_desccreated_timeupdated_timeinstancesmetricsengine_typeexecution_coderesult_location
3400407nodeexecution_owenxu_spark_29owenxuowenxu{"nodeName":"sql_9024","requestIP":"127.0.0.1","projectName":"testpubauthority","flowName":"test01"}{"codeType":"sql","engineType":"spark-2.4.3","userCreator":"owenxu-nodeexecution"}{"configuration":{"runtime":{"nodeName":"sql_9024","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"+PHsmq+A1AkWQ3olJILCuFspWs9RflbL2HLiVea4FcQ\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","wds.dss.workflow.submit.user":"owenxu","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"owenxu\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"testpubauthority\\",\\"flow\\":\\"test01\\",\\"contextId\\":\\"8-8--cs_1_devcs_1_dev58211\\",\\"version\\":\\"v000003\\",\\"env\\":\\"BDAP_DEV\\"}\"}","nodeType":"sql","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/owenxu/linkis/2022-11-16/155518/nodeexecution/3400407","source":{"nodeName":"sql_9024","projectName":"testpubauthority","flowName":"test01","requestIP":"127.0.0.1"},"jobId":"3400407","job":{"#rt_rs_store_path":"hdfs:///apps-data/owenxu/linkis/2022-11-16/155518/nodeexecution/3400407"}},"startup":{"jobId":"3400407"}},"variable":{"user.to.proxy":"owenxu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"owenxu-schedulis","codeType":"sql","engineType":"spark-2.4.3","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/owenxu/3400407.log02022-11-16 15:55:18.0002022-11-16 15:55:20.387localhost11ide01:9205{"scheduleTime":"2022-11-16T15:55:19+0800","timeToOrchestrator":"2022-11-16T15:55:19+0800","engineconnMap":{"gz.xg.localhost110001.webank:27735":{"engineInstance":"gz.xg.localhost110001.webank:27735","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400407_otJobId_astJob_647_codeExec_647","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_647"}},"submitTime":"2022-11-16T15:55:18+0800","yarnResource":{},"completeTime":"2022-11-16T15:55:20+0800"}sparkselect 1hdfs:///apps-data/owenxu/linkis/2022-11-16/155518/nodeexecution/3400407
3400406nodeexecution_johnnwang_spark_42johnnwangjohnnwang{"nodeName":"sql_2947","requestIP":"127.0.0.1","projectName":"hmh0901","flowName":"flow001"}{"codeType":"sql","engineType":"spark-2.4.3","userCreator":"johnnwang-nodeexecution"}{"configuration":{"startup":{"spark.executor.memory":"3G","spark.driver.memory":"3G","spark.executor.cores":"2","spark.executor.instances":"2","wds.linkis.rm.yarnqueue":"dws","ReuseEngine":"true","jobId":"3400406"},"runtime":{"nodeName":"sql_2947","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"Lg76z9Wq/bjKI3Kp1nTKBNZnRJ6dDz3v5E4e2cL2cD4\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","wds.dss.workflow.submit.user":"johnnwang","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"johnnwang\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"hmh0901\\",\\"flow\\":\\"flow001\\",\\"contextId\\":\\"8-8--cs_1_devcs_1_dev61373\\",\\"version\\":\\"v000005\\",\\"env\\":\\"BDAP_DEV\\"}\"}","nodeType":"sql","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/johnnwang/linkis/2022-11-16/155217/nodeexecution/3400406","source":{"nodeName":"sql_2947","projectName":"hmh0901","flowName":"flow001","requestIP":"127.0.0.1"},"jobId":"3400406","job":{"#rt_rs_store_path":"hdfs:///apps-data/johnnwang/linkis/2022-11-16/155217/nodeexecution/3400406"}}},"variable":{"user.to.proxy":"johnnwang","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"johnnwang-schedulis","codeType":"sql","engineType":"spark-2.4.3","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/johnnwang/3400406.log02022-11-16 15:52:17.0002022-11-16 15:52:19.328localhost11ide01:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"gz.xg.localhost110001.webank:35637":{"engineInstance":"gz.xg.localhost110001.webank:35637","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400406_otJobId_astJob_646_codeExec_646","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_646"}},"submitTime":"2022-11-16T15:52:17+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:19+0800"}sparkshow tables;hdfs:///apps-data/johnnwang/linkis/2022-11-16/155217/nodeexecution/3400406
3400405nodeexecution_johnnwang_appconn_42johnnwangjohnnwang{"nodeName":"sqoop_6588","requestIP":"127.0.0.1","projectName":"hmh0901","flowName":"flow001"}{"codeType":"exchangis.sqoop","engineType":"appconn-1","userCreator":"johnnwang-nodeexecution"}{"configuration":{"runtime":{"nodeName":"sqoop_6588","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"Lg76z9Wq/bjKI3Kp1nTKBNZnRJ6dDz3vupd1m5IsFA0\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","variables":{"user.to.proxy":"johnnwang","run_today_h":"2022111615","run_date":"20221115"},"wds.dss.workflow.submit.user":"johnnwang","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"johnnwang\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"hmh0901\\",\\"flow\\":\\"flow001\\",\\"contextId\\":\\"8-8--cs_1_devcs_1_dev61373\\",\\"version\\":\\"v000005\\",\\"env\\":\\"BDAP_DEV\\"}\"}","nodeType":"exchangis.sqoop","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/johnnwang/linkis/2022-11-16/155217/nodeexecution/3400405","source":{"nodeName":"sqoop_6588","projectName":"hmh0901","flowName":"flow001","requestIP":"127.0.0.1"},"jobId":"3400405","job":{"#rt_rs_store_path":"hdfs:///apps-data/johnnwang/linkis/2022-11-16/155217/nodeexecution/3400405"}},"startup":{"jobId":"3400405"}},"variable":{"user.to.proxy":"johnnwang","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"johnnwang-schedulis","codeType":"exchangis.sqoop","engineType":"appconn-1","labels":"{\"route\":\"prod\"}"}}1.0Failedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/johnnwang/3400405.log\N21304, Task(codeExec_645) status not succeed,is Failed2022-11-16 15:52:17.0002022-11-16 15:52:18.475localhost11ide01:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"localhost110004:10781":{"engineInstance":"localhost110004:10781","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400405_otJobId_astJob_645_codeExec_645","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_645"}},"submitTime":"2022-11-16T15:52:17+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:18+0800"}appconn{"id":5924}hdfs:///apps-data/johnnwang/linkis/2022-11-16/155217/nodeexecution/3400405
3400404nodeexecution_allenlliu_shell_25allenlliuallenlliu{"nodeName":"shell_4441","requestIP":"127.0.0.1","projectName":"mytest_xq_0032","flowName":"test_workflow001"}{"codeType":"shell","engineType":"shell-1","userCreator":"allenlliu-nodeexecution"}{"configuration":{"runtime":{"nodeName":"shell_4441","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"y4h8zre1zbG7a5OlwX8oULazMLTJJpelCaiwk84RsEk\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","wds.dss.workflow.submit.user":"allenlliu","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"allenlliu\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"mytest_xq_0032\\",\\"flow\\":\\"test_workflow001\\",\\"contextId\\":\\"8-8--cs_2_devcs_2_dev10489\\",\\"version\\":\\"v000009\\",\\"env\\":\\"BDAP_DEV\\"}\"}","nodeType":"sh","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155217/nodeexecution/3400404","source":{"nodeName":"shell_4441","projectName":"mytest_xq_0032","flowName":"test_workflow001","requestIP":"127.0.0.1"},"jobId":"3400404","job":{"#rt_rs_store_path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155217/nodeexecution/3400404"}},"startup":{"jobId":"3400404"}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"allenlliu-schedulis","codeType":"shell","engineType":"shell-1","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/allenlliu/3400404.log02022-11-16 15:52:17.0002022-11-16 15:52:18.359localhost110002:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"localhost110004:14499":{"engineInstance":"localhost110004:14499","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400404_otJobId_astJob_532_codeExec_532","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_532"}},"submitTime":"2022-11-16T15:52:17+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:18+0800"}shellecho 'hello'hdfs:///apps-data/allenlliu/linkis/2022-11-16/155217/nodeexecution/3400404
3400403nodeexecution_allenlliu_appconn_111allenlliuallenlliu{"nodeName":"datachecker_90101_copy_copy","requestIP":"127.0.0.1","projectName":"mytest_xq_0032","flowName":"test_workflow001"}{"codeType":"datachecker","engineType":"appconn-1","userCreator":"allenlliu-nodeexecution"}{"configuration":{"startup":{"ReuseEngine":"true","jobId":"3400403"},"runtime":{"max.check.hours":"1","nodeName":"datachecker_90101_copy_copy","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"y4h8zre1zbG7a5OlwX8oUNZnRJ6dDz3vcFfovQF97E8\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","variables":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"wds.dss.workflow.submit.user":"allenlliu","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"allenlliu\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"mytest_xq_0032\\",\\"flow\\":\\"test_workflow001\\",\\"contextId\\":\\"8-8--cs_2_devcs_2_dev10489\\",\\"version\\":\\"v000009\\",\\"env\\":\\"BDAP_DEV\\"}\"}","check.object":"allenlliu_ind.a","nodeType":"datachecker","source.type":"hivedb","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155217/nodeexecution/3400403","source":{"nodeName":"datachecker_90101_copy_copy","projectName":"mytest_xq_0032","flowName":"test_workflow001","requestIP":"127.0.0.1"},"jobId":"3400403","job":{"#rt_rs_store_path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155217/nodeexecution/3400403"}}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"allenlliu-schedulis","codeType":"datachecker","engineType":"appconn-1","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/allenlliu/3400403.log02022-11-16 15:52:17.0002022-11-16 15:52:18.060localhost11ide01:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"localhost110004:10781":{"engineInstance":"localhost110004:10781","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400403_otJobId_astJob_644_codeExec_644","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_644"}},"submitTime":"2022-11-16T15:52:17+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:18+0800"}appconn{"configuration":{"startup":{"ReuseEngine":"true"},"runtime":{"max.check.hours":"1","check.object":"allenlliu_ind.a","source.type":"hivedb"}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"labels":"{\"route\":\"prod\"}"}}hdfs:///apps-data/allenlliu/linkis/2022-11-16/155217/nodeexecution/3400403
3400402nodeexecution_allenlliu_spark_32allenlliuallenlliu{"nodeName":"sql_3520","requestIP":"127.0.0.1","projectName":"mytest_xq_0032","flowName":"test_workflow001"}{"codeType":"sql","engineType":"spark-2.4.3","userCreator":"allenlliu-nodeexecution"}{"configuration":{"runtime":{"nodeName":"sql_3520","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"y4h8zre1zbG7a5OlwX8oULazMLTJJpelslfPQ0jh9bw\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","wds.dss.workflow.submit.user":"allenlliu","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"allenlliu\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"mytest_xq_0032\\",\\"flow\\":\\"test_workflow001\\",\\"contextId\\":\\"8-8--cs_2_devcs_2_dev10489\\",\\"version\\":\\"v000009\\",\\"env\\":\\"BDAP_DEV\\"}\"}","nodeType":"sql","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400402","source":{"nodeName":"sql_3520","projectName":"mytest_xq_0032","flowName":"test_workflow001","requestIP":"127.0.0.1"},"jobId":"3400402","job":{"#rt_rs_store_path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400402"}},"startup":{"jobId":"3400402"}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"allenlliu-schedulis","codeType":"sql","engineType":"spark-2.4.3","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/allenlliu/3400402.log02022-11-16 15:52:16.0002022-11-16 15:52:18.436localhost110002:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"localhost110004:25145":{"engineInstance":"localhost110004:25145","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400402_otJobId_astJob_531_codeExec_531","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_531"}},"submitTime":"2022-11-16T15:52:16+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:18+0800"}sparkshow tableshdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400402
3400401nodeexecution_allenlliu_appconn_85allenlliuallenlliu{"nodeName":"datachecker_90101","requestIP":"127.0.0.1","projectName":"mytest_xq_0032","flowName":"test_workflow001"}{"codeType":"datachecker","engineType":"appconn-1","userCreator":"allenlliu-nodeexecution"}{"configuration":{"startup":{"ReuseEngine":"true","jobId":"3400401"},"runtime":{"max.check.hours":"1","nodeName":"datachecker_90101","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"y4h8zre1zbG7a5OlwX8oULazMLTJJpelHY1ioj7PF6w\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","variables":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"wds.dss.workflow.submit.user":"allenlliu","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"allenlliu\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"mytest_xq_0032\\",\\"flow\\":\\"test_workflow001\\",\\"contextId\\":\\"8-8--cs_2_devcs_2_dev10489\\",\\"version\\":\\"v000009\\",\\"env\\":\\"BDAP_DEV\\"}\"}","check.object":"allenlliu_ind.a","nodeType":"datachecker","source.type":"hivedb","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400401","source":{"nodeName":"datachecker_90101","projectName":"mytest_xq_0032","flowName":"test_workflow001","requestIP":"127.0.0.1"},"jobId":"3400401","job":{"#rt_rs_store_path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400401"}}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"allenlliu-schedulis","codeType":"datachecker","engineType":"appconn-1","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/allenlliu/3400401.log02022-11-16 15:52:16.0002022-11-16 15:52:17.718localhost110002:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"localhost110004:10781":{"engineInstance":"localhost110004:10781","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400401_otJobId_astJob_530_codeExec_530","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_530"}},"submitTime":"2022-11-16T15:52:16+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:17+0800"}appconn{"configuration":{"startup":{"ReuseEngine":"true"},"runtime":{"max.check.hours":"1","check.object":"allenlliu_ind.a","source.type":"hivedb"}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"labels":"{\"route\":\"prod\"}"}}hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400401
3400400nodeexecution_allenlliu_appconn_110allenlliuallenlliu{"nodeName":"datachecker_90101_copy","requestIP":"127.0.0.1","projectName":"mytest_xq_0032","flowName":"test_workflow001"}{"codeType":"datachecker","engineType":"appconn-1","userCreator":"allenlliu-nodeexecution"}{"configuration":{"startup":{"ReuseEngine":"true","jobId":"3400400"},"runtime":{"max.check.hours":"1","nodeName":"datachecker_90101_copy","workspace":"{\"workspaceId\":224,\"workspaceName\":\"bdapWorkspace\",\"cookies\":{\"linkis_user_session_ticket_id_v1\":\"y4h8zre1zbG7a5OlwX8oULazMLTJJpelBtBXO2lr2rM\u003d\",\"dataworkcloud_inner_request\":\"true\",\"workspaceName\":\"bdapWorkspace\",\"workspaceId\":\"224\"},\"dssUrl\":\"http://localhost11ide01:9001\"}","variables":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"wds.dss.workflow.submit.user":"allenlliu","contextID":"{\"type\":\"HAWorkFlowContextID\",\"value\":\"{\\"instance\\":null,\\"backupInstance\\":null,\\"user\\":\\"allenlliu\\",\\"workspace\\":\\"bdapWorkspace\\",\\"project\\":\\"mytest_xq_0032\\",\\"flow\\":\\"test_workflow001\\",\\"contextId\\":\\"8-8--cs_2_devcs_2_dev10489\\",\\"version\\":\\"v000009\\",\\"env\\":\\"BDAP_DEV\\"}\"}","check.object":"allenlliu_ind.a","nodeType":"datachecker","source.type":"hivedb","labels":"{\"route\":\"prod\"}","wds.linkis.resultSet.store.path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400400","source":{"nodeName":"datachecker_90101_copy","projectName":"mytest_xq_0032","flowName":"test_workflow001","requestIP":"127.0.0.1"},"jobId":"3400400","job":{"#rt_rs_store_path":"hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400400"}}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"userCreator":"allenlliu-schedulis","codeType":"datachecker","engineType":"appconn-1","labels":"{\"route\":\"prod\"}"}}1.0Succeedhdfs:///appcom/logs/linkis/log/2022-11-16/nodeexecution/allenlliu/3400400.log02022-11-16 15:52:16.0002022-11-16 15:52:17.736localhost11ide01:9205{"scheduleTime":"2022-11-16T15:52:17+0800","timeToOrchestrator":"2022-11-16T15:52:17+0800","engineconnMap":{"localhost110004:10781":{"engineInstance":"localhost110004:10781","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400400_otJobId_astJob_643_codeExec_643","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_643"}},"submitTime":"2022-11-16T15:52:16+0800","yarnResource":{},"completeTime":"2022-11-16T15:52:17+0800"}appconn{"configuration":{"startup":{"ReuseEngine":"true"},"runtime":{"max.check.hours":"1","check.object":"allenlliu_ind.a","source.type":"hivedb"}},"variable":{"user.to.proxy":"allenlliu","run_today_h":"2022111615","run_date":"20221115"},"run_today_h":"2022111615","run_date":"20221115","labels":{"labels":"{\"route\":\"prod\"}"}}hdfs:///apps-data/allenlliu/linkis/2022-11-16/155216/nodeexecution/3400400
3400399IDE_connorliuyude_spark_1connorliuyudeconnorliuyude{"DSS-Scriptis":"import_to_connorliuyude_qml.peter_100w_1000_a_1668585127900.scala","requestIP":"127.0.0.1"}{"codeType":"scala","engineType":"spark-2.4.3","userCreator":"connorliuyude-IDE"}{"configuration":{"special":{},"runtime":{"args":"","env":[],"wds.linkis.resultSet.store.path":"hdfs:///apps-data/connorliuyude/linkis/2022-11-16/155208/IDE/3400399","source":{"DSS-Scriptis":"import_to_connorliuyude_qml.peter_100w_1000_a_1668585127900.scala","requestIP":"127.0.0.1"},"jobId":"3400399","job":{"#rt_rs_store_path":"hdfs:///apps-data/connorliuyude/linkis/2022-11-16/155208/IDE/3400399"}},"startup":{"jobId":"3400399"}},"variable":{}}0.7191358Runninghdfs:///appcom/logs/linkis/log/2022-11-16/IDE/connorliuyude/3400399.log\N\N2022-11-16 15:52:08.0002022-11-16 15:55:38.556localhost11ide01:9205{"scheduleTime":"2022-11-16T15:52:09+0800","timeToOrchestrator":"2022-11-16T15:52:09+0800","engineconnMap":{"gz.xg.localhost110001.webank:33228":{"engineInstance":"gz.xg.localhost110001.webank:33228","taskClassname":"CodeLogicalUnitExecTask","idInfo":"TaskID_3400399_otJobId_astJob_642_codeExec_642","taskName":"CodeLogicalUnitExecTask","execId":"codeExec_642"}},"submitTime":"2022-11-16T15:52:08+0800","yarnResource":{"application_1662051718074_332612":{"queueMemory":107374182400,"queueCores":20,"queueInstances":0,"jobStatus":"COMPLETED","queue":"queue_0701_01"}}}sparkval source = """{"path":"/apps-data/connorliuyude/peter_100w_1000_a.csv","pathType":"hdfs","encoding":"utf-8","fieldDelimiter":",","hasHeader":true,"sheet":"","quote":"","escapeQuotes":false}""" val destination = """hdfs:///tmp/bdp-ide/connorliuyude/executionCode/20221116/_bgservice;454023#74026""" org.apache.linkis.engineplugin.spark.imexport.LoadData.loadDataToTableByFile(spark,destination,source)hdfs:///apps-data/connorliuyude/linkis/2022-11-16/155208/IDE/3400399

索引说明

序号名称描述类型字段
1idx_created_time将created_time 列设置为普通索引INDEXcreated_time
2idx_submit_user将submit_user 列设置为普通索引INDEXsubmit_user

52. linkis_ps_resources_download_history​

序号名称描述类型键为空额外默认值
1idprimary keybigint(20)PRINOauto_increment
2start_timestart timedatetimeNOCURRENT_TIMESTAMP
3end_timestop timedatetimeNOCURRENT_TIMESTAMP
4client_ipclient ipvarchar(200)NO
5stateDownload status, 0 download successful, 1 download failedtinyint(1)NO
6resource_idvarchar(50)NO
7versionvarchar(20)NO
8downloaderDownloadervarchar(50)NO

示例数据

idstart_timeend_timeclient_ipstateresource_idversiondownloader
18596172022-11-16 15:56:172022-11-16 15:56:18127.0.0.1011b8ca20-3437-4f31-a808-915a6f016a87v000001owenxu
18596142022-11-16 15:55:182022-11-16 15:55:18127.0.0.10836ba735-3a46-4303-8e9f-c4276a356386v000001owenxu
18596132022-11-16 15:53:062022-11-16 15:53:07127.0.0.10cb407155-242b-4303-8365-1da6256a01e3v000173hadoop
18596122022-11-16 15:52:172022-11-16 15:52:17127.0.0.10665fe5ce-fdc6-4b9a-ab08-955e48b1f8d4v000001owenxu

53. linkis_ps_udf​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2create_uservarchar(50)NO
3udf_namevarchar(255)NO
4udf_typeint(11)YES0
5pathPath of the referenced functionvarchar(255)YES
6register_formatvarchar(255)YES
7use_formatvarchar(255)YES
8descriptionvarchar(255)YES
9is_expirebit(1)YES
10is_sharedbit(1)YES
11tree_idbigint(20)NO
12create_timetimestampNOon update CURRENT_TIMESTAMPCURRENT_TIMESTAMP
13update_timetimestampNOCURRENT_TIMESTAMP

示例数据

idcreate_userudf_nameudf_typepathregister_formatuse_formatdescriptionis_expireis_sharedtree_idcreate_timeupdate_time
204neiljianliujar_udf0/mnt/bdap/neiljianliu/zy_test/Wbjar_1.0.0.jarcreate temporary function jar_udf as "com.webank.bdp.mask.udf.BdpBankCardNoFirstEightMask"String jar_udf(String)001452021-11-09 09:52:312021-11-09 09:52:31
205neiljianliujar_udf10/mnt/bdap/neiljianliu/zy_test/Wbjar_1.1.jarcreate temporary function jar_udf1 as "com.webank.bdp.mask.udf.BdpBankCardNoFirstEightMask"String jar_udf1(String)001452021-11-09 09:43:282021-11-09 09:43:28

54. linkis_ps_udf_baseinfo​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2create_uservarchar(50)NO
3udf_namevarchar(255)NO
4udf_typeint(11)YES0
5tree_idbigint(20)NO
6create_timetimestampNOon update CURRENT_TIMESTAMPCURRENT_TIMESTAMP
7update_timetimestampNOCURRENT_TIMESTAMP
8syssource systemvarchar(255)NOide
9cluster_namevarchar(255)NO
10is_expirebit(1)YES
11is_sharedbit(1)YES

示例数据

idcreate_userudf_nameudf_typetree_idcreate_timeupdate_timesyscluster_nameis_expireis_shared
318neiljianliuh01313702022-08-08 19:39:392021-11-04 20:36:46IDEall01
321neiljianliuh14113312021-11-01 23:28:252021-10-29 10:39:08IDEall00
324stacyyanudf_jar_83401332021-10-29 11:28:102021-10-29 11:28:10ideall00

55. linkis_ps_udf_manager​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2user_namevarchar(20)YES

示例数据

iduser_name
1stacyyan
2johnnwang
3neiljianliu

56. linkis_ps_udf_shared_group​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2udf_idbigint(20)NO
3shared_groupvarchar(50)NO

示例数据

idudf_iduser_name
136jianfuzhang
236stacyyan
338shanhuang
438stacyyan

57. linkis_ps_udf_shared_info​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2udf_idbigint(20)NO
3user_namevarchar(50)NO

58. linkis_ps_udf_shared_user​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2udf_idbigint(20)NO
3user_namevarchar(50)NO

示例数据

idudf_iduser_name
63117jianfuzhang
64119neiljianliu
65119johnnwang
66126jianfuzhang

59. linkis_ps_udf_tree​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2parentbigint(20)NO
3nameCategory name of the function. It would be displayed in the front-endvarchar(100)YES
4user_namevarchar(50)NO
5descriptionvarchar(255)YES
6create_timetimestampNOon update CURRENT_TIMESTAMPCURRENT_TIMESTAMP
7update_timetimestampNOCURRENT_TIMESTAMP
8categoryUsed to distinguish between udf and functionvarchar(50)YES

示例数据

idparentnameuser_namedescriptioncreate_timeupdate_timecategory
21-1系统函数sys2021-04-29 19:22:072021-04-29 19:22:07function
22-1BDAP函数bdp2021-04-29 19:22:072021-04-29 19:22:07function
23-1共享函数share2021-04-29 19:22:072021-04-29 19:22:07function
24-1个人函数jianfuzhang2021-04-29 19:22:072021-04-29 19:22:07function
25-1个人函数hduser052021-04-30 10:15:142021-04-30 10:15:14udf
26-1系统函数sys2021-04-30 11:21:132021-04-30 11:21:13udf
27-1BDAP函数bdp2021-04-30 11:21:132021-04-30 11:21:13udf
28-1共享函数share2021-04-30 11:21:132021-04-30 11:21:13udf
29-1个人函数alexyang2021-05-06 20:41:482021-05-06 20:41:48function
30-1个人函数johnnwang2021-05-06 21:47:522021-05-06 21:47:52udf
1587-1个人函数aronlv2022-11-15 10:47:272022-11-15 10:47:27udf
1586-1个人函数aronlv2022-11-15 10:47:262022-11-15 10:47:26function
1585-1个人函数jackyxxie2022-11-14 14:59:442022-11-14 14:59:44udf
158436自定义分类1stacyyan2022-11-11 17:10:562022-11-11 17:10:56udf
1583-1个人函数alvinzhou2022-11-09 11:23:042022-11-09 11:23:04function
158236qualitis自定义分类stacyyan2022-11-08 16:22:312022-11-08 16:22:31udf
158136qualitis测试stacyyan2022-11-07 12:21:302022-11-07 12:21:30udf
158029fun自动化测试alexyang2022-11-04 19:16:292022-11-04 19:16:29function
157920udf自动化测试alexyang2022-11-04 19:16:252022-11-04 19:16:25udf
157820测试alexyang2022-11-01 11:05:462022-11-01 11:05:46udf
1577-1个人函数jeromepeng2022-10-31 10:54:332022-10-31 10:54:33function
1576-1个人函数jeromepeng2022-10-31 10:54:312022-10-31 10:54:31udf

60. linkis_ps_udf_user_load​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2udf_idbigint(20)NO
3user_namevarchar(50)NO

示例数据

udf_iduser_name
34johnnwang
53johnnwang
34neiljianliu
109stacyyan
110stacyyan

61. linkis_ps_udf_user_load_info​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2udf_idint(11)NO
3user_namevarchar(50)NO

示例数据

idudf_iduser_name
113hadoop
214bob
318testuser

62. linkis_ps_udf_version​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2udf_idbigint(20)NO
3pathSource path for uploading filesvarchar(255)NO
4bml_resource_idvarchar(50)NO
5bml_resource_versionvarchar(20)NO
6is_publishedis publishedbit(1)YES
7register_formatvarchar(255)YES
8use_formatvarchar(255)YES
9descriptionversion descvarchar(255)NO
10create_timetimestampNOon update CURRENT_TIMESTAMPCURRENT_TIMESTAMP
11md5varchar(100)YES

示例数据

idudf_idpathbml_resource_idbml_resource_versionis_publishedregister_formatuse_formatdescriptioncreate_timemd5
8034file:///mnt/bdap/johnnwang/wds_functions1_0_0.jaraee4698a-0aad-4dfe-9e3c-0d2c674c81f9v0000010create temporary function cf_charcount_s as "com.webank.wedatasphere.willink.bdp.udf.CountTotalCharInStr"int cf_charcount_s(string,string)2021-10-20 16:50:57\N
9334file:///mnt/bdap/johnnwang/wds_functions1_0_0.jaraee4698a-0aad-4dfe-9e3c-0d2c674c81f9v0000021create temporary function cf_charcount_s as "com.webank.wedatasphere.willink.bdp.udf.CountTotalCharInStr"int cf_charcount_s(string,string)2021-10-20 18:53:59\N
20596file:///mnt/bdap/stacyyan/tm_client_1.6_cp.jar759c6179-060e-4c61-9ff9-8f6e18d0efafv0000010create temporary function udf_jar_834 as "com.webank.bdp.mask.udf.BdpBankCardNoFirstEightMask"udf_jar_834()2021-10-23 16:57:00\N
250109file:///mnt/bdap/stacyyan/scala系统函数调用.scala4519f563-ac8a-48a3-a487-36b0d629bc59v0000010\NString aadfdff()2021-10-25 16:56:04\N
251110file:///mnt/bdap/stacyyan/scala系统函数调用.scalae0caa4a5-754e-4517-9d0d-5610c7712d82v0000010\NString df78()2021-10-25 16:56:28\N
257116file:///mnt/bdap/udf/udf_pyspark_011621477729461.py2917d57a-0078-455f-8eda-45d18d90adb3v0000011udf.register("udf_hello_0518",hello)String udf_hello_0518(String)aaaad2021-10-25 17:31:43\N

63. linkis_ps_variable_key​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2keyKey of the global variablevarchar(50)YES
3descriptionReserved wordvarchar(200)YES
4nameReserved wordvarchar(50)YES
5application_idReserved wordbigint(20)MULYES
6default_valueReserved wordvarchar(200)YES
7value_typeReserved wordvarchar(50)YES
8value_regexReserved wordvarchar(100)YES

示例数据

idkeydescriptionnameapplication_iddefault_valuevalue_typevalue_regex
1di_marw_warn_flow_dcn_d\N\N-1\N\N\N
2table_a\N\N-1\N\N\N
3table_a\N\N-1\N\N\N
4aaaa\N\N-1\N\N\N

索引说明

序号名称描述类型字段
1idx_aid将application_id 列设置为普通索引INDEXapplication_id

64. linkis_ps_variable_key_user​

序号名称描述类型键为空额外默认值
1idbigint(20)PRINOauto_increment
2application_idReserved wordbigint(20)MULYES
3key_idbigint(20)MULYES
4user_namevarchar(50)YES
5valueValue of the global variablevarchar(200)YES

示例数据

idapplication_idkey_iduser_namevalue
1-11neiljianliud
2-12stacyyanstudent
3-13jianfuzhanga_01

索引说明

序号名称描述类型字段
1idx_key_id将key_id 列设置为普通索引INDEXkey_id
2uniq_aid_kid_uname将application_id,key_id,user_name 列设置为普通索引INDEXapplication_id,key_id,user_name
3idx_aid将application_id 列设置为普通索引INDEXapplication_id

65.linkis_cg_user_ip_config​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2uservarchar(50)NO
3creatorvarchar(50)NO
4ip_listtextNO
5create_timedatetimeNO
6update_timedatetimeNO
7descvarchar(100)NO
8bussiness_uservarchar(50)NO

索引说明

序号名称描述类型字段
1uniq_user_creator将user,creator 列设置为唯一索引UNIQUE KEYuser,creator

66.linkis_cg_tenant_label_config​

序号名称描述类型键为空额外默认值
1idint(20)PRINOauto_increment
2uservarchar(50)NO
3creatorvarchar(50)NO
4tenant_valuevarchar(128)NO
5create_timedatetimeNO
6update_timedatetimeNO
7descvarchar(100)NO
8bussiness_uservarchar(50)NO

索引说明

序号名称描述类型字段
1uin_user_creator将user,creator 列设置为唯一索引UNIQUE KEYuser,creator