fa755faf72
ftp
2026-01-09 13:47:43 +08:00
7de49feb66
feat(annotation): 优化标注模板生成和配置验证
...
- 添加文本对象类型集合用于模板类型判断
- 将XML生成部分拆分为对象和控件两个独立部分
- 为文本类模板添加响应式布局支持长文本标注
- 修复配置验证器中对象和控件查找逻辑
- 优化标签控件在长文本场景下的显示位置
2026-01-09 13:39:55 +08:00
d6aaa1b7a8
feat(runtime): 启用 FTP 读写模块
...
- 取消注释 ftpreader 模块的配置
- 取消注释 ftpwriter 模块的配置
- 使 FTP 数据传输功能在运行时可用
2026-01-09 13:36:51 +08:00
08336e2a13
feat(annotation): 添加标注模板配置功能
...
- 在schema中新增choice和show_inline字段支持选择模式配置
- 为编辑器服务添加空标注创建逻辑避免前端异常
- 实现标签类型的标准化处理和大小写兼容
- 支持Choices标签的单选/多选和行内显示配置
- 优化前端界面滚动条显示控制样式
2026-01-09 13:05:09 +08:00
a82f4f1bc3
refactor(annotation): 移除对 Label Studio Server 的依赖并切换到内嵌编辑器模式
...
- 移除 LabelStudioClient 和 SyncService 的导入及使用
- 删除与 Label Studio 项目的创建、删除和同步相关代码
- 修改创建数据集映射功能，改为创建 DataMate 标注项目
- 更新删除映射接口，仅进行软删除不再删除 Label Studio 项目
- 修改同步接口为兼容性保留，实际操作为空操作
- 移除 Label Studio 连接诊断功能
- 更新文档说明以反映内嵌编辑器模式的变化
2026-01-09 12:31:03 +08:00
3aa7f6e3a1
refactor(annotation): 移除对 Label Studio Server 的依赖并切换到内嵌编辑器模式
...
- 移除 LabelStudioClient 和 SyncService 的导入及使用
- 删除与 Label Studio 项目的创建、删除和同步相关代码
- 修改创建数据集映射功能，改为创建 DataMate 标注项目
- 更新删除映射接口，仅进行软删除不再删除 Label Studio 项目
- 修改同步接口为兼容性保留，实际操作为空操作
- 移除 Label Studio 连接诊断功能
- 更新文档说明以反映内嵌编辑器模式的变化
2026-01-09 12:01:20 +08:00
92aa27caa9
mirror
2026-01-09 10:10:58 +08:00
adb90bbf10
mirror
2026-01-09 09:28:02 +08:00
fafe4c6a41
mirror
2026-01-09 08:56:15 +08:00
a98cdae209
mirror
2026-01-09 08:51:58 +08:00
4d228ba739
mirror
2026-01-09 08:49:18 +08:00
f3f1609455
mirror
2026-01-09 08:46:01 +08:00
d5b75fee0d
LSF
2026-01-07 00:00:16 +08:00
hhhhsc701
7d4dcb756b
fix: 修复入库可能重复;筛选逻辑优化 ( #226 )
...
* 修改数据清洗筛选逻辑-筛选修改为多选
* 修改数据清洗筛选逻辑-筛选修改为多选
* antd 组件库样式定制修改
* fix: 修复入库可能重复
* fix: 算子市场筛选逻辑优化
* fix: 清洗任务创建筛选逻辑优化
* fix: 清洗任务创建筛选逻辑优化
---------
Co-authored-by: chase <byzhangxin11@126.com >
2026-01-06 17:57:25 +08:00
Kecheng Sha
49cc98941f
优化合成任务数据集选择交互体验 ( #225 )
2026-01-06 15:02:06 +08:00
o0Shark0o
843bfef07b
fix: correct dataset file pagination for synthesis task
2026-01-06 11:28:37 +08:00
hefanli
a15a6134ff
fix the ratio task config ( #224 )
...
* fix: fix the dataset card icon
* fix: fix the dataset file tag distribution and ratio task
* refactor: change dateRange config from latest to start-end
2026-01-05 17:02:28 +08:00
Kecheng Sha
3f1ad6a872
feat(auto-annotation): integrate YOLO auto-labeling and enhance data management ( #223 )
...
* feat(auto-annotation): initial setup
* chore: remove package-lock.json
* chore: 清理本地测试脚本与 Maven 设置
* chore: change package-lock.json
2026-01-05 14:22:44 +08:00
hefanli
ccfb84c034
feature: add mysql collection and starrocks collection ( #222 )
...
* fix: fix the path for backend-python imaage building
* feature: add mysql collection and starrocks collection
* feature: add mysql collection and starrocks collection
* fix: change the permission of those files which collected from nfs to 754
* fix: delete collected files, config files and log files while deleting collection task
* fix: add the collection task detail api
* fix: change the log of collecting for dataset
* fix: add collection task selecting while creating and updating dataset
* fix: set the umask value to 0022 for java process
2026-01-04 19:05:08 +08:00
hhhhsc701
8d61eb28c3
fix: ray部署修改 ( #221 )
2026-01-04 09:42:25 +08:00
Dallas98
91f02300d7
feat: update Docker configuration to include backend Nginx settings ( #219 )
...
* feat: 增加label-studio的k8s部署卸载
* Revert "feat: 增加label-studio的k8s部署卸载"
This reverts commit 3e59c33e1de7d2c8d45a1f3d5fb53112a20a24a6.
* feat: update Docker configuration to include backend Nginx settings
2025-12-31 16:44:21 +08:00
o0Shark0o
cbed6fbcd7
Revert "Merge branch 'main' of https://github.com/ModelEngine-Group/DataMate "
...
This reverts commit a12f4c90a534f08df86b
2025-12-31 16:19:19 +08:00
o0Shark0o
a12f4c90a5
Merge branch 'main' of https://github.com/ModelEngine-Group/DataMate
2025-12-31 16:04:05 +08:00
o0Shark0o
34f08df86b
Add lucide icons and colors for video, audio and multimodal operators.
2025-12-31 16:03:57 +08:00
hefanli
3a874fe699
fix: fix the collection for nfs ( #218 )
...
* fix: remove the datax-builder for the Backend Image
* fix: fix the collection for nfs
2025-12-31 15:56:01 +08:00
Kecheng Sha
01e1c6c7e9
polish(operator cards): improve icon color distinction and subtle UI … ( #217 )
...
polish(operator cards): improve icon color distinction and subtle UI details
2025-12-31 10:54:34 +08:00
hhhhsc701
f183b9f2f3
feat: 算子上传适配 ( #216 )
2025-12-31 10:30:32 +08:00
hhhhsc701
6a1eb85e8e
feat: 支持运行data-juicer算子 ( #215 )
...
* feature: 增加data-juicer算子
* feat: 支持运行data-juicer算子
* feat: 支持data-juicer任务下发
* feat: 支持data-juicer结果数据集归档
* feat: 支持data-juicer结果数据集归档
2025-12-31 09:20:41 +08:00
hefanli
63f4e3e447
refactor: modify data collection to python implementation ( #214 )
...
* feature: LabelStudio jumps without login
* refactor: modify data collection to python implementation
* refactor: modify data collection to python implementation
* refactor: modify data collection to python implementation
* refactor: modify data collection to python implementation
* refactor: modify data collection to python implementation
* refactor: modify data collection to python implementation
* fix: remove terrabase dependency
* feature: add the collection task executions page and the collection template page
* fix: fix the collection task creation
* fix: fix the collection task creation
2025-12-30 18:48:43 +08:00
hhhhsc701
80d4dfd285
feat: 修复清洗任务创建 ( #207 )
2025-12-30 14:41:39 +08:00
Dallas98
c7ee10b007
feat: 增加label-studio的k8s部署卸载 ( #206 )
2025-12-30 10:26:13 +08:00
Kecheng Sha
e22f16166c
fix: reset pagination when switching operator market category filters ( #205 )
2025-12-29 15:16:33 +08:00
Kecheng Sha
081abf7d2f
Revert "feat: fix the problem in the Operator Market frontend pages" ( #204 )
...
Reverts ModelEngine-Group/DataMate#203
2025-12-29 12:01:19 +08:00
Kecheng Sha
0df7a872e4
Revert "feat: fix the problem in the Operator Market frontend pages"
2025-12-29 12:00:37 +08:00
Kecheng Sha
8f30f71a68
feat: fix the problem in the Operator Market frontend pages ( #203 )
2025-12-29 11:50:01 +08:00
root
844add27ea
feat: fix the problem in the Operator Market frontend pages
2025-12-29 11:38:47 +08:00
hefanli
29e4a333a9
feature: LabelStudio jumps without login ( #201 )
2025-12-25 16:49:06 +08:00
hhhhsc701
87e73d3bf7
feat: label-studio支持指定sc ( #200 )
...
* feat: label-studio构建脚本
* feat: label-studio构建脚本
* feat: label-studio构建脚本
* feat: label-studio安装脚本
* feat: label-studio支持指定sc
2025-12-25 16:13:38 +08:00
hhhhsc701
7e842c7cd5
feat: label-studio构建脚本 ( #198 )
...
* feat: label-studio构建脚本
* feat: label-studio构建脚本
* feat: label-studio构建脚本
* feat: label-studio安装脚本
2025-12-25 11:44:05 +08:00
hhhhsc701
1c507ac98a
feat: 支持npu自动扩缩容 ( #197 )
...
* feat: npu动态调度
* feat: 数据集分页优化
* feat: 支持npu自动扩缩容
* feat: 支持npu自动扩缩容
* feat: 支持npu自动扩缩容
* feat: clean code
2025-12-24 18:03:30 +08:00
Dallas98
de7f853c83
feat: add CodeQL analysis workflow configuration ( #196 )
2025-12-24 12:14:16 +08:00
hefanli
215d7f0612
Fix the ratio task bug ( #194 )
...
* fix: add feign client configurations
* fix: add nacos configurations
* fix: add python to gateway
* fix: Fix the ratio task bug
2025-12-24 11:40:26 +08:00
hhhhsc701
6d61348388
feat: deer-flow通过gateway转发 ( #193 )
2025-12-23 11:35:45 +08:00
hhhhsc701
d82bff441a
fix: prevent deletion of predefined operators and improve error handling ( #192 )
...
* fix: prevent deletion of predefined operators and improve error handling
* fix: prevent deletion of predefined operators and improve error handling
2025-12-22 19:30:41 +08:00
hefanli
c1516c87b6
Feat gateway ( #191 )
...
* fix: fix the routes definition
* fix: fix the helm installing file
* fix: modify the logging dependencies
2025-12-22 18:58:55 +08:00
hefanli
d419eec3ec
fix: fix the routes definition ( #189 )
2025-12-22 16:04:49 +08:00
hefanli
e5b28c26b1
add gateway ( #187 )
...
* feature: add gateway
2025-12-22 15:41:17 +08:00
hhhhsc701
46f4a8c219
feat: add download functionality for example operator and update Dock… ( #188 )
...
* feat: add download functionality for example operator and update Dockerfile
* feat: enhance download response by exposing content disposition header
* feat: update download function to accept filename parameter for example operator
2025-12-22 15:39:32 +08:00
Dallas98
8fc4455b57
配置文件更改 ( #186 )
...
* feat(generation_service): add image URL extraction and random QA generation logic
* fix(generation_service): increase batch size from 20 to 100 for improved chunk processing
* fix(generation_service): increase batch size from 20 to 100 for improved chunk processing
2025-12-22 09:29:00 +08:00
Dallas98
85eb5a99ba
feat(generation_service): add image URL extraction and random QA generation logic ( #182 )
2025-12-19 17:36:00 +08:00
