q792602257/DataMate
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • d70a3eda0d feat(generation_service): add document filtering to remove short documents based on chunk size (#180) Dallas98 2025-12-19 09:34:02 +08:00
  • be875086db feat: add operator-packages-volume to docker-compose and update Docke… (#179) hhhhsc701 2025-12-18 20:32:42 +08:00
  • 27b1cc8e09 feat(model_chat): enhance JSON parsing by removing additional thought tags and improving fallback logic (#178) Dallas98 2025-12-18 19:19:54 +08:00
  • e0e9b1d94d feat：问题生成过程优化及COT数据生成优化 (#169) Dallas98 2025-12-18 16:51:18 +08:00
  • 761f7f6a51 fix: optimize PDF parsing by implementing concurrent processing with … (#177) hhhhsc701 2025-12-18 15:28:30 +08:00
  • 8113840ac7 fix(docker-compose): update entrypoint and command for mineru-openai-server configuration (#176) Dallas98 2025-12-17 21:23:03 +08:00
  • 12ade8bc7b fix: streamline Dockerfile by removing redundant mirror configuration… (#175) hhhhsc701 2025-12-17 16:34:41 +08:00
  • 924d977d6f 支持mineru npu处理 (#174) hhhhsc701 2025-12-17 16:31:06 +08:00
  • 3b4f8488e8 fix: update Dockerfile to improve pip installation process and remove unnecessary uninstalls (#173) hhhhsc701 2025-12-17 11:49:47 +08:00
  • 62b91b6deb bugfix: update values.yaml to enhance ray-cluster configuration with security context, environment variables, and resource limits (#172) hhhhsc701 2025-12-17 10:41:13 +08:00
  • 082aca1597 fix: the interface for querying data set files is compatible with ret… (#171) hefanli 2025-12-16 11:31:52 +08:00
  • b3558d3202 修改系统参数的预置数据 (#170) hefanli 2025-12-15 16:43:22 +08:00
  • 4712f00196 feature: add the pipeline for pushing images to Huawei Cloud (#167) hefanli 2025-12-12 16:44:43 +08:00
  • c51058a867 feature: 商业版构建 (#166) hhhhsc701 2025-12-12 16:19:46 +08:00
  • d8c0b0ed73 补充modal范围 (#165) hhhhsc701 2025-12-12 13:34:03 +08:00
  • fc9fb07e77 bugfix (#164) hhhhsc701 2025-12-11 23:17:01 +08:00
  • ec87e4f204 feat(frontend): 增强Synthesis Data Detail页面UX体验 (#163) Dallas98 2025-12-11 21:02:44 +08:00
  • 8f529952f6 Fix ratio (#162) hefanli 2025-12-11 17:45:16 +08:00
  • bb8641bea2 docs: update README files to include instructions for accessing the f… (#161) hhhhsc701 2025-12-11 16:15:23 +08:00
  • 12529276ee fix(settings): improve ModelAccess table responsiveness during browser zoom o0Shark0o 2025-12-11 14:53:01 +08:00
  • 72669d1293 feat: add .env and conf.yaml for deer-flow configuration (#160) hhhhsc701 2025-12-11 14:33:06 +08:00
  • a6e82ce68b fix: update MILVUS_URI in .env.example for correct service endpoint (#159) hhhhsc701 2025-12-11 14:17:02 +08:00
  • f69ed6b8aa Revert "feature: 增加data-juicer算子" (#158) hhhhsc701 2025-12-11 10:32:53 +08:00
  • 786f13f9c3 feature: 增加data-juicer算子 (#157) hhhhsc701 2025-12-11 10:32:19 +08:00
  • cfa6301e9e feat(annotation-templates): add new NLP templates for multilabel classification, keyword extraction, and text summarization o0Shark0o 2025-12-11 09:37:32 +08:00
  • 2f3ae21f8a feat: enhance dataset file fetching with improved pagination and document loading support (#156) Dallas98 2025-12-10 22:39:24 +08:00
  • e9fd6a3ae1 fix: adjust pagination logic in dataset fetching to start from the current page Dallas98 2025-12-10 19:52:06 +08:00
  • 174359be9f feat(milvus): update Milvus configuration to use URI and remove deprecated host/port settings (#155) Dallas98 2025-12-10 18:41:20 +08:00
  • 99fd46cb70 fix: fix the Data Evaluation Detail page (#154) hefanli 2025-12-10 18:35:29 +08:00
  • 4ed049ca11 feat(milvus): update Milvus configuration to use URI and remove deprecated host/port settings Dallas98 2025-12-10 18:29:21 +08:00
  • 44d72c446f feat(milvus): update Milvus configuration to use URI and remove deprecated host/port settings Dallas98 2025-12-10 18:27:58 +08:00
  • 19a04df276 feature: 增加水印去除/高级匿名化算子 (#151) hhhhsc701 2025-12-10 18:12:47 +08:00
  • cbb146d3d7 feat(chart): add Helm chart for deploying Label Studio with PostgreSQL (#152) Dallas98 2025-12-10 17:46:12 +08:00
  • f87060490c feature: data management supports nested folders (#150) hefanli 2025-12-10 16:42:45 +08:00
  • fea7133dee Merge branch 'main' of github.com:ModelEngine-Group/DataMate o0Shark0o 2025-12-10 15:07:28 +08:00
  • 52accfb44c fix(synthesis-task): 修复文件选择列表中全选按钮无法勾选所有文件的问题 o0Shark0o 2025-12-10 15:05:14 +08:00
  • 103c21945d 修复部分功能 (#138) hhhhsc701 2025-12-10 14:31:05 +08:00
  • c18b7af2c4 docs: update README and Makefile for clarity and new development instructions (#147) Dallas98 2025-12-10 12:25:25 +08:00
  • 6ccbc8a02f feat(dependencies): update greenlet to version 3.3.0 and adjust Python version compatibility (#145) Dallas98 2025-12-10 10:17:48 +08:00
  • 705009cab6 Merge branch 'main' of github.com:ModelEngine-Group/DataMate o0Shark0o 2025-12-10 09:56:57 +08:00
  • d9ce140c1f Merge branch 'main' of github.com:ModelEngine-Group/DataMate uname 2025-12-09 20:13:57 +08:00
  • a728bc3100 修改数据标注：标注模板到主流语言。 uname 2025-12-09 20:00:43 +08:00
  • f8b32506cf fix: k8s部署场景下，backend-python服务挂载需要存储 (#144) hefanli 2025-12-09 19:09:51 +08:00
  • bef15f328d feat(config): add proxy configuration for evaluation API endpoint (#141) Dallas98 2025-12-09 15:01:44 +08:00
  • 758cf93e36 feature: 增加压缩包上传功能 (#137) hefanli 2025-12-09 14:42:27 +08:00
  • 015e738a7f feat(SynthDataDetail): add chunk/synthesis data management with edit/delete & UI enhancements (#139) Dallas98 2025-12-09 09:59:40 +08:00
  • cf20299af4 feat: add GitHub Actions workflow for releasing Docker images (#136) Dallas98 2025-12-05 18:51:06 +08:00
  • d59c167da4 算子将抽取与落盘固定到流程中 (#134) hhhhsc701 2025-12-05 17:26:29 +08:00
  • 744d15ba24 fix: 修复评估时模型输出json格式不对导致读取错误的问题 (#133) hefanli 2025-12-04 18:49:50 +08:00
  • 31c4966608 feat(synthesis): add functionality to archive synthesis tasks to existing datasets (#132) Dallas98 2025-12-04 17:11:43 +08:00
  • 7a9530c1e3 feature: 增加对redis未部署时异常捕获 (#131) hhhhsc701 2025-12-04 16:09:29 +08:00
  • 977d16339b feat(synthesis): add chunk-level synthesis data detail page & refine APIs/routing (#130) Dallas98 2025-12-04 14:27:01 +08:00
  • 7012a9ad98 feat: enhance backend deployment, frontend file selection and synthesis task management (#129) Dallas98 2025-12-04 09:57:13 +08:00
  • 1d19cd3a62 feature: add data-evaluation hefanli 2025-12-04 09:23:54 +08:00
  • 265e284fb8 feature: 修改算子开发指南 (#127) hhhhsc701 2025-12-03 17:45:08 +08:00
  • c22683d635 优化部分问题 (#126) hhhhsc701 2025-12-03 16:41:48 +08:00
  • 04cff3f7e6 fix: Correctly extract file values from selectedFilesMap in AddDataDialog (#125) Dallas98 2025-12-03 11:47:32 +08:00
  • b5fa8af900 bugfix: 修复deer-flow部署 (#124) hhhhsc701 2025-12-02 19:23:30 +08:00
  • bcd1bc1534 feat: Update Python version requirements and refine dependency constraints in configuration (#123) Dallas98 2025-12-02 16:34:22 +08:00
  • 8b164cb012 feat: Implement data synthesis task management with database models and API endpoints (#122) Dallas98 2025-12-02 15:23:58 +08:00
  • 458afa2966 feat: Add original file ID to document metadata in RagEtlService #121 Dallas98 2025-12-02 15:10:07 +08:00
  • d692f5fdae feat: new endpoint allowing only add file path to dataset record without any FS operations (#119) Jason Wang 2025-12-01 20:31:06 +08:00
  • f730bd5b0c bugfix: 支持使用runtime单实例 (#118) hhhhsc701 2025-12-01 19:05:50 +08:00
  • 9fc35f066f feat: Add original file ID to document metadata in RagEtlService Dallas98 2025-12-01 17:04:52 +08:00
  • bb3345268e bugfix: 清洗/算子支持名称/描述搜索 (#116) hhhhsc701 2025-11-29 18:15:43 +08:00
  • 5c178d5274 Integrated Redux for state management with auth and settings slices. (#117) chenghh-9609 2025-11-29 17:37:36 +08:00
  • 2e13bb9b4c feat: Add download and load images functionality to Makefile (#115) Jason Wang 2025-11-29 10:53:19 +08:00
  • fe42b03548 bugfix: milvus部分组件支持镜像仓库 (#114) hhhhsc701 2025-11-28 17:39:56 +08:00
  • 07029d07ff 优化清洗重试机制，优化清洗进度展示，修复模板无法展示参数 (#113) hhhhsc701 2025-11-28 15:28:10 +08:00
  • f1bffdcd61 bugfix: 创建清洗任务时修改数据集状态；无法删除已在模板/运行任务的算子 hhhhsc701 2025-11-27 17:34:53 +08:00
  • 91390cace0 feature: 北向接口：支持通过模板创建清洗任务 (#111) hhhhsc701 2025-11-26 17:30:54 +08:00
  • 0ca5f29885 feat: Add build target for generic docker builds in Makefile (#110) Jason Wang 2025-11-26 14:35:07 +08:00
  • bc2f57f2c0 feature: 修改缩进 (#109) hhhhsc701 2025-11-26 11:24:50 +08:00
  • bc26cfba55 feat: Refactor knowledge base retrieval to return detailed search results and enhance API integration #108 Dallas98 2025-11-25 21:21:21 +08:00
  • b50c12d135 feature: 删除kuberay镜像推送 (#107) hhhhsc701 2025-11-25 17:46:50 +08:00
  • c097a06fbe feat: Improve makefile readability, Add user control on volume keep at uninstallation, Add Label Studio install and uninstall via Make. (#106) Jason Wang 2025-11-25 17:37:28 +08:00
  • af2a01e52d feature: milvus pvc支持本地目录 (#105) hhhhsc701 2025-11-25 16:54:24 +08:00
  • fb399b74cf feature: pvc支持本地盘+配置sc (#104) hhhhsc701 2025-11-24 17:29:32 +08:00
  • c1352ab91f feature: multiple ratio configurations can be set for the data set. (#103) hefanli 2025-11-24 15:28:17 +08:00
  • 497a5688e9 feature: df构建双架构镜像 (#102) hhhhsc701 2025-11-24 11:52:08 +08:00
  • a53f6776b8 feature: 构建双架构镜像 (#101) hhhhsc701 2025-11-24 11:34:53 +08:00
  • 9858388084 feat: Refactor dataset file pagination and enhance retrieval functionality with new request structure #98 Dallas98 2025-11-21 17:28:25 +08:00
  • 536ef9f556 feature: milvus service名称变更 兼容k8s (#97) hhhhsc701 2025-11-21 12:06:53 +08:00
  • fdfcfec1f1 update knowledge base file selection component (#96) chenghh-9609 2025-11-21 11:39:26 +08:00
  • cddfe9b149 feature: 数据配比增加通过更新时间来配置 (#95) hefanli 2025-11-20 18:50:51 +08:00
  • 955ffff6cd add select dataset files component (#94) chenghh-9609 2025-11-20 14:12:59 +08:00
  • a07fba23f2 feature：数据集导入数据集支持选择归集任务导入 (#92) hefanli 2025-11-19 11:05:33 +08:00
  • 4506fa8a91 feat: Enhance AddDataDialog with dataset file selection and improved upload process (#91) Dallas98 2025-11-18 20:48:28 +08:00
  • 5da992d312 feature：增加obs归集方式 (#90) Vincent 2025-11-18 09:24:07 +08:00
  • 04a233b803 fix: 修复知识库问题 (#89) Dallas98 2025-11-17 19:11:04 +08:00
  • 145c154d1f feat: Integrate Milvus service for enhanced knowledge base management and file deletion (#88) Dallas98 2025-11-17 17:36:09 +08:00
  • e300d13c21 feat: Enhance dataset file management with improved file copying Dallas98 2025-11-14 23:30:28 +08:00
  • 5638bdcf1c feat: add file copying functionality to dataset directory and update base path configuration Dallas98 2025-11-14 18:05:40 +08:00
  • d9e163c163 Develop deer flow (#85) hhhhsc701 2025-11-14 17:36:55 +08:00
  • df853a5177 feat: Enhance file tag update functionality with automatic format conversion (#84) Jason Wang 2025-11-14 12:42:39 +08:00
  • 5cef9cb273 feature: deer-flow支持从datamate获取外部接入模型 (#83) hhhhsc701 2025-11-13 20:13:16 +08:00
  • 604fd019d5 fix: restore HTTP query parameter from 'pageSize' to 'size' (#82) Jason Wang 2025-11-13 17:41:56 +08:00
  • 15498f27cf feat: add file copying functionality to dataset directory and update base path configuration #80 Dallas98 2025-11-13 16:52:14 +08:00
  • 960323f41c fix: Restore database-docker-build to build target (#81) Jason Wang 2025-11-13 16:25:42 +08:00
  • 45743f39f5 feat: add labeling template. refactor: switch to Poetry, build and deploy of backend Python (#79) Jason Wang 2025-11-13 15:32:30 +08:00