* feat: Implement data synthesis task management with database models and API endpoints
* feat: Update Python version requirements and refine dependency constraints in configuration
* fix: Correctly extract file values from selectedFilesMap in AddDataDialog
* feat: Refactor synthesis task routes and enhance file task management in the API
* feat: Enhance SynthesisTaskTab with tooltip actions and add chunk data retrieval in API
* feat: Implement data synthesis task management with database models and API endpoints
* feat: Update Python version requirements and refine dependency constraints in configuration
* fix: Correctly extract file values from selectedFilesMap in AddDataDialog
* feat: Implement data synthesis task management with database models and API endpoints
* feat: Update Python version requirements and refine dependency constraints in configuration
* feat: Implement DatasetFileTransfer component for file selection and management
* feat: Add pagination support to file list in Overview component
* feat: add DatasetFileTransfer and TagManagement components
- Added DatasetFileTransfer component for managing dataset files.
- Introduced TagManagement component for handling tags.
- Integrated Redux for state management with auth and settings slices.
- Updated package.json to include @reduxjs/toolkit and react-redux dependencies.
- Refactored existing components to utilize new DatasetFileTransfer and TagManagement components.
- Implemented hooks for typed dispatch and selector in Redux.
- Enhanced CreateKnowledgeBase and SynthesisTask components to support new features.
* feature: Add label studio installation and uninstallation commands to Makefile
* feature: Enhance Makefile with detailed help commands and improve install/uninstall targets for services
* feature: Update Makefile help commands to clarify usage of local images
* feature: Improve error handling in Makefile for build, install, and uninstall targets
* feature: Enhance uninstall process in Makefile to prompt for volume deletion and update README with usage details
---------
Co-authored-by: Jason Wang <wjl_jason@qq.com>
* feat: Enhance knowledge base management with collection renaming, imp…
* feat: Update Milvus integration with new API, enhance collection mana…
* Merge branch 'refs/heads/main' into dev
* feat: Refactor dataset file pagination and enhance retrieval function…
* Merge branch 'main' into dev
* feat: Refactor AddDataDialog and introduce DatasetFileTransfer component for improved file selection and management
* feat: Refactor SynthesisTask and InstructionTemplate components for improved UI and functionality; integrate DatasetFileTransfer for file management
* feat: Enhance CollectionTaskCreate form with additional fields for MYSQL configuration and prefix input
* feat: Refactor system parameter management with new data structure and update logic
* feat: Enhance dataset file management with improved file copying
* feat: Enhance dataset file management with improved file copying
* fix: 修复知识库相关问题
* feat: Integrate Milvus service for enhanced knowledge base management and file deletion
- Updated `update_file_tags` to support both simplified and full tag formats.
- Introduced `TagFormatConverter` to handle conversion from simplified external tags to internal storage format.
- Added logic to fetch and utilize the appropriate annotation template for conversion.
- Improved error handling for missing templates and unknown controls during tag updates.
- Created example script demonstrating the usage of the new tag format conversion feature.
- Added unit tests for `TagFormatConverter` to ensure correct functionality and edge case handling.
* feat: Enhance annotation module with template management and validation
- Added DatasetMappingCreateRequest and DatasetMappingUpdateRequest schemas to handle dataset mapping requests with camelCase and snake_case support.
- Introduced Annotation Template schemas including CreateAnnotationTemplateRequest, UpdateAnnotationTemplateRequest, and AnnotationTemplateResponse for managing annotation templates.
- Implemented AnnotationTemplateService for creating, updating, retrieving, and deleting annotation templates, including validation of configurations and XML generation.
- Added utility class LabelStudioConfigValidator for validating Label Studio configurations and XML formats.
- Updated database schema for annotation templates and labeling projects to include new fields and constraints.
- Seeded initial annotation templates for various use cases including image classification, object detection, and text classification.
* feat: Enhance TemplateForm with improved validation and dynamic field rendering; update LabelStudio config validation for camelCase support
* feat: Update docker-compose.yml to mark datamate dataset volume and network as external
* feat: Add tag configuration management and related components
- Introduced new components for tag selection and browsing in the frontend.
- Added API endpoint to fetch tag configuration from the backend.
- Implemented tag configuration management in the backend, including loading from YAML.
- Enhanced template service to support dynamic tag rendering based on configuration.
- Updated validation utilities to incorporate tag configuration checks.
- Refactored existing code to utilize the new tag configuration structure.
* feat: Refactor LabelStudioTagConfig for improved configuration loading and validation
* feat: Update Makefile to include backend-python-docker-build in the build process
* feat: Migrate to poetry for better deps management
* Add pyyaml dependency and update Dockerfile to use Poetry for dependency management
- Added pyyaml (>=6.0.3,<7.0.0) to pyproject.toml dependencies.
- Updated Dockerfile to install Poetry and manage dependencies using it.
- Improved layer caching by copying only dependency files before the application code.
- Removed unnecessary installation of build dependencies to keep the final image size small.
* feat: Remove duplicated backend-python-docker-build target from Makefile
* fix: airflow is not ready for adding yet
* feat: update Python version to 3.12 and remove project installation step in Dockerfile
