You've already forked DataMate
feat(dataset): 实现数据集文件可见性过滤功能
- 添加派生文件识别逻辑,通过元数据中的derived_from_file_id字段判断 - 实现applyVisibleFileCounts方法为数据集批量设置可见文件数量 - 修改数据集统计接口使用过滤后的可见文件进行统计计算 - 添加normalizeFilePath工具方法统一路径格式处理 - 更新文件查询逻辑支持派生文件过滤功能 - 新增DatasetFileCount DTO用于文件计数统计返回
This commit is contained in:
@@ -145,9 +145,10 @@
|
||||
|
||||
<select id="getAllDatasetStatistics" resultType="com.datamate.datamanagement.interfaces.dto.AllDatasetStatisticsResponse">
|
||||
SELECT
|
||||
COUNT(*) AS total_datasets,
|
||||
SUM(size_bytes) AS total_size,
|
||||
SUM(file_count) AS total_files
|
||||
FROM t_dm_datasets;
|
||||
(SELECT COUNT(*) FROM t_dm_datasets) AS total_datasets,
|
||||
(SELECT COALESCE(SUM(size_bytes), 0) FROM t_dm_datasets) AS total_size,
|
||||
(SELECT COUNT(*)
|
||||
FROM t_dm_dataset_files
|
||||
WHERE metadata IS NULL OR JSON_EXTRACT(metadata, '$.derived_from_file_id') IS NULL) AS total_files
|
||||
</select>
|
||||
</mapper>
|
||||
|
||||
Reference in New Issue
Block a user