xfr/longitudinal
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
3 commits 1 branch 0 tags 258 KiB
Python 100%
Find a file
Furen Xiao 33bc3c603f refactor(core): improve data pipeline robustness and manifest generation 
Refactor the data loading and preprocessing pipeline to handle edge cases in
medical imaging data, including NaN/Inf values, shape mismatches, and
numerical instability during training.

- Update `01_build_ntuh_manifest.py` with improved regex for T1c detection,
  spine exclusion, and deduplication logic based on acquisition timestamps.
- Enhance `PatchDataset` in `src/dataset.py` to handle NaN/Inf values,
  clip intensity ranges, and ensure label/image shape alignment via
  padding/trimming.
- Add a zero-gradient fallback in `src/training.py` to prevent DDP
  synchronization failures when encountering NaN/Inf losses.
- Add `scripts/scan_procs.py` for process monitoring.
- Increase DataLoader timeout to prevent hangs during heavy I/O.
2026-09-25 22:12:32 +08:00
scripts refactor(core): improve data pipeline robustness and manifest generation 2026-09-25 22:12:32 +08:00
src refactor(core): improve data pipeline robustness and manifest generation 2026-09-25 22:12:32 +08:00
.gitignore feat: initial project structure 2026-09-25 16:00:37 +08:00
AGENTS.md feat: initial project structure 2026-09-25 16:00:37 +08:00
README.md first commit 2026-09-25 10:15:20 +08:00

README.md