Skip to content

Latest commit

 

History

13 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

DatasetSplit

DatasetSplit is a Python application for splitting a dataset into training, validation, and test sets. It scans a source directory, optionally filters files by extension, shuffles the dataset, and copies files into their respective output folders based on customizable split percentages. It is non-destructive, using copy rather than move operations.

Features

  • Split a dataset into train, validation, and test sets
  • Custom train/validation/test percentages
  • Optional minimum and maximum file counts for each split
  • File extension filtering (all files or a custom comma-separated list)
  • Optional recursive directory scanning
  • Optional retention of subdirectory structure
  • Output summary file with split totals
  • Overwrite, skip, and abort handling for existing files
  • Retry, skip, and abort handling for copy errors
  • Optional random seed for reproducibility
  • Settings persistence

Requirements

  • Python 3.10 or later

Usage

  1. Run the app:
    python dataset_split_app.py

About

Python app for splitting a dataset into training, validation, and test sets with customizable parameters.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages