Repository containing the data lake creation and configuration script to be used in the project.
Docker >= 28.3.3
First, inside config directory, create an .env file using the .env.example file as a base. Edit the new file with the username and password for MinIO data lake. These will be the root user's login credentials. Next, run the setup file with command below. Make sure you are running from project root directory to avoid unreachable references. MinIO data lake service will be start automatically.
./setup.sh
The above script will create inside datalake directory all pre-defined buckets.
To start MinIO data lake service:
docker start rionowcast-minio
To stop MinIO data lake service:
docker stop rionowcast-minio
To get access to MinIO data lake GUI, access localhost:9101 from your web browser. MinIO data lake login page will be shown. Enter credentials defined in the .env file.
For data organization inside the data lake, the conventions defined in docs/convention.md should be followed.
For data catalog metadata, see docs/metadata.md.