HRW Media Archive Script Library

Bag Project Script

This script analyzes a completed project folder and creates a set of log files, including a recursive list of files contained in the folder (index), disk usage sizes and file counts of folders on the the top-level directory, and full checksums for each file.

Once this process is complete, the resulting folder, data, and logs constitute a “bag” for long-term storage and digital preservation.

Media Ingest Script

The HRW Ingest script (ingest-wfh.sh) is used to ingest data from completed projects that were produced by staff working from home. It moves files from a source location to a destination and creates rsync file transfer logs. To use the ingest script...

1. Drag the "ingest_universal.sh" file to your Desktop

2. To run the file, open Terminal and enter:

sh ~/Desktop/ingest-wfh.sh

3. When prompted, enter your name, then name of the sender of the project you'd like to ingest. Use an underscore instead of spaces. For example:

Samir_Muscati

4. When prompted, drag and drop the HRW project folder of the source data you would like to transfer into the Terminal window. Drag the project folder itself, not the individual set of folders it contains. For example:

/Volumes/MM_Remote_Drive/202208CRD_US_Child_Labor

5. When prompted, enter the destination location where you would like to transfer this project. This will be an HRW division folder within the rest of the video collection. For example:

/Volumes/destination/_MM_BACKUP_3/VIDEO_3/CRD

7. At this point, a transfer of the data begins. A "temp-logs" folder is created on your computer's desktop. This folder stores logs temporarily. Depending on the size of the data transfer, this process may take seconds, minutes, or hours. Unfortunately there is no progress bar.

8. When the script has finished running it will open the .txt log it created in Text Edit so you can review results. Check logs to make sure all of the data present in the source location was properly transferred to the destination location.

9. Manually check to make sure files are present in the folder you specified.

10. Yay!