| Table of Contents |
|---|
Reviewing for restrictions in digital material is mostly the same as reviewing physical material except there is software that we use to search the files for restrictions as well. If the amount of files are very small you might just stick to reviewing the folder and filenames and possibly looking at the files without running the tools below.
...
- The documentation goes over how to review the report. In general, you want to go through the different results looking at their context. Open the files if necessary for further context.
- Those files that are false positives should be marked as dismissed.
- If there are positive matches that need restriction, add a note using the pencil button next to the feature, indicating the type of restriction and a short reason, such as "R-75, student health information."
- If you can't complete review of the report immediately, click the Save button to save your progress and return later.
When complete, choose the Download CSV option and save it as bulkreviewer.csv in the submissionDocumentation folder.
Info This file lists the items found and what was dismissed and what wasn't dismissed as well as the note added explaining a restriction. The csv could be used for further description later.
If you encountered files needing restriction, you should also click the "Download tar exclude file" with the default name the system generates and add that the submissionDocumentation folder as well.
Info This file will allow us the means for excluding the restricted files in bulk in the future when providing access to researchers. - When done there are a couple options depending on the situation:
- Continue onto the next group of material with a bulk_extractor report if there are additional ones for the accession.
- If completely finished, proceed to the Preparing for Archivematica steps.
...
In addition to bulk reviewer, you can look choose the "examine contents" option when transfer the material through Archivematica. This won't cover as much mainly surfacing credit card numbers, social security numbers, telephone numbers, and email addresses through their interface. More information can be found in the appraisal tab section of the Archivematica documentation. (link)
Creating
...
new reports
If you did not use one of the CCA tools or chose not to create reports at time of transfer, you can create reports for looking for restricted materials by running reports directly through Bulk Reviewer.
...
To create new reports, follow these steps:
- Click on the Bulk Reviewer shortcut on the BitCurator Desktop.
- Select "Scan new directory or disk image" button
- For the name, use the package name, such as 2020_029acc or if there individual packages from one accession with their own reports, use the object id such as 2020_029_001.
- Select the source as Directory or DIsk Image (depending on the type of files being analyzed) from the drop down menu
- Click the "Choose directory" button and choose the directory containing the files or disk image.
- Under "Regular Expressions File" click the "Choose file" button and select the text file called "InstArch_regex.txt" from the top-level of the BitCurator shared folder. This file performs regular expression keyword matching based on things related to our restriction categories, which enhances the quality of the searching.
- Under Social Security Identification Mode, choose Medium.
- Do not select either of the scanner optionsThis will be within the package under /metadata/submissionDocumentation/bulk_extractor
- Click Start scan.
- This may take a little while, once it is complete, go to the reviewing the report section (link) above.
- Once done with reviewing for restrictions, you can move the bulk_extractor reports generated by Bulk reviwer to the submissionDocumentation folder. These reports will be in the "/home/Bulk Reviewer" directory in a directory with the name you gave when creating the reports in Bulk Reviewer (i.e. the transfer package name such as 2020_029acc or 2020_029_001.