Review Sets

Creating Review Sets

1. Click on the Discovery menu at the top of the screen and select "Review Sets"

2. Click + Add Review Set in the upper right corner

3. In the Create Review Set window, enter the Name of the Review Set and select a sort option (Master Date and Source File Path are the current sort options). Document families are always kept together during review with the parent being immediately followed by any children regardless of the chosen sort. 

• Master Date will provide documents for review in chronological order.

• Source File Path is tailored toward non-email files that were in heavily nested folders on disk. This option will provide documents for review based on their file path.

4. Click "Create Review Set" to save.

Adding Documents to Review Sets

1. Navigate to the Browse or Search page.

2. Use Quick Links, Filters, Search, or a combination thereof to identify documents to add to a Review Set

3. Select documents individually,  or use the Select dropdown menu to select "Page"  (selects all documents currently displayed), or "All" (selects all documents currently available on the Browse or Search screens).

4. Once selected, expand the Review Sets menu on the left side of the screen and select the desired Review Set from the dropdown menu.

5. A confirmation window with an "Expand to Entire Email Family" checkbox will appear. Check the box to add the selected documents plus all family members to the Review Set, or uncheck it to only add the selected documents. Regardless of the below, this checkbox can be checked or unchecked as needed.

   • • If the Paperclip is enabled when adding documents to a Review Set, the "Expand to Entire Email Family" checkbox will be checked by default.

     • If the Paperclip is not enabled, the "Expand to Entire Email Family" checkbox will be unchecked by default.

6. Click OK to add the documents to the Review Set.

**NOTE: Documents cannot be removed from a review set once added. If documents are added that do not need to be reviewed, the user should create a new review set and add only the necessary documents.

Editing, Deleting,  and Releasing Review Sets

Account Admins can use the below buttons to complete the above listed actions (Fig. 1).

Fig. 1  Account Admin Display Before Review Set is Released

Accessing Documents for Review

1. Review Sets that have been made available by the Account Admin will be displayed on the Review Sets page in alphanumeric order.

2. To begin reviewing, click "Start" on the left side of the screen next to the name of the corresponding Review Set (Fig. 2). The first document will populate in the doc viewer, and the user may begin their review.

3. Users have the option to use the Same as Last button which is available under the Auto Advance and Propagate Coding checkboxes. Click this button to apply the coding changes from the last reviewed document to the current document. Changes will not be saved until Save has been clicked.

4. Once the document has been coded, click "Save", or use keyboard shortcut Alt+S to save coding and advance to the next document. 

   • • If the document is not part of a family, then it will be checked in and the next document checked out.

     • If the document is part of a family, you'll advance to the next family member belonging to the review set, and then the family will be checked in once coded in its entirety.

     • In instances where the Propagate Coding feature is selected, and the user does not wish to review all attachments to an email, the keyboard shortcut Alt+K will save coding, check-in the document family, and advance to the next document without having to review its attachments.

Fig. 2  Review Display Once Review Set is Released

5. As documents are reviewed a history of those documents will populate in the left panel. This panel can be accessed by clicking the double arrow in the lower left corner (Fig. 3). This panel provides the following functionality:

1. • The Reviewed Documents list provides hyperlinks to the last 30 (more when email families are present) documents reviewed by that user in that review set. Click on a document title in the list to open it. Click the document at the top of the list or the Resume Workflow button to return to the most recent document.

   • Documents where the Document Reviewed By Me label appears will appear light grey in the history. Documents where the Reviewed By Others label is displayed (i.e. a user clicks Save without having coded the document) will appear black in the history (Fig. 3).

   • An icon will appear next to a document if an issue is detected that would need to be addressed as part of validating a production job (Fig.3). These are pre-production validation flags. These flags are informational only, and will not prevent users from continuing with their review. These flags are triggered by the following:

     • 1. Inconsistent responsiveness coding across a family

       2. Inconsistent privilege coding across a family

       3. Missing redactions on a partially privileged document

       4. Documents coded as Not Specified or Needs Further Review 

   • The Reviewed Documents list will appear and continue to populate even when a user exits the review set and then returns to that review set at a later time.

   • This feature is only available when the Doc Viewer has been accessed via the Review Sets page.

Fig. 3 Review Sets Doc Viewer

6. Users can exit the review at any time by clicking "Exit Review" and they'll be returned to the Review Sets page.

1. • Click "Continue" to resume reviewing where you left off (Fig. 4).

   • Click "Stop" to check-in the document or document family that's currently displayed under the name of the Review Set (Fig. 4).

NOTE: As documents are reviewed, the number of documents remaining in the review set will be displayed under the DISC tab of the doc viewer, along with the type of document you are currently reviewing. Additionally, when reviewing a family the Documents Remaining count will only decrease once the entire family has been reviewed.

Fig. 4 Reviewer Display Once Review has Started

Review Tracker Functionality

Accessing the Review Tracker

1. To access the Review Tracker, click "Review Tracking" in the upper right corner of the blue bar on the Review Sets page (Fig. 1).

2. Click "Review Sets" to return to the Review Sets screen.

Display Options

1. The Table display is the default display along with the Doc Count and Daily options selected (these options generate a report showing the number of documents reviewed, per day, per reviewer).

2. To switch to the graph view, click "Graph" (Fig. 5).

   • • The X axis of the graph plots the selected time interval (i.e. Daily or Hourly) of the tracking report.

     • The Y axis of the graph plots the volume of the selected option (i.e. Doc Count, Pages, GB, or Activity) per reviewer.

     • The legend on the right assigns a line color to users that have reviewed documents.

     • Hovering over the points of intersection on the graph will display the values for each reviewer that correspond to the selected options.

     • Hovering over the usernames in the legend will display the total values for each reviewer that correspond to the selected options.

3. To return to the Table view, click "Show Table."

Applying Filters

1. Filters can be applied to achieve more specific results. To apply a filter, click "+ Filters."

3. • • Filters will remain applied when Exporting, switching to the Graph view, or changing the report options.

2. To remove filters, refresh the page.

Generating and Exporting Reports

1. To generate a report, select the desired metric: Doc Count, Pages, GB, or Activity, in combination with the desired interval: Daily or Hourly (Fig. 5).

   1. • These options will remain selected until the user leaves or refreshes the page.

2. Currently, the report can only be exported from the Table display. To export the report, click "Export" and save locally.

   1. • Exported values will reflect those on the screen at the time of export. As such, users can export filtered values if desired.

Fig. 5 Review Tracking Displays