Documents
Part of Document management software compared
Testing document search with a realistic file collection
Build a realistic document search trial using similar filenames, scans, metadata, versions and user permissions.
Test document search with files that resemble the collection people will use, then ask intended users to find specific answers. One perfectly named demonstration file will not reveal problems with similar titles, scans, restricted records or wording that appears only in an older version.
Build the collection
Use fictional or cleared files. Include two similarly named policies, a document with the target phrase only in its body, a PDF with selectable text, a scan without selectable text, a file with useful metadata and a superseded version.
Add one file the test searcher must not be able to open. Record the expected answer and permitted audience for each task before uploading.
Give each system the same files and metadata. Record the upload time and use a consistent wait before comparing results. If the system exposes indexing status, record it before treating an immediate miss as a final result.
| Task | What to record |
|---|---|
| Find by filename | Does the intended file appear among similar names? |
| Find by body phrase | Is the phrase found in supported file types? |
| Find a scan | Was its text extracted, or is only the filename found? |
| Narrow by context | Which owner, folder, date or metadata filters are available? |
| Check access | Can a restricted user see or open a file they should not access? |
| Find earlier wording | Does search retrieve it, or must the user open version history? |
Interpret product boundaries
Box's help page lists filters for keywords, file type, date modified, owner, folder, comments, descriptions, file and folder names, file contents, tags and metadata. It also describes exact-phrase and Boolean searches.
For Google Drive, test the searches users are expected to run in the workflow you expect them to follow. Do not infer that every format or scan will yield the same result.
SharePoint modern search shows users content they can access, and search scope can change with the location selected. Search from the library or site used in the proposed workflow.
An administrator's successful search does not establish what an ordinary staff member will find.
Search capabilities across major platforms
- BoxSupports keyword, file type, date modified, owner, folder, comments, descriptions, file/folder names, file contents, tags, metadata; supports exact-phrase and Boolean searches
- Google DriveDepends on file format and indexing; not all scans or formats yield consistent results
- SharePoint Modern SearchShows content based on user access; scope varies by location (library or site); requires testing in intended workflow context
Run the tasks with real roles
Ask a document owner and a typical reader to complete the written tasks without hints. Record each query, filter, result and opened file.
For a missing result, check format, indexing state, access and metadata before deciding what failed. Have someone unfamiliar with the collection repeat the most important task.
Set a practical pass condition: people who need the approved document can find it without gaining access to restricted material. If scans or past versions are essential, require a demonstrated route for them. Search may need to be paired with OCR, an archive or version history.
