The hard work starts before the question is typed. Teams need a usable set of project documents, clear revision and approval status, appropriate access, and a route for unanswered questions. AI cannot make a file current or resolve an authority conflict simply by retrieving it.
Make the project source set explicit
List which libraries and record types the assistant may search. Depending on the project, that might include approved drawings, specifications, RFIs, submittals, meeting decisions, or change records. Define what “approved” means in the system the team already uses, and identify how superseded revisions are marked. If those labels are unreliable, fix the document process before asking a model to interpret it.
Keep source and access boundaries visible. Microsoft’s documentation for declarative agents describes grounding in SharePoint or OneDrive content that a user can access, while SharePoint agent controls provide ways to manage access and permitted sources. Those are Microsoft-specific features. They do not guarantee that a contractor’s project library is correctly organized, that every revision is current, or that another assistant follows the same rules. Microsoft: Add knowledge sources to a declarative agent · Microsoft: Manage access to agents in SharePoint
Begin with a narrow source set. A pilot that searches the entire company drive can surface irrelevant or stale files and make results harder to evaluate. Give the assistant only the source locations and permissions appropriate to its intended users, following the company’s current access procedures.
Divide retrieval, rules, and decisions
Ordinary rules can handle clear metadata checks. A workflow can require a project ID, reject an expired or superseded file status, or restrict search to an approved library. Permissions should come from the document platform’s controls, not from instructions typed into a prompt. A revision register can identify the current record if the organization maintains it reliably.
AI can help interpret a question, retrieve relevant passages, and draft a concise answer. It should include document name, revision, date or status when available, and a direct link to the source. If the source set does not support an answer, the assistant should say it did not find an answer and route the question to the relevant project owner. If it finds two conflicting records, it should display both rather than deciding which one governs.
The project manager, architect, engineer, or other authorized role makes the actual decision. The assistant should not approve a submittal, change, field instruction, or scope interpretation. A source citation is a pointer to evidence, not proof that the cited record is approved or applicable.
Worked example: find the note and expose the conflict
Hypothetical example: A user asks, “What finish was approved for the east stair?” The assistant finds a finish note in “Submittal 08 71 00,” revision 2, marked approved in the project library. It also finds drawing set revision 3, which does not state a finish decision. The response links both records and says the records do not provide the same level of evidence. It asks the project manager to confirm which approved record controls.
The project manager opens the cited pages and checks their status, date, and relationship to the work. If the submittal is the approved selection, the PM responds with that reference or updates the controlled project record. If the records are in conflict, the assistant does not choose between them. The project decision remains with the authorized person.
Build the no-answer behavior into test cases. Ask questions whose answers are absent, questions with two conflicting documents, and questions that use a different term from the source. Inspect whether the assistant gives a source, exposes the conflict, or admits that it cannot support an answer.
Treat security and revision hygiene as operating controls
Use the system’s access controls and current company procedures. Microsoft’s Copilot architecture documentation describes how Microsoft 365 permissions and protection settings affect content discovery and references in that product environment. That product documentation does not establish the configuration of a particular tenant. An administrator should verify the actual tenant’s access, licensing, and settings before a pilot with real project documents. Microsoft 365 Copilot data protection architecture
Keep an owner for the approved source set and a path for correcting bad metadata. If a document is superseded, the source library needs to reflect that change. Do not rely on the model to infer a revision policy from filenames alone. If a user loses access, the assistant should not reveal the restricted content through a copied answer.
Measure retrieval quality before expanding
Build a test set from real project questions and approved records, then have a human create the reference answer and source. Include answerable, unanswerable, and conflicting cases. Compare a simple search process with the AI-assisted process. Track whether the assistant found the relevant source, cited the correct revision, omitted a key caveat, or answered without evidence. Record reviewer corrections and time to a verified answer.
Set criteria before the pilot with the people accountable for project decisions and information access. Do not use a single accuracy score that hides dangerous cases. A wrong revision or unsupported answer deserves separate attention from a harmless wording edit. Keep the pilot narrow until both the source library and the review process work as intended.
Contractors looking to improve how project information moves across field and office teams can review Blackwing’s construction operations context. If document retrieval or handoffs are producing recurring delay or management effort, a 30-minute Operations Review can help identify the process question to address before selecting a tool.
Frequently asked questions
Can an AI assistant decide which drawing revision is current?
Only if the source system provides reliable status and revision information and the search is configured to use it. A person still needs to verify that the cited record is approved and applicable to the question.
What should the assistant do when documents conflict?
Show the relevant sources and the nature of the conflict, then route the question to the authorized owner. It should not select a governing document on its own.
Does a source citation mean the answer is correct?
No. It makes the answer easier to inspect. The reviewer must open the cited record, confirm its revision and status, and check that it supports the response.
How should a contractor pilot a project assistant?
Use a narrow approved source set and a human-checked test set with answerable, absent, and conflicting questions. Track source correctness, revision errors, unsupported answers, corrections, and time to a verified response.