1 State the question and the expected scope
Write down the records, subsidiaries, dates, statuses and currency you mean. Define ambiguous words such as “open,” “recent” and “best.” If the question needs a calculation, agree on the formula before evaluating the result.
2 Check the role and record access
Use the same NetSuite role for the AI request and the comparison report. Different permissions can change which records appear. Test a restricted role deliberately; do not use administrator visibility as the only reference.
3 Match time and currency assumptions
A posting period is not always the same as a transaction date. Created date is not due date. Record the time of retrieval if data can change during the comparison.
Do not sum amounts in different currencies without an explicit conversion method. Distinguish transaction currency, base currency and consolidated reporting currency.
4 Compare with a known NetSuite method
Run a saved search, workbook or report using the same filters. Compare record counts and totals, then inspect a sample of source records. Include a partially completed transaction, a boundary date and a record that should be excluded.
If results disagree, check filters and definitions first. Record the mismatch without assuming that the AI or existing report is automatically correct.
5 Test follow ups and uncertainty
Ask a follow-up that changes one condition, such as the period or subsidiary. Confirm that the response keeps the other conditions intact. Try a question with insufficient information and check whether clarification or limitations are communicated.
6 Decide what review the task requires
Use the result according to the consequence of the task. An exploratory lookup and a financial approval need different review. Keep people responsible for decisions and use your organization’s controls before making changes or commitments.
For a pilot, capture the question, expected scope, observed result, discrepancy and resolution in a controlled internal test log. Avoid putting sensitive account data into public feedback or marketing tools.
Apply the checklist to a real task
Our open vendor bill example shows how status, dates and currency affect a common finance question. Read how Carmen works and security and data handling before planning a beta.
Prepared by the AskCarmen team. Updated October 8, 2026.