Quick answer: connect the evidence, not unlike denominators
Start with a decision question and a source register. Preserve each channel's population, unit, period and collection context. Code relevant excerpts, review contradictions, calculate source-specific counts and assign the next validation or service action to an owner. Record what happened afterward. Do not label a mixture of tickets, interviews and ratings as a percentage of customers.
The ten sources below are options, not a requirement to collect all ten. Choose the minimum evidence that can answer the question. Download the ten-source working checklist, fictional source packet, cross-channel records CSV and NPS rating CSV. Every example record and result is invented teaching material, not an OpenMax customer dataset or product test.
The output should let a colleague distinguish a customer statement, an observed behavior, a coding decision, an interpretation and an approved action. Those are different objects. A model-generated explanation is not a substitute for the source that supposedly supports it.
Define the question and the evidence record
“Understand our customers” is too broad for a reproducible analysis. “What makes recent invoices difficult to understand, and what should we investigate before changing the invoice explanation?” identifies a problem and a decision boundary. Set the period, product versions, languages and intended audience before collecting extracts. Define which people are absent from the available channels.
An evidence record preserves the relevant source, not necessarily a copy of the entire conversation. A code identifies a specific type of content; a finding interprets a pattern; an action decides what to do. GOV.UK's research-analysis guidance separates observations, findings and actions. That distinction is useful here without assuming that the same research method fits every channel. GOV.UK: analyse a research session.
| Record | Minimum useful content | Question it prevents you from skipping |
|---|---|---|
| Decision brief | Business question, scope, period, audience and decision owner | What will this evidence help us decide? |
| Source register | Owner, collection design, unit, access, permitted reuse and omissions | What does each channel include and exclude? |
| Evidence register | Stable record ID, source location, context and permitted excerpt | Can a reviewer inspect what was actually said or observed? |
| Coding record | Definition, excerpt, proposed label, reviewed label and version | Did the interpretation add a claim that is not in the evidence? |
| Finding memo | Supporting cases, contrary cases, denominators and alternative explanations | What remains uncertain or source-dependent? |
| Action record | Decision, owner, approval, next check and outcome evidence | Was anything tested or resolved after the report? |
Do not make “confidence” an unexplained high/medium/low badge. State why a finding is credible for its limited purpose: a direct quotation, a reviewed observation, corroborating information or an unresolved discrepancy. Five channels may share the same customers, copied content or recruiting bias; their agreement is not automatically five independent confirmations.
Keep urgent service or security concerns on an appropriate escalation path. They do not need to become the most frequent theme before an accountable team examines them. Conversely, a recurring suggestion does not itself authorize a product commitment, a refund or a change to someone's service eligibility.
Ten evidence sources and their interpretation limits
For every source, preserve enough context to interpret the evidence and calculate its declared unit. Do not collect unnecessary personal data merely to fill a standard template. The checklist is a starting point for the research and data owners, not a universal legal permission.
1. Customer interviews: depth with a recruitment boundary
Interviews can explain what people are trying to accomplish, how they describe a difficulty and which tradeoffs matter. Keep the recruitment criteria, interview guide, product exposure and relevant recording or note location. A participant recruited because they complained about billing is not interchangeable with a randomly selected active account.
Separate the participant's words from the interviewer's interpretation. “I asked finance to check it” reports a step; “the invoice caused a loss of trust” needs supporting context. Record prompting and follow-up questions so a leading question does not disappear from the evidence trail.
Count participants or interviews as declared, retaining repeat sessions with the same person. Use a small purposive study to explore explanations, not estimate the customer population. A contrasting experience may reveal a plan, role or product-version difference worth investigating rather than a comment to remove.
2. Support tickets: contacts are not affected customers
Tickets reveal the problems people bring to support, the route they take and what happens after assistance. Preserve ticket and thread identifiers, relevant timestamps, product area, reopen status and permitted account linkage. Distinguish repeated contact about one issue from a new issue and from a duplicate export of the same record.
Analytical grouping is not the same as merging live tickets. Zendesk's documentation warns that ticket merges are permanent and that source-ticket fields do not all transfer into the destination. For an analysis exercise, work from permitted records and a documented grouping rule; do not change support history to make a count easier. Zendesk ticket-merging rules.
Report the chosen unit explicitly. Four relevant tickets from two accounts describe contact volume and account coverage differently. Neither count includes customers who experienced a problem but never contacted support. A fall in tickets can reflect an unavailable contact channel rather than a better product.
3. Sales calls: expectations differ from use
Approved call notes or permitted transcripts can reveal explicit requirements, objections, buying criteria and alternatives. Preserve whether the speaker is a prospect, current user, evaluator or partner when that status is legitimately known. Record the sales stage and the question that elicited the statement.
Do not convert a salesperson's summary into a buyer quotation. “They probably need invoice approvals” is a staff hypothesis. “We cannot proceed until finance approves” is a stated condition. A lost-deal reason entered by a seller is another evidence type and should retain that attribution.
Pre-sale expectations are not post-sale experience. Keep them separate even when both use the same words. A request heard in a large opportunity can matter commercially, but deal size is not a license to label it the most common need. A revenue-weighted view needs its own declared unit and purpose.
4. Product reviews: visible does not mean representative
Reviews can expose vocabulary, comparisons and experiences not present in your own support system. Retain the platform, posting date, product context and any verification status the platform actually supplies. Mark unknown purchase or use status as unknown instead of inferring it from a profile.
The same text may be cross-posted, quoted by another author or copied into an internal note. Keep provenance so a copied review is not counted as fresh confirmation. Do not attempt to identify an anonymous reviewer by joining names, writing style or unrelated account data.
Use approved collection and quotation practices. Public visibility alone does not establish the permissions for every reuse. Ratings from platforms with different scales, moderation or invitation practices should not be pooled into a single satisfaction result without a justified measurement design.
5. CSAT comments: preserve the interaction being rated
Customer satisfaction, or CSAT, feedback is often collected after a particular interaction. Keep the exact question, response options, invitations, response window and service event. “How satisfied were you with the support you received?” is not the same question as satisfaction with the product overall.
Retain both valid ratings and the presence or absence of an optional comment. The people who write explanations may differ from those who only select a score. Do not calculate the rating summary from the comment-only subset and present it as the entire survey.
A complaint about an invoice can coexist with praise for the agent who explained it. Code the object of the comment rather than assigning one negative label to the whole experience. Report the rating denominator and the text-analysis denominator separately, including how invalid or missing entries were handled.
6. NPS comments: a score and its explanation use different bases
Net Promoter Score, or NPS, uses valid recommendation ratings: the percentage rating 9–10 minus the percentage rating 0–6. Ratings of 7–8 remain in the base. Bain's official description provides this calculation; it does not justify using only respondents who wrote comments. Bain: measuring NPS.
Keep recommendation ratings separate from the reasons people optionally provide. Record question wording, survey wave and whether the study concerns a relationship or a particular experience. Do not infer an unprovided score from sentiment or fill missing comments with a model's guess.
In the example below, the valid-rating score is 30 while the comment-only subset would produce −25. That difference is created by filtering, not a measured collapse in loyalty. Neither number independently establishes future referrals, churn or the cause of a customer's rating.
7. Community discussions: repeated voices need context
Community threads can reveal peer workarounds, confusing terminology and unresolved questions. Retain thread structure, relevant replies, date and any explicitly known role, such as staff or partner. A proposed workaround in an unanswered post is not a confirmed successful solution.
Choose whether the unit is posts, threads or contributors. One contributor may write repeatedly across several threads. A repost of an announcement is not an additional customer's experience, and silence after a reply does not prove that the issue was resolved.
Respect community rules and the approved purpose of analysis. Do not export private discussions simply because an employee can read them. A small expert community can provide valuable depth without representing all users; preserving that limitation makes the evidence more useful, not less.
8. Product feedback forms: requests are not validated solutions
Forms capture explicit requests and problem descriptions at a particular entry point. Preserve the form wording, triggering page, date, product version and relevant context the user voluntarily supplied. A feature request entered after an onboarding failure may have a different meaning from the same request during procurement.
Group related needs without deleting distinct use cases. “Add a breakdown of tax” and “show which seats changed” may both concern invoice clarity, but they suggest different investigations. Maintain those subtopics and the original evidence instead of collapsing them into “improve billing.”
If the form lets people vote, document whether votes are unique, changeable or associated with accounts. Submission count, votes and affected people are not interchangeable. A popular request still needs feasibility, accessibility, privacy and product-strategy review before a commitment.
9. Cancellation reasons: stated reasons are not a causal model
Preserve the options a departing customer could select, the selected reason, optional text and the point in the cancellation flow. If staff entered the reason, label it as staff coding. If an account never completed the reason form, retain that omission in the source register.
Separate price burden, unclear billing and changes in the customer's own circumstances. They can coexist, but the same remedy will not necessarily address all three. A save offer or mandatory reason field can influence what gets recorded; a selected option is not guaranteed to be the sole reason for departure.
Use this evidence to formulate a follow-up question or a bounded improvement test. Do not claim that changing invoice wording will prevent a particular percentage of churn without an appropriate evaluation. Never use a research summary to delay a cancellation or automatically pressure a respondent to return.
10. Usability research notes: observation and explanation differ
Record the task, product or prototype version, participant context, observed behavior, relevant words and facilitator interventions. “Paused on the invoice page and opened help” is an observation. “Did not trust the amount” is an explanation that needs further evidence.
Task design matters. A participant asked specifically to locate a tax breakdown has a different prompt from someone completing a natural monthly review. Assistance, time limits or a prototype's missing interaction may affect the observed outcome. Keep these conditions visible when comparing sessions.
Small studies can uncover important friction and test a proposed explanation. They do not directly estimate how often the entire market experiences it. Retain successful cases and unsuccessful ones so an improvement is checked against varied conditions rather than only the example that inspired it.
Move from intake to an owned action
Define the decision and access first. Name the question, product scope, period, source owners and permitted output audience. Identify whose review is necessary before extracting recordings, joining records or sharing quotes. If a source is not approved, omit it and describe the gap rather than quietly replacing it with guessed data.
Freeze a small, inspectable source set. Retain the extraction date, filters, units and missingness. Use stable references to authorized originals. Remove verified export duplicates but preserve meaningful repeat contacts. Do not join identities across channels merely to create a neat unique-customer number.
Pilot definitions against varied evidence. Read positive, negative, ambiguous, multilingual and unusual cases. For this operational coding workflow, compare reviewers' decisions and record reasons for disagreement. Revise the definitions and reassess affected records. The qualitative survey analysis guide provides a narrower codebook exercise; do not present a fixed taxonomy as every research method.
Build a finding with opposing evidence. Name the observed pattern, source-specific counts, exceptions and plausible alternative explanations. A customer report that a charge is wrong does not establish an actual billing error. Route that verification to the team with access to the underlying transaction and applicable rules.
Separate individual response from system improvement. An authorized support follow-up and a change to invoice design are different actions with different owners. XM Institute describes individual response and broader improvement within a four-loop model, also covering process integration and strategic decisions. Here, use the distinction to prevent “we replied” from being treated as “we fixed the recurring problem.” XM Institute's action-loop guidance.
Record a decision and revisit it. Capture whether the team will investigate, test a change, act through an existing service process or decline with a reason. Give the next check an owner and date appropriate to the risk and operating cycle. Preserve the result and unresolved questions. Do not invent a universal weekly cadence or a success percentage to make the workflow look complete.
For a proposed wording change, a useful check might ask whether participants can explain the relevant invoice components under a defined task. Record the baseline, test conditions and contrary cases before interpreting improvement. A before/after decline in comments alone can be confounded by volume, channel access, seasonality or a changed question.
Worked example: forty-seven records do not establish forty-seven customers
The fictional team investigates invoice clarity. Its definition includes statements that invoice line items, amount composition or changes are difficult to understand. A complaint that the price is too high is not enough to qualify. All records concern one invented review period, but the collection methods differ and cross-channel identities are not established.
The source files contain twelve support tickets, four interview records, twenty valid NPS ratings, five reviews and six completed cancellation-reason records. There are no duplicate export rows in this example. Repeat support contacts remain real contacts; an analytical view can group them without altering live tickets.
| Source | Declared base | Invoice-clarity evidence | What the result describes |
|---|---|---|---|
| Support | 12 tickets from 8 known source-local accounts | 4 tickets from 2 accounts | Contact volume and account-level coverage are different |
| Interviews | 4 participants | 2 participants mention difficulty | This recruited group, not the customer population |
| NPS | 20 valid ratings; 8 nonblank comments | 3 comments mention difficulty | Comment evidence and rating calculation have different bases |
| Reviews | 5 included reviews from distinct platform accounts | 2 reviews mention difficulty | Included review records, not verified unique customers |
| Cancellations | 6 completed reason records | 2 records mention difficulty | Stated reasons among included completions, not all causes of churn |
For support, 4 ÷ 12 × 100 ≈ 33.3% of tickets mention invoice clarity. Three relevant tickets belong to account A and one to B; there are eight known accounts in this source. The account view is 2 ÷ 8 × 100 = 25%. Neither is a whole-customer prevalence estimate. Reporting only ticket count would hide the concentration of repeated contact.
The interview description is 2 ÷ 4 × 100 = 50% of these participants. One other participant explicitly says the invoice is understandable; keep that counterexample. For reviews, 2 ÷ 5 × 100 = 40% describes included review records. Cancellation records give 2 ÷ 6 × 100 ≈ 33.3%, but the comments do not prove that invoice clarity alone caused those departures.
The NPS file has ten promoters, six passives and four detractors. Its valid-rating calculation is (10 − 4) ÷ 20 × 100 = 30, reported as an NPS of 30, not 30%. Of eight nonblank comments, three mention invoice clarity: 3 ÷ 8 × 100 = 37.5%. Across all twenty ratings, 3 ÷ 20 × 100 = 15% have an accompanying comment with that label. That is not evidence that only 15% experienced the problem: twelve people gave no comment.
The comment-only subset contains two promoters, two passives and four detractors. Calculating (2 − 4) ÷ 8 × 100 = −25 describes that selected subset. Substituting it for the twenty-rating score changes the population being summarized. It does not demonstrate a fall of 55 points over time; no earlier or later wave is present.
Across the five sources, the files contain 12 + 4 + 20 + 5 + 6 = 47 records and 4 + 2 + 3 + 2 + 2 = 13 records with invoice-clarity evidence. The arithmetic 13 ÷ 47 × 100 ≈ 27.7% is possible, but “27.7% of customers have unclear invoices” is not supported. The denominator mixes contacts, participants, ratings and other records, includes ratings without comments and does not resolve overlap between sources. Averaging the channel percentages would not repair those differences.
A defensible memo says the issue appears in several included channels, is concentrated in two support accounts and deserves investigation alongside contrary experiences. It does not announce a market rate or five independent confirmations. The support owner can address approved individual cases; the billing and product owners can investigate wording, plan changes and account context. The example does not establish that an error, redesign or resolution has already occurred.
Choose tools around the bottleneck, not a promised score
Manual analysis is suitable when the source set is manageable and interpretation is the main challenge. An evidence register and a versioned spreadsheet can support a careful decision. The difficult part is coordinating changes, permissions and follow-up as sources and reviewers multiply, not the absence of an AI summary.
Native customer-experience tools may already cover collection, text analysis and action routing. Qualtrics describes those capabilities in its VoC offering. Treat that as a vendor description and check the actual connector, license, language and review workflow required for your case. Do not assume identical functionality across channels or transfer advertised results to your organization. Qualtrics VoC product overview.
Deterministic automation can validate allowed codes, find a repeated export ID, preserve filters and recompute the denominator. These checks are valuable precisely because a plausible narrative can conceal a wrong filter. They do not determine from arithmetic whether a customer's explanation is complete or a pattern is causal.
Agent-assisted coordination can be evaluated when approved tools expose the required evidence and review steps. Test retrieval boundaries, source links, multilingual handling and rejection of unsupported conclusions before expanding the task. Keep publication and consequential actions under their appropriate authorization rather than treating every reviewed label as permission to act.
For the final meeting handoff, use the AI research report template to separate findings, calculations and recommendations. A dashboard may show the latest state; the dated report should preserve what was actually reviewed at the decision point.
Evaluate OpenMax with a bounded VoC exercise
OpenMax's public positioning is a platform for human–agent collaboration. That makes a source-and-review coordination exercise relevant, but it does not prove a dedicated VoC connector, validated customer identity resolution or automatic enforcement of every quotation rule described here. OpenMax product overview.
Start with the fictional packet and the question about invoice clarity. Ask the proposed workflow to preserve all source-local IDs, keep account and ticket counts separate, retain the positive interview, reproduce the full NPS score and reject the unsupported customer-percentage claim. Require a reviewer to inspect the underlying rows before accepting the memo.
Then verify the intended environment's access, transformations, version records, retention and multilingual review behavior. A source link must not expose data to someone who is allowed to read only the summary. A correct calculation in this exercise is not proof that real customer data cannot leak or that a future model run will classify every statement correctly.
If the existing customer-experience stack already meets the need, retain it. If evidence and action handoffs are fragmented, bring the sanitized packet and acceptance conditions to a scoped OpenMax workflow discussion. The next step is a limited evaluation, not unrestricted ingestion of customer history or automated customer contact.
Protect customer context and avoid false closure
Confirm the permitted purpose, collection terms, applicable legal basis, audience and retention with responsible owners. Recording access does not automatically grant publication rights. A public quote, a private ticket and an interview recording may require different treatment. Do not treat a generic consent field as sufficient for every reuse or jurisdiction.
Removing names alone may leave a distinctive role, event or sequence that identifies someone. UK Data Service's text guidance addresses contextual identification and the balance between preserving meaning and protecting people, including review of automated processing. Anonymisation for text data.
Keep original-language evidence beside approved translations where access permits. Negation, politeness, sarcasm and product terminology may change the interpretation. Have consequential findings reviewed by someone competent in the language and context. Do not infer protected characteristics, identity or mental state from writing style, and do not join anonymous contributors to account records to improve a dashboard.
Treat feedback text as data, not instructions for an agent to fetch unrelated information, send messages or publish results. Recheck a finding when its source changes, access is withdrawn or the taxonomy is revised. A copied quote in a slide can outlive the permission and context that made it appropriate; the release record needs a way to trace and correct downstream uses.
Finally, distinguish acknowledgement, service resolution, product change and demonstrated outcome. An email sent is not proof that a problem is fixed. A released change is not proof that it improved customer experience. High-impact privacy, security, legal, financial or employment uses require qualified review beyond this operational guide.
Frequently asked questions
Can we combine all channels into one customer percentage?
Not directly when the units, selection methods and identities differ. Keep source-specific results. A combined estimate needs a defined target population, compatible units and a defensible design; arbitrary weights or a larger dashboard do not provide those conditions.
Should repeat tickets be deleted before VoC analysis?
Not simply because they concern the same issue. Preserve genuine repeat contacts, remove only verified export duplicates under the stated rule, and create a separate analytical grouping when appropriate. Changing or merging live support tickets is a different operational action.
Should NPS be calculated only from written comments?
No, not when reporting the valid-rating survey result. Optional comments are a separate text-analysis subset. In the fictional example, all twenty valid ratings yield 30; the eight comment writers yield −25. Those summarize different sets, not a time trend.
Does a theme appearing in five sources prove it is the top priority?
No. Sources may overlap or repeat the same evidence. Consider severity, affected contexts, missing populations, contrary cases, feasibility and further validation. A rare serious concern can require action before it becomes frequent.
What does closing the loop actually require?
Record the appropriate response or decision, its owner, what was done and how the result will be checked. Individual follow-up and systemic improvement are distinct. Obtain any necessary contact or publication approval, and do not declare resolution solely because a summary or message was produced.
Sources, authorship and revision scope
Prepared by the OpenMax content team for OpenMax's own website. The publisher has a commercial interest in the product discussed. Sources were checked on September 4, 2026; they support the adjacent statements, not an endorsement of this page or a certification of the proposed workflow.
The ten-source checklist, fictional records and example interpretations are editorial teaching materials. They are not customer research, a benchmark, a novel validated methodology or a named specialist's approval. The original publication date remains September 2, 2026. This September 4 revision expands source boundaries, traceable calculations, action ownership, downloadable materials and explicit product-verification limits.
Send corrections with the page URL and non-sensitive supporting information to contact@openmax.com. Do not send confidential customer histories or identifying interview material. Reproducible arithmetic improves inspectability; it does not replace research validity, professional review or actual product testing.

