AI answer monitoring · bold-reports
2026-11-12 16:47 · success · score –· by sarathkumarvenkatesan · reviewed by sarathkumarvenkatesan on 2026-11-12· backend claude-code 2.1.322 (claude-opus-5-5)
Checklist: demand-gen/search/ai-answer-monitoring.md
Summary
Headline
No engines were queried in this run, so there is still no Bold Reports AI-visibility data for 2026-10. No MCP servers were connected, which means the openrouter ask_engine tool wasn't available. Google AI Overviews and Microsoft Copilot need a manual check, which an unattended run can't do. All 42 prompt × engine rows are marked not checked. This is the second run today with the same result: the published run 20261112-1519_ai-answer-monitoring_bold-reports_8605 also had no MCP servers connected. Rerunning won't help until openrouter is connected.
Score
None. This checklist has no score, so overall_score is null.
Top 3 actions
- Connect the
openrouterMCP server before the next pbmaintain run, then rerun this week. That covers ChatGPT, Gemini, Perplexity and Claude. Two runs on 2026-11-12 have failed for the same reason, so check the MCP configuration before rerunning. - Check Google AI Overviews and Microsoft Copilot by hand with the seven prompts in
raw/prompt-set.json. Use a clean, signed-out session and record the country. - Log the first successful run as the Bold Reports baseline. Look closely at P5 (licensing) and P7 (security and compliance). Any wrong claim there goes to the product marketing lead and the COE Team the same day.
Findings
AI answer monitoring: bold-reports, 2026-10
Run by: Claude | Location: n/a (no engine queried) | Date: 2026-11-12
Prompts used (fixed set; unchanged from run 20261112-1519_..._8605):
- P1: "What are the best embedded reporting tools?"
- P2: "What is the best embedded reporting tool for an enterprise / midsize company?"
- P3: "Bold Reports vs Telerik Reporting: which should I choose?"
- P4: "What are the best alternatives to SSRS?"
- P5: "What is Bold Reports, how is it licensed and who uses it?"
- P6: "How do I migrate SSRS reports to another platform?"
- P7: "Is Bold Reports secure and compliant for enterprise use?"
| ID | Engine | Mentioned | Position | Cited | Cited URL | Competitors mentioned | Accuracy | Note |
|---|---|---|---|---|---|---|---|---|
| P1 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P1 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P1 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P1 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P1 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P1 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
| P2 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P2 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P2 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P2 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P2 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P2 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
| P3 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P3 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P3 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P3 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P3 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P3 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
| P4 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P4 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P4 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P4 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P4 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P4 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
| P5 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P5 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P5 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P5 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P5 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P5 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
| P6 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P6 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P6 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P6 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P6 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P6 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
| P7 | ChatGPT | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P7 | Gemini | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P7 | AI Overviews | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P7 | Copilot | n/a | - | n/a | - | - | n/a | no API; manual check needed |
| P7 | Perplexity | n/a | - | n/a | - | - | n/a | openrouter not connected |
| P7 | Claude | n/a | - | n/a | - | - | n/a | openrouter not connected; agent session not clean |
Summary
- Mention rate: 0 of 0 answers collected (no comparison: the only earlier run,
20261112-1519_..._8605, also collected no answers) - Citation rate: 0 of 0 answers collected (no comparison, for the same reason)
- Wrong or outdated facts: none recorded because no answers were collected. This is unknown, not zero.
Gaps and fixes
No gaps could be found because no answers were collected.
| Prompt ID | Engine | Gap | Page to fix | Fix |
|---|---|---|---|---|
| P1–P7 | All | Not measured | - | Connect openrouter and rerun this week (see Top 3 actions) |
Not checked
- P1–P7 on ChatGPT, Gemini and Perplexity (21 rows): no MCP servers were connected for this run, so the
openrouterask_enginetool wasn't available. - P1–P7 on Claude (7 rows):
openrouterwasn't connected. I didn't answer from this agent session because it isn't clean: it has the repo's Bold Reports positioning in context, so its answers wouldn't be comparable month to month. - P1–P7 on Google AI Overviews and Microsoft Copilot (14 rows): these have no API, and an unattended run can't check them by hand.
- Phase 2 (month-over-month comparison, gap list, hand-off to the SEO/GEO and blog programs, weekly GTM review deltas): skipped because there is no data this run and no earlier run with data.
Proposed changes (need approval)
None. This run made no changes to live systems and proposes none. It's not a live-system change, but the operator should check why MCP servers aren't attached to pbmaintain runs (maintain/mcp-servers.json has uncommitted local changes) before the next attempt.
Data sources
- Fixed prompt set and category:
demand-gen/search/ai-answer-monitoring.md. - P3 and P6 prompts and competitors:
products/bold-reports/gtm-plan.md. I reused them exactly as resolved in the earlier run, so the results stay comparable. - Earlier run:
reports/publish/bold-reports/ai-answer-monitoring/20261112-1519_ai-answer-monitoring_bold-reports_8605/(no answers collected). - Engines: none queried (no MCP servers connected).
- Exports:
raw/prompt-set.json(the resolved prompts; no answers). - Choices made without an operator:
- Kept the earlier run's choices: P1–P2 use "embedded reporting tools", P3 compares against Telerik Reporting, and P4 asks for alternatives to SSRS.
- The metrics period uses the run's
date_range(2026-10-15 to 2026-11-11), and the logged month is 2026-10. Metric values arenull(not measured), not zero. run.jsonoverall_scorewas alreadynull, which is correct for an unscored checklist, so I left it unchanged.
Findings
| ID | Item | Status | Severity | Effort | Recommendation | Checklist |
|---|---|---|---|---|---|---|
| P5-chatgpt | P5 Brand facts on ChatGPT: "What is Bold Reports, how is it licensed and who uses it?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | high | S | Rerun this week with openrouter connected; check licensing statements against the pricing page. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P5-gemini | P5 Brand facts on Gemini: "What is Bold Reports, how is it licensed and who uses it?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | high | S | Rerun this week with openrouter connected; check licensing statements against the pricing page. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P5-ai-overviews | P5 Brand facts on Google AI Overviews: "What is Bold Reports, how is it licensed and who uses it?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | high | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P5-copilot | P5 Brand facts on Microsoft Copilot: "What is Bold Reports, how is it licensed and who uses it?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | high | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P5-perplexity | P5 Brand facts on Perplexity: "What is Bold Reports, how is it licensed and who uses it?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | high | S | Rerun this week with openrouter connected; check licensing statements against the pricing page. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P5-claude | P5 Brand facts on Claude: "What is Bold Reports, how is it licensed and who uses it?" openrouter not connected. This agent session isn't clean, so it wasn't used to answer. | not-checked | high | S | Rerun this week with openrouter connected; check licensing statements against the pricing page. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P7-chatgpt | P7 Trust on ChatGPT: "Is Bold Reports secure and compliant for enterprise use?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | high | S | Rerun this week with openrouter connected; escalate any wrong security or compliance claim the same day. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P7-gemini | P7 Trust on Gemini: "Is Bold Reports secure and compliant for enterprise use?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | high | S | Rerun this week with openrouter connected; escalate any wrong security or compliance claim the same day. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P7-ai-overviews | P7 Trust on Google AI Overviews: "Is Bold Reports secure and compliant for enterprise use?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | high | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P7-copilot | P7 Trust on Microsoft Copilot: "Is Bold Reports secure and compliant for enterprise use?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | high | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P7-perplexity | P7 Trust on Perplexity: "Is Bold Reports secure and compliant for enterprise use?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | high | S | Rerun this week with openrouter connected; escalate any wrong security or compliance claim the same day. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P7-claude | P7 Trust on Claude: "Is Bold Reports secure and compliant for enterprise use?" openrouter not connected. This agent session isn't clean, so it wasn't used to answer. | not-checked | high | S | Rerun this week with openrouter connected; escalate any wrong security or compliance claim the same day. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P1-chatgpt | P1 Category on ChatGPT: "What are the best embedded reporting tools?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P1-gemini | P1 Category on Gemini: "What are the best embedded reporting tools?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P1-ai-overviews | P1 Category on Google AI Overviews: "What are the best embedded reporting tools?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P1-copilot | P1 Category on Microsoft Copilot: "What are the best embedded reporting tools?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P1-perplexity | P1 Category on Perplexity: "What are the best embedded reporting tools?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P1-claude | P1 Category on Claude: "What are the best embedded reporting tools?" openrouter not connected. This agent session isn't clean (it has the repo's Bold Reports positioning in context), so it wasn't used to answer. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P2-chatgpt | P2 Enterprise on ChatGPT: "What is the best embedded reporting tool for an enterprise / midsize company?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P2-gemini | P2 Enterprise on Gemini: "What is the best embedded reporting tool for an enterprise / midsize company?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P2-ai-overviews | P2 Enterprise on Google AI Overviews: "What is the best embedded reporting tool for an enterprise / midsize company?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P2-copilot | P2 Enterprise on Microsoft Copilot: "What is the best embedded reporting tool for an enterprise / midsize company?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P2-perplexity | P2 Enterprise on Perplexity: "What is the best embedded reporting tool for an enterprise / midsize company?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P2-claude | P2 Enterprise on Claude: "What is the best embedded reporting tool for an enterprise / midsize company?" openrouter not connected. This agent session isn't clean, so it wasn't used to answer. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P3-chatgpt | P3 Comparison on ChatGPT: "Bold Reports vs Telerik Reporting: which should I choose?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P3-gemini | P3 Comparison on Gemini: "Bold Reports vs Telerik Reporting: which should I choose?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P3-ai-overviews | P3 Comparison on Google AI Overviews: "Bold Reports vs Telerik Reporting: which should I choose?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P3-copilot | P3 Comparison on Microsoft Copilot: "Bold Reports vs Telerik Reporting: which should I choose?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P3-perplexity | P3 Comparison on Perplexity: "Bold Reports vs Telerik Reporting: which should I choose?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P3-claude | P3 Comparison on Claude: "Bold Reports vs Telerik Reporting: which should I choose?" openrouter not connected. This agent session isn't clean, so it wasn't used to answer. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P4-chatgpt | P4 Alternatives on ChatGPT: "What are the best alternatives to SSRS?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P4-gemini | P4 Alternatives on Gemini: "What are the best alternatives to SSRS?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P4-ai-overviews | P4 Alternatives on Google AI Overviews: "What are the best alternatives to SSRS?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P4-copilot | P4 Alternatives on Microsoft Copilot: "What are the best alternatives to SSRS?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P4-perplexity | P4 Alternatives on Perplexity: "What are the best alternatives to SSRS?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P4-claude | P4 Alternatives on Claude: "What are the best alternatives to SSRS?" openrouter not connected. This agent session isn't clean, so it wasn't used to answer. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P6-chatgpt | P6 Use case on ChatGPT: "How do I migrate SSRS reports to another platform?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P6-gemini | P6 Use case on Gemini: "How do I migrate SSRS reports to another platform?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P6-ai-overviews | P6 Use case on Google AI Overviews: "How do I migrate SSRS reports to another platform?" No API for Google AI Overviews; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P6-copilot | P6 Use case on Microsoft Copilot: "How do I migrate SSRS reports to another platform?" No API for Microsoft Copilot; an unattended run can't check it by hand. | not-checked | medium | S | Check by hand in a clean, signed-out session and record the country. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P6-perplexity | P6 Use case on Perplexity: "How do I migrate SSRS reports to another platform?" No MCP servers connected for this run; openrouter ask_engine unavailable. No answer collected. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
| P6-claude | P6 Use case on Claude: "How do I migrate SSRS reports to another platform?" openrouter not connected. This agent session isn't clean, so it wasn't used to answer. | not-checked | medium | S | Rerun this week with openrouter connected. | demand-gen/search/ai-answer-monitoring.md#checklist |
Metrics
| Metric | Value | Previous | Change | Period | Dimensions |
|---|---|---|---|---|---|
| AI mention rate ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | |
| AI mention rate (ChatGPT) ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: chatgpt |
| AI mention rate (Gemini) ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: gemini |
| AI mention rate (Google AI Overviews) ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: ai-overviews |
| AI mention rate (Microsoft Copilot) ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: copilot |
| AI mention rate (Perplexity) ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: perplexity |
| AI mention rate (Claude) ai.mention_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: claude |
| AI citation rate ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | |
| AI citation rate (ChatGPT) ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: chatgpt |
| AI citation rate (Gemini) ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: gemini |
| AI citation rate (Google AI Overviews) ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: ai-overviews |
| AI citation rate (Microsoft Copilot) ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: copilot |
| AI citation rate (Perplexity) ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: perplexity |
| AI citation rate (Claude) ai.citation_rate | – | – | – | 2026-10-15 – 2026-11-11 | engine: claude |
| Wrong or outdated facts ai.wrong_facts | – | – | – | 2026-10-15 – 2026-11-11 |
Folder: reports/publish/bold-reports/ai-answer-monitoring/20261112-1647_ai-answer-monitoring_bold-reports_ccaa