AI tools are fluent, fast and sure of themselves, including when they're wrong. When a chatbot gets a movie quote wrong, it's annoying. When it gets the age of a roof or the contents of an inspection report wrong a few days before offers are due, it can cost real money.
A general chatbot can't open your disclosures. Roost can.
Ask in the chat with your agent. Roost answers from the home's own documents and cites the page.
A 1/4-inch foundation crack [Home Inspection Report, Page 17] and a 2003 garage roof that leaked in 2024 [Seller Disclosure (TDS), Page 4].
The fix isn't to stop using AI. It's one habit: make it show you the page.
What an AI hallucination is
A hallucination is when an AI tool produces an answer that sounds right but isn't backed by anything real. It isn't lying. These systems are built to produce likely-sounding text, and a likely-sounding answer isn't always a true one.
The rates are higher than most people assume. A 2024 Stanford study found that general-purpose chatbots hallucinated between 58% and 82% of the time on legal questions. Even purpose-built legal research tools from major providers produced incorrect information more than 17% of the time, and one did so more than 34% of the time. Those are tools designed for lawyers, from companies that have every reason to get it right.
Real estate questions aren't legal research, but they have the same weak spot: the right answer lives in specific documents, and a tool that hasn't read them will fill the gap with something plausible.
Why real estate is a risky place for made-up answers
The facts live in one house's paperwork
How old is the water heater? Did the inspector mention the electrical panel? What did the HOA decide about the roof? None of that is general knowledge. It's in the documents for that specific home. A chatbot that hasn't read them can only guess, and it won't always tell you it's guessing.
Numbers don't travel
Repair costs, values and fees vary a lot by area. In July, an agent told Inman that some buyers now drop inspection reports into a chatbot and negotiate off its repair estimates, which don't reflect local pricing and can put a deal at risk. A number that sounds precise isn't necessarily local.
The clock is short
Disclosure packages often arrive a few days before offers are due, and long reports get skimmed. That's exactly when a fast, confident and wrong answer is most tempting to accept.
The "show me the page" standard
Whatever AI tool you use on a home, hold it to five checks:
- It answers from this home's documents. Not from what's typical, but from what's in this listing's disclosures, inspections and HOA papers.
- It tells you where. Every factual answer should come with a document and a page.
- You can check it in one click. If verifying an answer takes ten minutes of scrolling, you won't do it.
- It says when it doesn't know. "I couldn't find that in the documents" is a good answer. A confident paragraph with no source isn't.
- It doesn't decide for you. A tool that tells you what something means for your offer has gone past what it can know.
If a tool fails the second check, treat everything it says as a starting point for your own reading, not as an answer.
What citations don't fix
A cited answer is far better than an uncited one, but it isn't the whole job.
- Read around the quote. A sentence can mean something different with the paragraph around it. Click through and read the section.
- Facts aren't interpretation. AI can show you that a report mentions a roof issue on page 12. Whether it matters, what it might cost and what to do about it are questions for your agent, your inspector and the specialists they bring in.
- Missing isn't the same as fine. If a document doesn't mention something, that tells you the document doesn't mention it. It doesn't tell you there's no issue.
What it looks like on a real listing
Say you're looking at a Sunnyvale condo and the HOA papers run to 90 pages of budgets and meeting minutes. You want to know whether the building has talked about a roof project.
You ask Roost AI on the listing. It answers from the HOA documents and points you to the meeting minutes where the roof comes up. You click through, read the paragraph and the ones around it, and see what the board actually discussed. Then you send that page to your agent with your question.
The same approach works on a San Jose house under $1.5M with a long inspection report, a single-family home in Los Gatos with a separate roof report, or a townhouse in Hayward with its own HOA. The documents change, but the habit doesn't.
How RoostHaven applies this
We built Roost AI around the "show me the page" standard. RoostHaven won Inman's 2026 Best of Proptech award for Conversational AI and Virtual Assistants this fall.
- Roost AI answers from the listing's own documents. Ask about a home's disclosures, inspections or HOA papers and it points you to where it found the answer. Here's how Roost AI works.
- The AI Report cites everything. On RoostHaven Pro, the AI Report reviews a listing's disclosure package and cites the document, page and exact quote for every finding. A second pass throws out any finding it can't locate on the cited page.
- People still decide. Roost doesn't book tours, make offers or tell you what to do. It gets you to the right page faster, so the conversation with your agent starts with facts.
No tool is perfect, ours included. That's why every answer comes with the page.
For a seller's view of the same shift, read why sellers should expect buyers to use AI on their disclosures. And for where AI fits next to your agent, see will AI replace real estate agents?
FAQ
Can you trust AI for real estate? Trust answers you can check. Use tools that cite the document and page behind each answer, and read that page before you rely on it.
Why does AI make things up? AI language tools are built to produce likely-sounding text. When they don't have the source material, they can fill the gap with something plausible but wrong.
Is AI accurate at reading disclosures and inspection reports? It's good at finding what a document says, and it doesn't skip pages. It can still miss context or misread a section, which is why citations matter.
Does Roost AI ever get things wrong? It can. That's why it points you to where each answer came from, so you can confirm it yourself.
Can AI tell me if an issue in a report is serious? No. It can show you what the report says. What it means for you is a question for your agent, your inspector and the professionals they recommend.
Sources
- Stanford HAI, "AI on Trial: Legal Models Hallucinate in 1 out of 6 (or More) Benchmarking Queries," May 2024
- Inman, "When mom and dad fund the deal, ChatGPT gets a seat at the table," July 2026
- Inman, "Inman names 2026 Best of Proptech award winners," October 2026
This post is general information, not legal, tax or financial advice. For decisions about your own purchase or sale, talk with your agent, a real estate attorney, a CPA or your lender.