LLMs Need Someone Who Knows the Domain
Claude, Codex, and the rest are useful debugging partners. They can suggest hypotheses quickly, explain unfamiliar systems, and keep an investigation moving when you are stuck.
They can also send you on a very convincing rabbit hole.
We ran into that with a client’s ASP.NET application. After it had been up for a while, the first request for a static JavaScript file could be very slow. Requests after that were fast. It was the kind of narrow, intermittent behavior that invites a long list of theories.
Claude’s initial diagnosis was that SSL certificate revocation checking was holding up the first request. That is a real thing worth knowing about, and it sounded plausible in the abstract. But the application was using a self-signed certificate. There was no certificate authority revocation check to perform. A small piece of domain knowledge ruled out a direction that otherwise could have consumed hours.
The problem was not that Claude mentioned certificate revocation. The problem would have been treating a confident, technically detailed answer as evidence.
Start with what the system is doing
Rather than follow the SSL theory, we tested the behavior we could observe. We read the assets directly from the filesystem and fetched the asset through the application. The pattern was consistent:
- Fetch an asset and the first request is slow.
- Fetch it again immediately and it is fast.
- Edit the file, then fetch it again, and the next request is slow again.
That is a much more useful description of the issue than “static JavaScript is slow.” The expensive path was associated with first access to changed file content. It was not ordinary request handling, and it did not fit the TLS explanation.
The experiment strongly pointed to endpoint scanning. SentinelOne was running in that environment and was the most likely cause: changed content was likely being scanned on its first access, while the next read benefited from the result already being available. We did not treat that as a definitive vendor-level attribution, but it fit the observed behavior far better than revocation checking did.
Plausible is not proven
LLMs are especially good at producing plausible explanations. They have seen the vocabulary around a symptom, and they can connect it to a real mechanism. That is useful for generating a list of things to investigate.
But a diagnosis has to survive the details of the actual system:
- Does the proposed mechanism exist in this deployment?
- Does it explain the timing and repeatability of the symptom?
- What inexpensive test could distinguish it from the other hypotheses?
- What observation would prove it wrong?
A self-signed certificate was enough to make us stop and question the revocation theory. The cold-read, warm-read, and modified-file test gave us a better hypothesis to pursue. Neither step required an encyclopedic knowledge of every possible cause. They required knowing enough to check the assumptions and to design a small experiment.
Use the model as a partner, not an authority
Claude still helped with the investigation. The right use was not to ask it for the answer and implement the first response. It was to use it as a partner while we compared theories against the environment and the measurements.
A practical debugging loop looks like this:
- State the observation precisely, including what changes between a slow request and a fast one.
- Ask the model for competing hypotheses and a test that would separate each one.
- Check its assumptions against the architecture, configuration, and operational environment.
- Run the smallest useful experiment.
- Feed the result back in and repeat.
This is also why domain expertise still matters when using LLMs. If you cannot tell whether an answer fits the system you are operating, confidence and detail are easy to mistake for correctness. Bring in someone who knows the domain, or slow down enough to validate the model’s premises before chasing its conclusion.
The model can make a good investigator faster. It cannot replace the judgment needed to decide whether a theory belongs in the investigation at all.