When an AI Request Should Become a Background Job
How to decide when a .NET AI request should stay synchronous, stream its response, or move to a durable background job with HTTP 202 and a status resource.
Architecture
Keep agent tools narrow and boring
Expose only the small, specific capabilities the agent needs for the current workflow.
Middleware order is important
Place ASP.NET Core middleware in the order that matches routing, security, and endpoint behavior.
Separate prompts from authorization
Do not let prompt instructions decide what data or actions a user is allowed to access.
Use OpenTelemetry before you need production debugging
Add traces, metrics, and logs while the system is still easy to reason about.