… The AI Crawler category covers bots that crawl for AI model training, including GPTBot, ClaudeBot, and Bytespider, and is distinct from the AI Assistant and AI Search categories that cover AI Agents. When a request arrives from a verified AI Crawler, Cloudflare reads the response HTML. …
… Using a Content-Signal directive in your robots.txt , you can independently control three things: whether your content can be used for AI training ai-train , whether it can be used as AI input for inference and grounding ai-input , and whether it should appear in search results search : User-agent:… …
… For example, security teams can filter LLM traffic to analyze requests containing PII-related prompts. Using Cloudflare’s WAF rules engine, they can create custom security policies tailored to their AI applications. …
… In your Worker, you just ask for a flag value: export default { async fetch request: Request, env: Env { // Simple boolean check const showNewUI = await env.FLAGS.getBooleanValue 'new-ui', false, { userId: 'user-42', plan: 'enterprise', } ; // Full evaluation details when you need them const detail… …
… You can write deterministic rules to secure those interactions. AI-powered applications and agents are different. …
… It then writes a single execute call to chain the operations together: // portal codemode execute async = { const tickets = await codemode.jira search jira with jql { jql: ‘project = BLOG AND status = “In Progress”’, fields: “summary”, “description” } ; const doc = await codemode.google workspace d… …
… AI Search: the search primitive for your agents AI Search is the search primitive for your agents. Create instances dynamically, upload files, and search across instances with hybrid retrieval and relevance boosting. Just create a search instance, upload, and search. …
… At review time, the AI Code Reviewer cites specific Codex rules in its feedback. AI Code Review: showing categorized findings Codex Compliance in this case noting the codex RFC violation. …
… The model writes a JavaScript snippet that calls our entire toolset programmatically: const datasets = await skipper.search datasets { query: "billing product revenue" } const queryId = await skipper.start query { sql: "SELECT ..." } const results = await skipper.fetch results { queryId, mode: "inj… …
… The error classifier maps OpenCode's error union type to a shouldFailback boolean: switch err.name { case "APIError": // Only retryable API errors 429, 503 trigger failback return { shouldFailback: Boolean data.isRetryable , ... }; case "ProviderAuthError": // Auth failure a different model won't f… …
To show you the most relevant results, we’ve omitted some entries very similar to those already shown. Repeat the search with the omitted results included.