User-agent: * Allow: / Disallow: /rfq Disallow: /cart Disallow: /checkout Disallow: /order Disallow: /?get= Disallow: /quality-control Disallow: /login # 1. allow ChatGPT Search index User-agent: OAI-SearchBot Allow: / # 2. GPTBot User-agent: GPTBot Disallow: / User-agent: *GPTBot* Disallow: / # 3. ChatGPT-User User-agent: ChatGPT-User Disallow: / User-agent: ChatGPT-User/2.0 Disallow: / # 4. Other OpenAI User-agent: OpenAI-GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: /