# ======================================================== # ROBOTS.TXT - https://www.seminuevos.com (EDICIÓN OPTIMIZADA) # ======================================================== # --- SECTION 1: BLOCK AGGRESSIVE SCRAPERS & AI INGESTION --- # Bloqueo estricto a bots que roban contenido o entrenan IA sin aportar tráfico. # Nota: Se han retirado Semrush y Ahrefs para permitir auditorías SEO internas. User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: Rogerbot Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / # --- SECTION 2: RULES FOR SEARCH ENGINES (GOOGLE, BING, ETC.) --- User-agent: * # 1. Bloqueo de Buscadores Internos (Crawl Traps) Disallow: /*?rText=* Disallow: /*&rText=* Disallow: /*?fts=* Disallow: /*&fts=* Disallow: /cdn-cgi/ # 2. Bloqueo de Filtros Secundarios/Facetados (Evitar Bucles Infinitos y Contenido Delgado) # Estas reglas bloquean parámetros cruzados que saturan el presupuesto de rastreo. Disallow: /*?seller=* Disallow: /*&seller=* Disallow: /*?fuel=* Disallow: /*&fuel=* Disallow: /*?drive=* Disallow: /*&drive=* Disallow: /*?transmission=* Disallow: /*&transmission=* # Nota: ?page= y ?sort= (u ?orderBy=) se dejan PERMITIDOS intencionalmente # para permitir el flujo de Link Equity, controlados vía rel="canonical". # ======================================================== # SITEMAPS # ======================================================== Sitemap: https://www.seminuevos.com/sitemap.xml Sitemap: https://www.seminuevos.com/blog/sitemap.xml Sitemap: https://www.seminuevos.com/sitemap-dealers.xml Sitemap: https://www.seminuevos.com/sitemap-fichas.xml Sitemap: https://www.seminuevos.com/sitemap-other.xml Sitemap: https://www.seminuevos.com/sitemap_01.xml