# =============================== # robots.txt for Transbulk International Shipping LLC # Domain: https://www.transbulk.ae # Purpose: SEO optimization + secure exclusion of confidential pages # Last updated: October 2025 # =============================== User-agent: * # --- Allow general public content Allow: /$ Allow: /about Allow: /services Allow: /contact Allow: /careers Allow: /gallery Allow: /news # --- Block sensitive or internal pages Disallow: /admin/ Disallow: /dashboard/ Disallow: /includes/ Disallow: /private/ Disallow: /uploads/ Disallow: /tmp/ Disallow: /cgi-bin/ Disallow: /background_details.html Disallow: /background_details/ Disallow: /old/ Disallow: /backup/ Disallow: /scripts/ Disallow: /modules/ Disallow: /forms/ Disallow: /errors/ Disallow: /*?* # blocks query URLs that might expose dynamic parameters # --- Optional (for future secure directories) Disallow: /confidential/ Disallow: /restricted/ # --- Sitemap for faster crawling of valid pages Sitemap: https://www.transbulk.ae/sitemap.xml # --- Notes: # 1. 'background_details.html' has been blocked for privacy reasons. # 2. Public pages remain fully crawlable for SEO ranking. # 3. Use Google Search Console's "URL Removals" tool for faster delisting.