StayIndexed
Free tool

Site through the eyes of a search robot (Spider Simulator)

Enter a page address: we will open it as a search robot without running JavaScript and show meta tags, headings, text, links, images and structured data. No sign-up.

Try:

The check runs from our server: we open the page with the Googlebot User-Agent, read the first 1 MB of code and do not run scripts. We do not store your requests together with your IP address.

Your first 30 tokens are on us

The robot can read your page. But is it really in the Google index?

Reading a page does not mean indexing it. Check which pages Google really keeps in its index and learn right away when they drop out.

  • Google indexing check for any URL, with the technical reason if the page is not in the index
  • Bulk checks of hundreds and thousands of URLs at once
  • Regular monitoring and an alert the same day a page drops out of the index
30
tokens at sign-up — that is 10 free checks
Try it for free Plans and pricing

No card · sign in with Google · 1 check = 3 tokens, from $0.0016

What the search robot simulator shows

How a search robot sees a page

A robot first downloads the HTML code and only then (sometimes with a delay) runs JavaScript. So everything that appears on the page only after scripts may be invisible on the first pass. If the simulator shows far less text than the browser, the content is built by JavaScript, and it is better to serve it right in the HTML (server-side rendering).

What it is for

Indexing diagnosticsIf a page does not get into Google, check whether it has text, whether there is no noindex and whether the canonical is correct.
Checking SEO requirementsYou will see a missing title, description and H1, duplicate H1s, images without alt and headings that are too long.
JavaScript sitesFor React, Vue or Angular, check whether the server returns full text without running scripts.
Competitor analysisLook at the heading and link structure of the pages that rank above yours.

How this differs from Googlebot Checker

The simulator shows the page content: what exactly the robot reads. Googlebot Checker answers a different question: is the bot let onto the page (robots.txt, response code, blocking) and does it get the same as a browser. Together they give the full picture. For bulk checks of addresses use indexing check.

Limits of the check

We do not run JavaScript, do not load images and styles and analyse only one page. We cannot tell elements hidden with styles from visible ones, and the real Googlebot is identified by IP, so bot protection (WAF) may answer us differently than Google. This is an approximate model, not an exact copy of a search engine’s work.

What else StayIndexed can do

This page is a free tool from the StayIndexed service. In your account you can save a list of URLs, check them in one click and see when their title, H1, canonical or noindex changed (this is free too), while the service’s main job is to track how your pages do in Google.

Page indexingWhether the page is in Google, the technical reason if not, and the history of changes.3 tokens / check Website speedPageSpeed score for mobile and desktop, LCP, INP, CLS and improvement tips.3 tokens / check BacklinksWhether the link to you is still on the donor page and whether the donor is indexed by Google.3 tokens / check WHOIS and domain ageExpiry date, registrar, name servers and change history for a list of your domains.Free DNS LookupAll DNS records, resolver comparison, SPF, DKIM and DMARC.Free Sitemap CheckerSitemap.xml validity, limits, duplicates, pages blocked in robots.txt and response codes.Free Blacklist IP CheckerAn IP check on 16 DNS blacklists and the change history for a list of your IPs.Free Robots.txt CheckerErrors in robots.txt, a check of whether a URL is blocked for a bot, and the file's change history.Free Site IPA domain's IP addresses, hosting, country, ASN and CDN detection with change history.Free SSL CheckerSSL certificate expiry, chain of trust, TLS, HSTS and change history for your list of sites.Free Redirect Checker301 and 302 redirect chains, loops, step timing and change history for your list of URLs.Free HTTP HeadersServer response headers, security grade, compression, caching and change history for your list of URLs.Free Googlebot CheckerThe page through Googlebot’s eyes: robots.txt, noindex, canonical, comparison with a browser and a Googlebot IP check.Free My User-AgentYour User-Agent, a breakdown of browser, system and device, and bot detection.Free CMS detectionCMS, version, theme, plugins and technologies of a site with change history for your list of URLs.Free Site through the eyes of a robotMeta tags, headings, visible text, links and images of a page without JavaScript, with change history for your list of URLs.Free Broken linksCrawl of up to 20 pages of a site: broken internal and external links with the pages where they are, and change history.Free robots.txt generatorTemplates for WordPress, a shop and Joomla, rules for AI bots and Sitemap. A ready file in one click.Free Outbound linksAll external links of a page: broken, redirects, nofollow and hidden, with change history for your list of URLs.Free Favicon generatorFavicon.ico, PNG icons for the tab, iOS and Android and code for your site: from an image, a letter or an emoji, in one ZIP.Free MD5 onlineMD5, SHA-1, SHA-256 and SHA-512 of a text or file and a check for a match with a ready hash.Free

How much it costs

The check is free, both on this page and in your account. Tokens are used to pay for the other services: indexing, speed and backlinks cost 3 tokens per check. 30 tokens are credited at sign-up, no card required.

Up to 10000 tokens$0.00102
10001–50000$0.00068
Over 50000$0.00054
Buy tokens

Frequently asked questions

How do I see a site through the eyes of a search robot?

Enter the page address in the form above: we will open it as Googlebot without running JavaScript and show meta tags, headings, text, links and images.

What is Spider Simulator?

It is a tool that shows a page the way a search robot reads it: without styles and scripts, only the code, text, headings and links.

Why is there less text in the simulator than in the browser?

Most likely, part of the content appears through JavaScript. A robot may see it with a delay or not see it at all, so important text is better served right in the HTML.

Does Google see content created by JavaScript?

Google runs JavaScript, but in a separate queue and with limits, and other search engines do it worse. It is more reliable to serve the main content in the source HTML.

Can I check a page that is blocked in robots.txt?

We load the page regardless of robots.txt to show its content, but a real bot would not go there. Check whether the address is blocked for the bot in Googlebot Checker or Robots.txt Checker.

How much does the search robot simulator cost?

Nothing: the check is free both on this page and in your StayIndexed account. In your account you can save a list of URLs, refresh the check in one click and see the change history.

Watch your pages through the eyes of a robot

A list of URLs, meta tags, headings and change history — in your account, free of charge. Sign-up without a card.

Start for free