One of the most common questions from small business owners who have just launched a website is some version of "why am I not on Google yet?" The answer requires understanding a process called crawling and indexing, which is how Google discovers and records websites. This article explains exactly what happens, in what order, and how long it realistically takes before you can expect to see results.
What is a web crawler?
Google uses automated programmes called crawlers, sometimes referred to as spiders or bots, to discover and read content on the internet. Google's main crawler is called Googlebot. It works by following links from page to page across the web, reading the content it finds, and sending that information back to Google's servers.
Think of Googlebot as a researcher visiting every library on earth, reading every book, and making notes. The notes go into a giant catalogue called the Google Index. When someone performs a search, Google searches its index rather than the live web in real time. This is why the internet is fast: Google has already done the reading and just has to look up its notes.
Discovery: how Google finds your site in the first place
Before Google can crawl your site, it has to find it. There are several ways this happens:
Links from other websites
If another website that Google already knows about links to yours, Googlebot will follow that link and discover your site. This is the original mechanism by which Google explored the web when it launched in 1998 and it still works today. Getting any legitimate external link to your new site, from a business directory, a social media profile, or a partner's website, can accelerate discovery.
Sitemaps
A sitemap is a file that lists all of the pages on your website. Submitting your sitemap to Google Search Console is the most reliable way to make sure Google knows about all of your pages. You do not need to wait for Google to find them by following links. You are handing Google a map of your site directly.
Most website platforms generate sitemaps automatically. The file is usually found at yourdomain.co.uk/sitemap.xml. Once you have verified your site in Google Search Console you can submit the sitemap URL and Google will process it, typically within a few days.
Direct submission via Google Search Console
Within Google Search Console there is a URL Inspection tool. You can paste any page URL from your site and request indexing directly. Google will then crawl that specific page within a few days. This is useful for new pages or pages you have recently updated that you want Google to recrawl quickly.
Crawling: what Googlebot actually does
Once Googlebot has found your site, it will crawl it. This means visiting each page, reading the content, following the internal links to other pages, and recording what it finds. The speed and thoroughness of this crawl depends on several factors.
Crawl budget
Google allocates a crawl budget to each website, which is essentially how much time and resource it is willing to spend crawling it. Large, well-established websites with millions of pages get crawled more frequently and more thoroughly than small, new websites. For a small business site with a handful of pages, all of your pages will typically be crawled within a few days of being discovered. The crawl budget does not usually become a concern until a site has hundreds or thousands of pages.
What Googlebot reads
Googlebot reads your page content, your headings and subheadings, your page titles and meta descriptions, your image alt text, your internal links, and your structured data if you have any. It also checks technical factors like page load speed, mobile-friendliness, and whether the page is accessible to crawlers (some pages are blocked by robots.txt files or noindex tags, intentionally or by mistake).
Googlebot cannot read text that is embedded in images. If important text on your page only exists as part of an image file rather than as actual HTML text, Google cannot read it. This is why putting your contact details or service information inside an image is a mistake from an SEO perspective.
Indexing: being added to Google's catalogue
After crawling, Google processes what it found and decides whether to add your pages to the index. Not every crawled page gets indexed. Google may choose not to index a page if it judges the content to be low quality, duplicate, thin, or not useful to searchers.
You can check whether your pages are indexed by searching for site:yourdomain.co.uk in Google. This shows all of the pages from your domain that are currently in the index. You can also check individual pages using the URL Inspection tool in Google Search Console, which will tell you whether a specific page is indexed and when it was last crawled.
Ranking: how long it realistically takes
This is where most of the confusion lies. Being indexed and ranking are two different things. Your pages might be indexed within a week or two of launch. That means Google knows they exist. It does not mean they will appear on page one of results for competitive searches anytime soon.
Ranking position is determined by Google's algorithm comparing your page against every other page in the index for a given search term. A new website has no track record, few or no backlinks, and no historical performance data. That puts it at a disadvantage relative to established sites, which is why rankings take time to build.
A reasonable expectation for a new small business website in the UK:
| Search type | Typical time to see results | Notes |
|---|---|---|
| Your business name (branded search) | Days to weeks | Usually the first thing to rank. Low competition. |
| Local long-tail keywords (e.g. "boiler repair Crewe") | 1 to 4 months | Depends on local competition. Well-built site helps. |
| Local service keywords (e.g. "plumber Cheshire") | 3 to 6 months | More competitive. Requires consistent content and citations. |
| Broader non-local keywords | 6 to 12 months or more | High competition. Requires authority building over time. |
These are averages. Some sites rank faster, some slower. The main variables are how competitive the keyword is, how well-built and technically sound the site is, how much relevant content it contains, and how many quality backlinks it has.
What you can do to speed things up
Submit your sitemap immediately
Verify your site in Google Search Console on launch day and submit your sitemap straight away. This is free, takes ten minutes, and removes any delay caused by waiting for Google to discover you organically.
Get your first external links early
Create or claim your Google Business Profile on the day your site launches. Add your website URL. Do the same on Bing Places. Submit your business to Yell and the other main UK directories. These create links to your site from established platforms, which helps Googlebot find you and contributes to your initial authority.
Make sure your site is technically sound
A site that is slow to load, not mobile-friendly, or has crawl errors will rank more slowly even if everything else is right. Use Google PageSpeed Insights to check your page speed and fix obvious issues. Use the Coverage report in Google Search Console to check for indexing errors.
Publish content regularly
New content gives Googlebot more reason to return to your site frequently. It also gives you more chances to rank for additional keywords. Even one new blog post per month signals to Google that your site is active and maintained.
Do not expect instant results and do not panic
The number one mistake new website owners make is checking their rankings daily in the first few weeks and concluding that SEO does not work because nothing has happened yet. Nothing will have happened yet. The process takes time. Set a calendar reminder to review your Google Search Console data at the one month, three month, and six month marks and assess progress properly over those timescales.