Blog for searchmysite.net

30 Oct 2021
searchmysite.net now with added Wikipedia goodness

This post has some more technical information on the indexing of Wikipedia for searchmysite.net. more...

23 Oct 2021
Some of the challenges of building an internet search

Of recent indexing failures, 62% are sites going offline, 19% are sites where robots.txt blocks indexing, and 5.5% are where Cloudflare blocks indexing. more...

11 Jun 2021
Progress update Q1 & Q2 2021

This is just a quick update on progress since the last post on 30 Jan 2021. more...

30 Jan 2021
searchmysite.net: The delicate matter of the bill

searchmysite.net is bootstrapped with no external funding. This post contains a review of current and expected running costs, and a summary of the plan to pay these. more...

17 Dec 2020
Advertising and search engines: When it is okay to mix and when it is not

searchmysite's approach to advertising has attracted a lot of positivity, but some negativity, so this post is to clarify the position on advertising and search engines. more...

12 Dec 2020
searchmysite.net is now open source

Topics in this post include: Why aren't other search engines open source? What open source licence is it? What are the future plans? and How can I contribute? more...

5 Dec 2020
Relevancy tuning for searchmysite.net

This post summarises the relevancy tuning following user feedback and growth. Ranking can be openly discussed because of the unique model designed to disincentivise spam. more...

29 Nov 2020
Web analytics on searchmysite.net

Keen-eyed observers may have noticed that the Analytics section on the Privacy Policy has recently been updated. This is a short post with further information. more...

22 Nov 2020
Improving stability and fixing issues on searchmysite.net

In the 4 days from 16 to 19 Oct, 215 sites were submitted. While this was great and led to some really useful feedback, it did expose some issues summarised here. more...

21 Nov 2020
searchmysite.net now has its own blog

Welcome to blog.searchmysite.net. I've split it from my personal website because searchmysite.net does seem to be starting to get a life of its own now. more...

9 Oct 2020
Adding a simple search page to my personal website with searchmysite.net

This post shows how I added a simple search page to my personal website with searchmysite.net. more...

25 Sep 2020
searchmysite.net update: Seeding and scaling

It has been over 2 months since https://searchmysite.net was launched, and I've had some good feedback. This post summarises the main changes - seeding and scaling. more...

18 Jul 2020
searchmysite.net: Building a simple search for non-commercial websites

Introducing https://searchmysite.net : a new model for a search engine, indexing only user-submitted sites, and promoting advert-free results. more...