It’s two years since we launched Mwmbl, the open source, non-profit search engine, on Boxing Day 2021. A good time to take stock of where we are and where we’re going.
We’ve indexed over 100 million pages Thanks to our volunteers, who crawl the web using the Firefox extension and command line script, we’re crawling up to a million pages a day, as you can see on our stats page. There are around 50-60 users crawling on an average day.
An update from November 2024 on the linked site indicates they have indexed 500 million pages. Thank you for sharing, but I would appreciate it if you could verify the information and avoid making assumptions based on misinterpretations.
An update from November 2024 on the linked site indicates they have indexed 500 million pages. Thank you for sharing, but I would appreciate it if you could verify the information and avoid making assumptions based on misinterpretations.