I'm a Kagi search/assistant user and advocate but the "small web" product is a frustrating misnomer.
To me the small web is any little website that was created to be interesting rather than to sell me something. That includes stuff like neocities, "shrine" type sites, single purpose sites, fandom portals, web experiments, etc.
Unfortunately Kagi's definition of "small web" is: blog or webcomic. You must have an RSS feed and it must have recent posts. That rules out so much interesting stuff I don't understand the point.
freetoniktoday at 11:05 AM
On a similar note, I maintain and grow a manually curated collection of personal blogs with valid RSS feeds: https://minifeed.net/blogs
The criteria is simple: human-written (as much as I can validate myself), in English (for now), with valid RSS feed, and not a micro-blog (so, more than just feed of links or short tweet-like messages).
Similar to Kagi's Small Web viewer, or StumbleUpon-style viewer: you can get a random listing of blogs [1] or a random listing of posts from all blogs [2]. Feeds and posts are indexed, so full-text search works across all blogs. When possible and permitted by robots.txt, text is scraped for searching, so even if some text is omitted in the RSS feed by the author, search should work.
Though I do plan to implement a similar "view one random post at source" kind of view, soon.
UPD: Feel free to submit a blog, including your own! [3]
Jokes aside, it's really nice and I can totally see becoming addictive. Kudos to Kagi team for an other user oriented product. (as a side note, I am using Kagi daily and i didn't know about this tool)
ArtificeAccounttoday at 11:40 AM
I've been using the Kagi search engine for months now and I'm not impressed. I bought into it because there were a lot of posts saying that it was "just like old Google" but this has not been my experience. It's the same as new Google, you can type in what you're looking for exactly and you'll get random sort-of related websites.
I remember when you could half-remember a comment from a website, type that into Google, and get taken to the article you were looking for. That was back in like 2010. To me that's the old, and useful, search engine that I want.
It refreshes every 5 hours and shows you the most recent blogs published on Kagi. Check it out!
azangrutoday at 11:57 AM
The first random page it returned to me was this â https://gaultier.github.io/blog/how_to_make_your_own_static_... â which was about building one's own static site generator, which I really liked. I did not realise when I closed that page how hard it would be to find it again, because, of course every new visit to Kagi returns a different page :-)
barbazootoday at 4:52 PM
Love Kagi and most things they do, don't get me wrong, but this is a bit ironic:
> This page is auto-generated from Github Actions workflow that runs every day at night and fetches the 5 latest articles from each of my favorite blogs.
arscantoday at 11:16 AM
I do love the concept, but a little part of me died
each time I came across an article with a very strong AI voice. That just feels antithetical to the âsmall webâ ethos because it obscures the âneighborâ behind it.
erremerretoday at 10:25 AM
I like the idea, but would like to be able to select a language and see the small web of that language. There are more languages than English, and this tool could make them thrive.
Also somehow if they are clever, they could use this for those translation system they are using, but please let us select our own language without feeding automatic translation like youtube does).
Aachentoday at 2:13 PM
Does it work for you guys to go to about and then click on the "list" link?
For me it says I'm blocked due to hitting a "secondary" rate limit (don't understand what that means). I don't think I've opened a page on github yet today so clearly it's a lie. Is it the referer that triggers this?
In general, freeloading the "small web" on a Microsoft service is kind of ironic. Being blocked by algorithms that try to detect if you're really human is precisely one of the things one would hope to get away from by using small, personal websites
input_shtoday at 11:46 AM
Could've at least checked if the website even allows embedding before embedding it, I found two by randomly clicking around that don't.
My blog was getting traffic from that domain! So that is what that is.
Venn1today at 3:58 PM
Ah, this might explain the traffic from Kagi a week or so ago. I've been scratching my head over that one. I just checked, and my wee little blog is listed in smallweb.txt. Neat!
Curious what goes on behind the Next Post and Show Similar buttons.
the_axiomtoday at 4:11 PM
I have the impression that Kagi is trending here every month
__eriktoday at 6:10 PM
This is cool, it reminds me of stumbleupon from back in the day
unbindableisaactoday at 11:16 AM
Bit bummed. The first random page I landed on was a really interesting article for me. The custom cursor (well why not) had me struggling to following a link, and instinctively I refreshed the page. I ended up somewhere else in the haystack with ostensibly no way back to that particular article.
Perhaps I'm yelling into the void here, but what would be great is when first landing at kagi.com/smallweb, the url query parameter would be somehow set, as it is when "Next Post" is clicked.
starkparkertoday at 6:06 PM
First impressions: My first five pages were stallman.org, a paywalled cybersec newsletter, a German-language blog, an AI-generated blog post ad for a cattle fencing service, and a blog republishing a Disney Parks press release
myth_drannontoday at 12:54 PM
Too many AI or relegion related sites.
titzertoday at 1:03 PM
How do we keep getting surprised by enshittification!?
The worst case scenario is that AI runs everything, we have no skills, and are completely dependent on it...and it shows us crummy commercials and subtly steers us to paid placement with no recourse whatsoever. I hate this possible future, but this is where the money will lead.
papakatsutoday at 3:11 PM
I thought this was going to be about payment processing for shareware applications.
lich_kingtoday at 2:18 PM
I think it shows the limits of hand curation. It's a tiny, human-reviewed slice of the "small web", only allowing a subset of blogs... but if you select the "programming" category and click around for a short while, you get a fair amount of obvious AI slop.
I don't think it's Kagi's fault, but I guess it's depressing in a way. A lot of "small web" bloggers dream of being a part of the "big web", and when they get a cheat button, they have no second thoughts about mashing it.
drstewarttoday at 10:39 AM
Some context would be helpful
jweltentoday at 11:08 AM
Interesting, really like the idea. Maybe in the future a possibility to use it in multiple languages
lelanthrantoday at 1:38 PM
This is fantastic - how long do I have to press F5 before my blog shows up?
:-)
7777777philtoday at 12:18 PM
I run a Hugo blog and I get more interesting referral traffic from Kagi's small web index than from Google at this point. 5,000 curated sites is small enough to be useful most "indie web" directories are graveyards unfortunately..
sam_goodytoday at 10:43 AM
So, basically, a random site from their index of ~30,000 sites.
You can choose similar sites by index.
But what are the criterion to have your site listed here, or how it will prevent this from just becoming a massive gamified advertising index, or anything more about "why these?" is not obvious to me.
Can anyone explain what is special about these sites specifically, or where this project is going?
deletedtoday at 10:00 AM
apples_orangestoday at 10:46 AM
A bit off topic, but I noticed I hardly ever use search anymore. It's just google.com/ai in 99% of cases. I believe in the future, search engines must go in this direction ..
deletedtoday at 10:28 AM
deletedtoday at 10:27 AM
myth_drannontoday at 2:05 PM
Can we just agree that the internet is broken and no amount of boutique search solutions will save it? Kagi, DDG, Google they are all trying to do a search in a pile of steaming sh*, in a hope of finding that shining diamond.
Quite possible that people will come up with a solution eventually. Like Samizdat was a solution to censorship and a broken publishing system in USSR.
leontlovelesstoday at 4:06 PM
[dead]
devcraft_aitoday at 3:00 PM
[dead]
WhereIsTheTruthtoday at 10:49 AM
Kagi wants to exist in a world that doesn't need it anymore