we started searching for a tool specifically built for complex discussions. We found none
This was basically solved in Usenet, more specifically, in news reader software. You had a clearly arranged threaded view (you could see the thread structure of as many as 50 postings on a single screen), with unread threads and unread postings highlighted, and pressing Tab jumped to the next unread posting. Unread status was per posting/comment, not by time. Many more conveniences for quick navigation, filtering, and so on.
All newer discussion platforms have been a step back in terms of efficiency of use and ability for deep, long running discussions. Initially due to web browser limitations (though nowadays that shouldn’t be much of a problem anymore), and later due to mobile touch interfaces (still poses some difficulties).
So why do you think Usenet is not the mainstream status quo for conversations then?
Usenet died due to spam. Newsgroups were unmoderated by default, and moderation wasn’t built into the protocol. Then PHP web forums took over because they were discoverable by web search and only required the web browser that you had anyway. They also added support for popular features like posting images and using emoticons graphics, instead of only text (though the latter hasn’t hurt HN).
Doesn't that make Usenet unfit for complex public discussions, at least?
It worked quite well with a mostly-academia audience. For the general public, of course, moderation is indispensable. The spam in Usenet began when businesses and scammers discovered Usenet. My point in the root comment is that Usenet clients contained all the ingredients for efficient, structured, long-running, deep discussion, and those are orthogonal to moderation, which you nowadays need in any case.
The problem with Usenet style interfaces isn't just spam, it's low value comments. Comment voting somewhat solves this but most people vote based upon how much they agree rather than the comment's discussion value.
This should be solved by moderation when necessary, like in traditional web forums. I agree that voting is a bad mechanism, because people then start posting for likes and reaction stats, and also involuntarily judge posts by their like count instead of only by their own judgement. Flagging/reporting to moderators is fine.
I'm not sure moderation is that much better. Some moderators strive to be fair but the majority will still vote and moderate based on preferences. There's also the quantity issue, most low-value comments don't break any rules but also aren't very insightful.
It really depends on the community. You can certainly have rules against low-value or one-sentence comments. Here on HN you can get banned if you post too many low-value comments, it doesn’t need voting for that.
I haven’t seen the lack of voting to be a major problem in newsgroups or traditional web forums. But I’ve come to despise the prevalent dynamics of liking/voting in newer platforms.
Slashdot solved this (arguably) by having you classify comments as "interesting", "funny", and several other categories, rather than plain up/down. Although Slashdot failed here by mapping these categories to a single score.
I would argue that Usenet died due to binaries, not spam. Binaries were what made it untenable for independent ISPs to run full-feed Usenet, which sent people who cared about Usenet to third-party centralized services, which destroyed incentives for independent shops to attempt to run Usenet.
These systems were developed before unsolicited commercial promotions started flooding these mediums, later, automation made it worse.
We may distinguish between USENET the public network that is part of the Internet (considerd "out of date" by many because it is not Web based, and indeed suffering from spam) and the USENET protocol, which you can use to set up your private version of USENET-like discussion groups.
In fact, many organizations had (and some still may have) inhouse groups, often prefixed "local." e.g. "local.events", "local.jokes" etc.
Advantage: threaded discussions, open standard (many existing open source readers e.g. Emacs: M-x gnus)
Most people don't want to have truth-seeking complex discussions because it's hard and boring.
Hard, boring, and a social liability.
There's a lot of truth to be found out there that is useful, technical, and utterly devoid of public attention.
But if the truth-seeking you're thinking of is being a culture war truther, that'd certainly explain the woes.
A lot of technical issues are very controversial.
It can be difficult to discuss inside an enterprise because everyone’s already so committed to a particular solution.
People have very strong opinions about crypto, SPAs, and CDNs.
It can be difficult to discuss technical issues inside an enterprise, but if it turns into a social liability, either you enterprise culture is extraordinarily corrosive to the soul, or what you're doing is culture war.
The words they used are social liability, not merely controversial. It's a pretty high bar for how wrong a discussion in an enterprise has to go that it turns into a social liability.
Maybe they're thinking about what they said, which is seeking out truth about issues that happen to be thrown around in culture war?
Anyway, you don't have to go all the way there for knowledge to become a social liability. The more you understand about the universe and the human world - hell, the more permission to think you give yourself - the more you realize just how much utter bullshit regular people believe about everything. Homeopathy, weird coaching stuff, fitness and dieting and cosmetics. This supplement will help your health, that fruit will stop some ailment, looking at a microwave when it's cooking will ruin your eyes, etc. Most of this bullshit is fed by content marketers, through magazines, shows, radio, podcasts, and social media.
I have a whole rant about ethics of advertising, but that's for another day; point here is: it doesn't take much truth-seeking before it gets incredibly cringe to talk with most people. You either let them keep believing in bullshit and suffer inside, or speak up and end up being pushed out of the group.
It's kind of boring at the beginning while you figure out where people are coming from, but if you do it genuinely and openmindedly, it's bound to get interesting.
Especially if the mob and/or government begin to want to "cancel" you.
Because it sucked, and people fondly remembering it have blotted its manifold failures out of their memory. Imagine HN or Reddit, but virtually every post in every thread quotes huge chunks of preceding posts, often many layers deep. Randomly remove comments from threads; remove different comments from different servers at different times, to make sure nobody sees the exact same content. Eliminate search. Eliminate all but the most blunt-force moderation. Eliminate user profiles, or following particular users. Divide the universe into a global taxonomy of discussion topics, then allow people to cross-post from one to the other, starting firestorms of confused argument and complaint. Wait 2-12 hours for your discussion partners to see your as they move peristaltically through the store-and-forward NNTP system. Expire all history after a week or so. Every once in awhile, just for fun, drop a 50-comment-long chain of uuencoded binary chunks into the middle of your debate about Lisp.
Usenet was one of the first systems of its kind, and it's no wonder people look back on it wistfully. It was wild, being able to talk (or argue, or flame, or troll) people all around the world at every hour of the day. Usenet was amazing. So was the Sony Vaio. You wouldn't want to use it today, though.
I don't know what you're talking about. I use Usenet daily.
Usenet is the best forum system out there; everything web thing is just a ghetto/silo.
And yet you have 29622 karma points here. To accumulate those points, how many hours did you spend reading and writing on what you'd presumably call a ghetto/silo?
However, I've never been able to actually discuss anything substantial here beyond two or three exchanges at most, usually.
Where is the equivalent of the Usenet three-month-long thread?
The karma points are not transferable, which ticks off the checkbox under the silo column.
Isn't a mailing list as good at hosting a three-month-long thread as Usenet is?
No-one has found a funding model that works for it.
Disproved by subscription-based www.cix.co.uk.
I don't see anything about Usenet service on there. More generally, while a few people are willing to pay for access to a discussion service, most aren't and it's not clear that the people who are are a big enough market to be viable.
I was referring to the paradigm but sorry yes you are right the parent was specifically about usenet.
Agreed.
https://en.wikipedia.org/wiki/Eternal_September
Eternal September lowered the average quality of Usenet content, but it’s not what ultimately lead to its demise. I actually only started using Usenet around the mid-90s, and continued for a good decade. The problem later was spam, and web forums being much more discoverable, and somewhat easier to get started with, so that’s where new users went.
People mention the spam, but the decentralized nature also makes it plain harder to use than the web. It's like the difference between Mastodon and X.
Your experience was largely dependent on the server and client you happened to use. I mainly ended up reading threads on Deja News (later Google Groups) because you could at least search for messages that were outside of the retention period of most servers.
No need for anyone to still have their own artisanally bespoke thoughts on "why": the reasons for the decline of Usenet are well-documented and easily found. It's a fascinating part of internet history worth reading up on.
FWIW, many email clients -- before Gmail dumbed down email forever and no one seems to understand that email replies form a tree anymore -- also had (and maybe some still do?) that way of viewing the world.
Or like the HN comment system :)
The HN comment system discourages depth as there is a relatively shallow limit to threads. There also is no in-built concept of an inbox to monitor replies.
This baffles me so much. It would be so simple and valuable to add.
Hacker News prefers quality over quantity and signal over noise. Deeper threads tend to result in uninteresting, low quality comments as the subject matter diverges from the topic at hand, or flamewars, so long-term engagement is discouraged.
I think the main reason for flame wars isn't the depth of threads but the users. Usenet had no such depth limits, LessWrong doesn't have them today.
All these decisions add up to people just not replying to interesting questions.
More often than not, nobody will reply, so all threads are just one or two levels deep. Or in the rare case someone actually replies to an interesting point, it's usually not the original poster. Probably because they had no idea that anyone had even followed up on their post.
Requests for elaboration mostly go unanswered, and comments are made expecting no replies. So people just shoot ideas into the void, with interesting interactions only happening when someone famous comments.
It discourages reflexive replies. The depth limit is a soft one, just an extra step that perhaps gives one a chance to pause and cool down.
No, HN doesn’t have read/unread state, and also cuts off discussions after a day. This makes checking for new comments tedious, and prevents any longer discussions.
There arae numerous email clients for Linux-like platforms that provide this, both text-based adn GUI.
Text: Mutt, Alpine, and emacs's mailer off the top of my head. There's a listing of other clients here: <https://www.tecmint.com/best-commandline-email-clients-for-l...>
GUI: Sylpheed, Thunderbird, KMail (KDE's Kontact suite still strikes me as one of the best I've encountered), Evolution, and Clawsmail.
My own strong preference remains mutt, and the ability to process huge amounts of complex email reasonably well is still utterly unmatched.
I like mutt, but aerc [0] is imho much better. But no matter which solution you prefer, editing emails in the terminal is so much more efficient. If the majority would switch to pure text emails instead of HTML...
Missing a link?
Sorry!
https://aerc-mail.org/
And some additional sources:
https://www.dennisc.net/writing/tech/gmail-aerc
https://www.julioloayzam.com/guides/email-with-aerc/
My simple config and binds that are a little bit more "vim-like":
https://github.com/rafo/aerc-vim
aerc sometimes breaks on non-compliant email because the author of the header parser refuses to introduce kludges to handle broken email. When it happens, the mail in question simply doesn't show up in the list. I fully understand that position, but it's not really ideal as a user who can't simply refuse to deal with broken crap. So after using it for a couple of months I reverted to neomutt.
Thunderbird is still alive and developing.
Outlook killed it, gmail arrived at a scene with an already dead body :-(
I have a very hard time connecting this to my lived experience of Usenet, which was full of top- and bottom- quoted posts, broken threads, and routine missing posts that sometimes left people talking past each other for days. I dearly loved Usenet; it started my career. But I don't miss it. Even before you get to basic affordances like posts, moderation and sorting, and following specific people, the basic nuts-and-bolts experience of discussing topics on Usenet was worse than it is today on Reddit, Usenet's rightful heir.
This must've differed a lot between usenet groups then; the ones I was on strictly followed a bottom (or infix) posting pattern and would chastise people who did it differently.
So the culture enforced the discussion format, not the technology.
Technically we could be all writing in a giant Notepad file, and adhere to any discussion format.
That's basically how discussions work in Wikipedia (and other MediaWiki projects). Discussion pages are just a giant text file which anyone can edit fully. The only extra feature over Notepad is an implicit edit history.
It feels like a straight line to that from the c2 wiki, where that was all pages, not just discussion pages. Discussion happened inline.
What made this workable was that discussions were rarely "hot" - typically you discussed with one or two users over a span of many hours / days. Once you got many people editing the discussion page at the same time, you got conflicts which were solvable but annoying.
(My experience is more than 10 years old, though)
The technology supported and encouraged it, for example by editors placing the cursor and the signature at the bottom of the quoted post by default, and auto-removing the quoted post’s signature, so you could immediately start typing your reply at the “right” location. Furthermore, when reading postings, the viewer would automatically jump to the first nonquoted part.
In email, top-posting began when Microsoft’s first email client placed cursor and signature at the top of the quoted email instead, and didn’t provide commands to reflow partial quotes, or any of the features mentioned above. It also had no threaded view, which is what makes it practical to only partially quote instead of fully.
Culture is important, but technology can influence it heavily.
I disagree with this; I lived through this switch. The problem might be that it was a paradigm shift; I realize what reddit does is not something USENET could be scaled to(?). Using USENET across multiple decades, I was used to following certain groups meticulously, tracking and reading whatever new items appeared. In particular, the news reader application - NN - had very solid tools for browsing and tracking discussions. When set up correctly, I could work through updates by pressing the space-bar to page through them.
Reddit, and the even worse lesser forums, loses pretty much all of that. Browsing reddit, for me, feels more like watching a mix of a river with flotsam drifting by, a busy traffic street, uncoordinated fireworks, and a tornado ripping through a midwestern city. There are no tools to track what you have and haven't read already, or what new comments have appeared. You cannot sort and filter the posts properly, the best you get is a "do you feel lucky?" search, which often shows that "no, you weren't lucky today". On low-traffic subreddits, it IS possible to track new stuff, but you have to do so manually. I offer no solutions, I don't know how to effectively do highquality discussions for 6 or 7 billion people.
I find this part as the general trend of enshitificaiton. Sometimes it's incompetence in UI/UX, other times it's other perverted reasons such as to keep users confused causing them to linger and be server more ads or to confuse users with billing, etc.
What struck me early on with Reddit is that it's where conversations go to die.
That's both a matter of design and scale. Forums larger than ~10^2 -- 10^3 participants aren't really discussions so much as a compilation of hit-and-run pieces. For very large subs (10^5 -- 10^6), discussion is effectively over within a day, if not hours.
A strong contrast are the now-defunct Google+ and (at certain points in its evolution) Ello, and the not-quite-dead-yet Diaspora*, all of which had or have a "notifications" pane in which recent discussions are presented in full, and to which all or most prior participants (so long as they've not muted the discussion) see not only direct responses but new comments. I've seen specific conversations continued for days, weeks, months, and even years, productively, and it's a really good way to noodle at an idea (particularly with a good post moderator) over time.
There are other factors about that which also contribute. All three of these platforms are post-and-comment style (HN can be somewhat like this), where the post author is the moderator of that post (HN is NOT like this). I consider the post author a "host", and think of this as a "salon-style" network. Barring blocking actions (which can have a pretty profound impact, TBH), everyone is mostly seeing the same discussion.[1] All three platforms also showed comments to posts in strict, flat, chronological order. As a long-time user of threaded interfaces (tin, mutt, /., Reddit, HN, etc.) this grated strongly on me for quite a while, but I eventually came to see the model as useful and with merits. It's an option and a tool in the box, though I'll still say it's not appropriate in all cases.
I'll also note that G+, Ello, and Diaspora* all have relatively small limits on discussion, with a post permitting up to 500 comments, so while the platform sizes could be large (G+ claimed over 4 billion "accounts", though highly actives were ~10 million or so), individual discussions tended to be fairly small. I'll also note that the salon-style engagement was fairly rare, many people (and institutional/organisational profiles) treated the platforms as post-only or broadcast, and my experience may well be niche. That said, there were some awesome discussions on all three of these which simply don't seem to gell elsewhere: Reddit, HN, and the Fediverse come particularly to mind.
Specific to HN: it's ... close. Discussions are threaded and moderated (both by mods and members, though by different mechanisms). There's no notification of follow-ups and it's hard to tell when a conversation's really died, or if it's still active. Participation quality is ... mixed, but there are some occasional gems. I do regret that there aren't better tools to surface really-high-quality comments or threads, though there've been some manual processes in the past ("best of" lists). That effort's largely been dropped, for understandable reasons of time and scale.
________________________________
Notes:
1. Some day I really should write up my thoughts on blocking. Effectively, it seems to create a geography or topography of the social network, which combined with follows and inter-participant links gives paths of greater and lesser propagation. Blocking by highly-linked nodes in particular can be devastating to reach, particularly in a simple chronological timeline. I'm a fan of the mental-hygiene aspects of blocks,[2] but have to admit that being on the receiving end can occasionally hurt. But beyond that, the effects on how following and blocking shape the overall network and activity dynamics is simply fascinating to me.
2. <https://toot.cat/@dredmorbius/104371585950783019>
I have the same response, more or less. Loved usenet, and miss it, but don't know it would actually compare well to reddit or even other forum software. I think the amount of traffic in usenet was smaller, the groups were smaller, and far less nasty actors.
I think worshipping Usenet is just a simple case of rose-tinted glasses. Like people telling how awesome old OSs and applications were in the 90s ;)
When did you first encounter Usenet?
I'd had my first tastes in the late 1980s, where some uniformity of tools, platforms, and cultures (tin, Unix, and largely uni-based participants) tended to cohere. I've cited on HN Brian Reid's Usenet activity surveys (from John Quarterman's The Matrix,[1] an early exploration of what we'd now consider social networks) several times on HN[2]. As of 1988, there were 381 newsgrous, 1,933 articles/day, 4.4 MiB/day of traffic, 7,800 hosts, and 141,000 readers. That's ... tiny by contemporary standards.
Cultural norms broke down rapidly as Usenet spread first to corporate networks (Lotus Notes email formats remain a massive annoyance etched in my brain), and then the general public. By the mid-1990s, Usenet though far more active and reaching far more people was a pale shadow of its former self in terms of culture and relevance.
The fundamental technical presentation along with the original posting culture was fairly effective. That unfortunately didn't scale. One of my concerns as I look at decentralised networks with multiple clients and server implementations (e.g., the Fediverse) is that a diversity of tools will inevitably result in a broken set of standards and practices. In the case of the Fediverse, the baseline is fairly low, though there are implementations and/or instances which offer some fairly narrowly-supported capabilities, notably raw HTML or Markdown formatting, and equations support (as with ColinWright's Mathstodon).
I'm not arguing against your experience, FWIW. I am arguing that your experience is probably highly time-dependent on when you participated in Usenet, and the era from 1979--1992 is markedly different from that of 1993 onward, though cracks were already starting to show.
I've also noted that HN has survived longer than Usenet's golden age, and with remarkably stable quality. It's not all it could be, but it's not the worst of what's online either, and by a long shot. Despite some frustrations, I still find it useful.
________________________________
Notes:
1. <https://archive.org/details/matrixcomputerne0000quar/page/24...>
2. Search shows most, excepting where I've brainfarted "Eric" for "Brian": <https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...>
Good moderation can increase the signal to noise ratio immensely, but also increases the latency.
I vehemently disagree that Reddit is in any way even approaching equivalent, much less better, than Usenet was.
There's something about the text area, vs an email-like posting box, which encourages low-thought short replies.
Zulip has many of these features I believe. Anecdotally it seems to be great for running an online discussion forum for a high school or college level class.
Twist is a better Zulip. Zulip has some awful UX decisions, though the chat experience is definitely a step up on Slack.
Twist is hugely underrated and doesn’t get the attention it deserves.
I love Zulip, but Twist's free tier seems to be restricted enough that I'm put off trying it. Maybe a month of retention is OK practically, but I'd hate losing conversations if I don't end up needing it enough to pay, so I'm not even inclined to try.
I can't recommend Zulip in my context because - reading between the lines slightly - the size of servers it needs is untenable. It scales up, not out, so last I looked autoscaling and resilience weren't there for the number of users I'd need to support.
I lead the Zulip project, feel free to stop by chat.zulip.org to discuss what you're trying to do.
Just to clarify for anyone here reading, Zulip can be scaled out, but largely our philosophy is that you should only scale out if you need to, since it comes with extra fiddly operational headaches and is expensive in dollars. We've designed Zulip with an efficient data model and well-indexes queries, and are constantly working as we add new features to maintain the property that only multi-tenant installations like Zulip Cloud should need to scale it out.
In particular, Zulip on a single server with 16GB of RAM can handle 10,000s of users, thousands of which are concurrently active. (That's what we use for chat.zulip.org, for example, and the machine is usually about 96% idle with only half its memory used).
(Keep in mind that Zulip's public access option means you don't need every user to create an account in order to access content).
I don't know your context, so I can't comment on whether zulip would be suitable. But there are very few communities today having complex conversations involving 100K+ people in a single organization/workspace, so I would expect it to be quite rare that autoscaling would be relevant. (Certainly there are Discords with over a million users, like the Midjourney one, but most of those users are just users the product, not having discussions at all; the company famously made the unusual decision to only offer a Discord bot as UI for their product).
https://zulip.readthedocs.io/en/latest/production/requiremen... has some basic guidelines on Zulip's scalability for a single-instance deployment, but those are fairly conservative -- the goal is for folks to be able to deploy with those settings and be safe even if their load profile per user is fairly heavy for whatever reason.
It is open source (appears to be django-based), so presumably you can treat it like any other Python app and optimise it that way.
I used Zulip last week to ask a question on Lean on their community.
I only sent like 3 messages, but it was awfully slow. Didn't come away with a good impression.
I'd be curious to investigate this; do you have many tens of thousands of unread messages in the Lean community, or is it a new account?
I ask because we have a known issue in Zulip that the first minute or two of using the product is quite slow for folks with 100K for unread messages because it the web app's client-side data fetching system ends up fetching them all in order to make clicking around the app afterwards extremely snappy.
We've reworked that system over the last few months, and it'll be deployed to Zulip Cloud next week if all goes well. But if you don't have a lot of unread messages, I'd very much like to understand why -- I'd love for you to stop by chat.zulip.org and debug with us a bit if you can spare a bit of time.
(It could be that the Lean community Zulip involves rendering a LOT of LaTeX, for example)
I didn't spend a lot of time. I logged in again just now to check.
You are right. Lean community had about 3K unread messages for me. After I marked a whole bunch read, and clicked around a bit, speed is now good.
Thanks for making me check.
My only other feedback would be that there is a new user "tutorial" or rather the interface highlights certain aspects of the UI for the new user. The bubbles that pop up for this, are too small and not noticeable on a dark theme. Make them bigger and different color.
You’re right. We shouldn’t try to improve what we are doing now.
I’m saying it’s worth looking into what worked in the past, and why. It’s not uncharted territory.
Yes. The only critical issue I'd see with Usenet's client interfaces would be linking cross threads.
At some point a thrrad becomes irrelevant because of parallel discussions in other threads, being able to easily redirect to a specific point in another thread helps a lot. But that requires an URL, and messages ids weren't used for that purpose.
I actually remember using message IDs to reference other postings. Newsreaders had commands to jump to a certain message ID. You had to copy the message ID from the posting, but on Unix that was just a double-click, and a middle-click to paste, so quickly accomplished.
You only think in yours UX world.
That site shows quite different UX for same logical structure as you said.
I would say backend core logic is almost same as usenet reader or mail client for mailing list.
But the real value is quite different.