I’ve recently been wondering if Lemmy should switch out NGINX for Caddy, while I hadn’t had experience with Caddy it looks like a great & fast alternative, What do you all think?

EDIT: I meant beehaw not Lemmy as a whole

  • BitOneZero@beehaw.org
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 years ago

    something like Apache Kafka

    Not that I see. A database like PostgreSQL can work, but you have to be really careful how new data flows into the database. As writing to the database involves record locking and invalidates the cache for output.

    Or changing to something that can be scaled, like cockroach db or neondb?

    Taking the bulk data, comments and postings, outside PostgreSQL would help. Especially since what most people are reading on a Reddit-like website is content form the last 48 hours… and your caching potential dies way down as people move on to the newer content.

    The comments alone are the primary problem, there are lot of them on each posting and they are bulky data. Also comments are unique data.

    • Cinnamon@beehaw.orgOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      hmmm a good approach would be to maybe split comments into some kind of database regions and just load as they’re needed instead of loading them all at once