I was curious if anyone knows anything about the large delay for content coming in from lemmy.world? There’s a discussion over there in one of fediverse communities and apparently we’re like a week behind in receiving data.

  • SalamanderMA
    link
    fedilink
    arrow-up
    9
    ·
    edit-2
    6 months ago

    Hi!

    Yes, I have been told about the slow federation. I have tested a few things - for example, I am able to fetch up-to-date data from Lemmy.World immediately. But I am not entirely sure why the federation is so slow in the background. Has anyone noticed if this affects only lemmy.world?

    I have two things planned:

    • Move images to object storage, which will be a more efficient way of using space. I can also use what I gain from decreasing disk resources by increasing the RAM and CPU count.
    • Upgrade the instance to 0.19.4

    My plan is to do these first and hopefully the federation issues are fixed during the process, and if not the next step will be to troubleshoot. But I have been so busy recently, and I do want to have a long block of uninterrupted time in case that things go wrong and I have to spend some time troubleshooting. I will try to do these tomorrow.

    EDIT: I have looked through the search for others experiencing similar issues, and it seems to be something experienced in the past by other instances, and so I will try to get some inspiration from those previous experiences: https://mander.xyz/post/10489815

    • Lee Duna@lemmy.nz
      link
      fedilink
      English
      arrow-up
      4
      ·
      6 months ago

      There’s another overlooked issues regarding the slow federation. And I just found out a few days ago, there’s de-peering drama since mid February that caused a huge of delays from APAC to Europe.

      https://www.thinkbroadband.com/news/9896-ntt-cogent-peering-dispute-increasing-latency-for-some-routes

      https://www.reddit.com/r/networking/comments/1cu13bv/cogent_depeering_tata/

      Around that time until now, I had trouble accessing some sites, like I couldn’t access some github projects, f-droid repos also failed, and also some websites. I’ve tried cloudflare warp, it didn’t help either.

      And if I’m not mistaken our admin has a solution to this issue a while ago, you may ask Dave.

      https://lemmy.nz/post/10046390

      • SalamanderMA
        link
        fedilink
        arrow-up
        4
        ·
        6 months ago

        Huh, interesting! I was not aware of this. Thanks!

    • Blaze@reddthat.com
      link
      fedilink
      English
      arrow-up
      2
      ·
      6 months ago

      Hello!

      Are you on the admins Matrix channel? The APAC instances (Reddthat, lemdro.id, Aussie.zone, Lemmy.nz, Blahaj) had the same issues a few weeks back, they managed to solve them somehow, they’ll probably be able to help you out

      • SalamanderMA
        link
        fedilink
        arrow-up
        2
        ·
        6 months ago

        Thanks!

        I have collected a few of the posts… I have lagged behind on a few things (object storage, migrating pictrs database to postgres, upgrade to 0.19.4), so I am trying to catch up and during this process I will see if I can implement their solutions.

        I have also noticed a generally slower experience when using the instance… After I move the files to the much cheaper object storage I will be able to allocate more resources to RAM, CPU, and bandwidth. I was under the impression that the slow federation could be related to this decrease in performance, but from what I have read now it seems that it happens independent from this.

    • Blaze@reddthat.com
      link
      fedilink
      English
      arrow-up
      2
      ·
      6 months ago

      EDIT: I have looked through the search for others experiencing similar issues, and it seems to be something experienced in the past by other instances, and so I will try to get some inspiration from those previous experiences: https://mander.xyz/post/10489815

      Good luck!

    • Aviandelight OP
      link
      fedilink
      arrow-up
      2
      ·
      6 months ago

      Hi Sal, thanks for the update and everything you do here! Glad to hear that everything is okay and I completely understand being busy.😊 Fingers crossed on the new version fixing most of the issued.