Nothing4You

You basically can’t if your instance was set up before 0.19.4, as there won’t be any association between users and uploads for older uploads. You also can’t do this without breaking thumbnails everywhere unfortunately.

The latest Lemmy version has a fix where thumbnails now are actually stored at a reasonable resolution for thumbnails, but old thumbnails may be quite large, and this does not retroactively shrink older thumbnails.

It’s possible to pull image aliases from the DB and ignore them when iterating over aliases within pict-rs, but you these will only be manual uploads, not automatic uploads like generated thumbnails. For posts by local users, deleting thumbnails will also end up breaking them for 0.19.5+ instances, as they should reuse the original thumbnail url.

you might find some inspiration from https://breezewiki.com/ - either its codebase directly or using it as an intermediary while scraping

@fmstrat@lemmy.nowsci.com there’s also rss feeds for communities

ugh, i didn’t notice they’re even hiding domains of remote communities for “simplicity” in most cases. that seems so much more dishonest tbh.

this isn’t entirely true, they do have some comments on lemmy as well, here are some examples:

• https://programming.dev/u/vinaya@api.clubsall.com
• https://programming.dev/u/chester22@api.clubsall.com
• https://programming.dev/u/impresario@api.clubsall.com
• https://programming.dev/u/luckymann@api.clubsall.com
• https://sh.itjust.works/u/BlazeFromLemmy@api.clubsall.com

it seems to be primarily about their communities not federating though i guess?

and either nobody from there posted a post to a lemmy community yet or maybe it doesn’t federate posts currently?

lemmy.ml doesn’t use cloudflare, that’s strange.

i’ve also never had issues with this when looking at instances that do use cloudflare.

pretty much, yeah. lemmy has a persistent federation queue instead of fire and forget requests when activities get generated. this means activities can be retried if they fail. this allows for (theoretically) lossless federation even if an instance is down for maintenance or other reasons. if mbin has a similar system maybe they could expose that as well, but unless the system is fairly similar in the way it represents this data it will be challenging to integrate it in a view like this without having to create dedicated mbin dashboard.

lemmy has a public api that shows the federation queue state for all linked instances.

it provides the internal numeric id of the last activity that was successfully sent to an instance, as well as the timestamp of the activity that was sent, and also when it was sent. it also includes data like how many times sending was unsuccessful since the last successful send. each instance only knows about its own outbound federation, but you can just collect this information from both sides to get the full picture.

there is also https://phiresky.github.io/lemmy-federation-state/site to look at the details provided by a specific instance.

it’s not just lemmy.world.

of the larger instances, the following have trouble sending activities to lemm.ee currently:

• lemmynsfw.com -> lemm.ee: 2.81d behind
• sh.itjust.works -> lemm.ee: 1.04d behind
• lemmy.world -> lemm.ee: 22.5h behind

i pinged @sunaurus@lemm.ee on matrix about 30h ago already about the issues with federation from lemmynsfw.com, as it was the first one i noticed, but I haven’t heard back yet.

at least the image resizing topic has recently been fixed in lemmy, thumbnails sizes are limited (at the time of thumbnail creation) in the latest release. I’d have to look closer at the other stuff, the api part is unlikely to have changed and will affect all frontends, but js part should differ depending on the front end. some instances already use other frontends by default and there is also a replacement for lemmy-ui being worked on (lemmy-ui-leptos), but I don’t know how they compare. either.

it should be taken into account though how much of this is cacheable as well, as it will then typically only affect the first load for the static files.

I can totally understand the issues in general though, I’ve been living with a 64kbps uplink for several years in the past.

requires sending ~25-fold less data per post

what are you referring to with this? AP traffic?

do you have some more information about this?

I’m not familiar with n8n but it’s fairly straightforward on the API side.

You’ll need a session token, also known as JWT, which you can get from logging in.

You typically don’t want to do a login for every post, so you’ll want to store that as a persistent value.
For authentication, you can pass the header authorization: Bearer {jwt}, with {jwt} being the session token.

https://join-lemmy.org/api/classes/LemmyHttp.html contains the API documentation.

You’ll need to figure out the id of the community that you want to post to.

If you need to look it up, you can use getCommunity to fetch its details. Afterwards you can use createPost to submit it.

The form links for the methods explain the request body json values that should be provided.

It should be noted that the (visibility of) community bans are a result of better enforcement of site bans in 0.19.4, which for now is implemented by sending out community bans for local communities when a user gets instance banned: https://github.com/LemmyNet/lemmy/pull/4464

Prior to this, when a user got instance banned from .ml, they were also implicitly banned from .ml communities, but this was only known to the instance they were banned on. As a result, users were still able to post, comment, and vote on those communities, but it would be visible only on that user’s instance, not federated anywhere else. Visibility of this ban was exclusively on the banning instance’s modlog.

fyi @SpaceCadet@feddit.nl