Don’t waste the human skin byproduct!
Don’t waste the human skin byproduct!
Fascinating, I didn’t realise the latency down there was that bad. How hard was it to get the process working across two distant servers like that?
Lemmy servers don’t send the next activity until the first is received. From memory it was something like 150-200ms for the round trip to Finland and back. That means a maximum of about 5 or 6 activities per second at the best of times. However, when Lemmy receives say a new comment, it then sends a request to retrieve the user details from the user’s instance, and the whole pipeline is held up. The worst I saw was occasional activities taking 8 seconds to complete (I guess whatever data was being fetched was on a slow instance).
At one point, kbin.Social hammered Lemmy.world with duplicate requests which then tried to federate out, and that was when the problem was noticed (though Lemmy.world does average more than 5 a second so even after kbin issues stopped we couldn’t recover). A guy on matrix Nothing4You (I’m not sure of Lemmy username ) built a pre-fetcher to trigger Lemmy to retrieve details of posts before Lemmy.world tried to federate them out, thus helping those situations where it was taking multiple seconds to retrieve all details. It helped but was not enough to turn the tide, and we were still getting further and further behind. Nothing4You was meanwhile building a complete batching solution, which you can see on github.
So for me? It was easy, I just signed up for a server and ran an ansible playbook to set it up, then added a docker container to the Lemmy stack, all the while getting personalised help 🙂. I’m not sure how hard it was to conceptualise a solution, build it, test it, and make sure it was fault tolerant, because I didn’t have to!
It’s prime time for broccoli, cauli, winter veggies. One of my kids cites broccoli as their favourite food, which means all the broccoli jokes in kids movies aren’t appreciated. But we eat more than our fair share of broccoli and cauliflower, and by extension cheese sauce.
Oh I’d forgotten about the Mechanical Turk!
That “so & so played this in 1850” is also what puts me off it sometimes. I play a bit (on my phone, no one to play it with IRL), I’m not that good, and I feel like getting better involves memorising the right moves. Especially getting into a good position early game. I don’t really have the time, and even more so I don’t have the will to memorise things.
Maybe there’s opportunity for a pre-approved list? Visiting a cave sounds like a high risk activity that feels low risk, so it might be hard for a school to make a good call on. But if there was a list of activities to guide schools, maybe that could help?
It transfers some of the responsibility to the government (who organises the list), and could give schools a concrete list of things they should be doing or considering for different activity types.
I know of people with similar mechanisms who had problems with very sincere-sounding bad actors before ChatGPT.
There are many ChatGPT answers, but I think this more affects instances like Beehaw who ask for an essay and have to pick the AI out from the others. My instance has a short and specific question and works to weed out a lot of this, though I’m confident some spammers still get through (and are sitting on accounts waiting for them to age up a bit).
Hey, unrelated, but do you know if they ever got the database code cleaned up? One of these days that’s actually going to start to bite; my instance already had to do a hardware upgrade once.
I’m not familiar with that specific code, but it probably depends on the last time you looked at it. In the early reddit migration days a lot of optimisation changes were made in a hurry, but there were issues that arose as instances scaled. These were patched up by various releases but on my instance the average CPU usage of the 0.19 versions is 30% or more up on the 0.18s.
Being in NZ we were also hit hard by the issue of federation being concurrent. To this day we are running an extra VM in Finland to batch up activities and send them in bulk to be replayed on the Lemmy server. I’m pretty sure I saw a pull request for that recently though so it might be fixed in the next version (but we’ll have to wait until Lemmy.world updates if I understand it correctly).
I should try and figure out how a list of bad IPs would best fit into ActivityPub. It sounds like it would be easy enough to add.
Perhaps such a thing exists for Mastodon and could be applied to Lemmy?
Nice tip! I didn’t know this.
Personally I like Organic Maps better than OSMand, though you do have to download the map regions rather than load them on the fly. It’s still OSM, though, so doesn’t solve the problem of needing to use Google to find places.
It sounds like they spotted multiple people at different times in the footage they reviewed, like it was known to be a thing so now all sorts of people are going down and adding their half drunk flavoured milk.
You can buy valid gmail address by the thousands. Email validation is one part of a multilayered approach. It cuts some out, but you need more layers. Captchas work, they cut some proportion out, but not all.
Probably the most effective is registration applications, but this is a huge barrier to entry. If we want Lemmy to grow, we are going to have to change the current state (most instances require an application to join), or change peoples expectations. You can sign up for a reddit account just like that, and start using it without waiting for approval. Why would people choose Lemmy? On our instance we had a drop in registrations to about 1/10 of what we had with open registrations.
Unfortunately I don’t know the answer. It probably involves taking on strategies like reddit if we are going to scale that big (auto-mod, karma, etc). Unfortunately we will have even more trouble, because in the users host instance doesn’t ban them then an admin on every other instance has to ban them for that instance. So we probably need to be able to follow ban lists to auto-ban users that have been banned on other trusted instances or something like that. As we grow, I’m sure we will have more pain before it gets better, but I’m hopeful that we will solve issues as they arise.
There are already spammers all over Lemmy. There’s a coordinated effort to remove spam, it just doesn’t include IP addresses (which aren’t that helpful because they change and with CG-NAT entire neighbourhoods can share them, and with VPNs people not near each other can - plus if you have a dynamic IP then restarting your router can give you a new one).
Yeah I can only find driving directions. I’ve come across other apps over the years but only ones on Google Play Store. I don’t think I’ve seen any mobile apps that are open source and do my region.
My favourite was that I enabled TOTP for Facebook, but for years they would also SMS a code as well. So the benefits of TOTP over SMS were eliminated. I don’t think they do that anymore, but I don’t log in to Facebook very much so maybe they do.
Chess is an interesting game for so many reasons. There’s a story told as a sign of the power of AI (and perhaps a warning), where for years Stockfish was this chess engine that could beat all others (by this time, maybe 2010?, humans had no hope). Then one day Google (technically a company Google bought) came out with this neural network AI AlphaZero that was beating Stockfish within a few hours of training, despite never being told anything about chess. It was simply given time to play games against itself until it worked out how to win.
My understanding is that Stockfish later adopted a neural net and is once again the best, but it is a pretty impressive story.
Chess is also interesting because it may never be considered a solved game. They are more moves possible than there are atoms in the observable universe, and it’s not even close.
Just think of all the kombucha being brewed around the world where they just throw out the scoby instead of using it as imitation human skin! So much opportunity!
Haha yes, I did wonder how it could go on for months without anyone thinking to put up a camera. I’d guess there is probably already a camera, it’s just the company hasn’t responded yet (and might not want to).
To my knowledge, there is no coordinated sharing of IP addresses between instances. Different instances are run by different people, so it’s very unlikely the IP address will matter.
A new username on a new instance is likely enough that no one will ever know, so long as your posts or comments don’t give you away.
I will also upvote because unpopular opinion but I don’t agree.
The benefit of the fediverse is that you can pick an instance and communities that align with your moderation preferences.
Personally I’d rather they be locked. Every shit fling pushes the thread back to the top of Active.
Plus, communies have rules. Moderators (in theory) enforce those rules. If there is so much rule breaking the moderators can’t keep up, it makes sense to just lock the topic and let the unpaid moderator go have a drink.
Kagi Maps has it as an option too. And it works on Firefox. 🤷
You don’t need to scrape. If you want to get all the content on Lemmy, just set up an instance and subscribe to all the top communities, and the instances will just send you all the content.
So there isn’t really a way to monetise or block it. I guess you could only federate to a whitelist, but the biggest instances will federate by default with any new instances until they are given a reason to defederate.
Neither! I also had this question. No emphasis on any part, karma-la.
I don’t know why, but I only really like the pureblack theme. Maybe that’s what I’m used to?