babbiorsetto

joined 1 year ago
[–] [email protected] 1 points 1 year ago

It just happened again. I couldn't ssh in despite the limit on docker resources, which leads me to believe it may not be related to docker or Lemmy.

This time it lasted only 20 minutes or so. Once it was over I could log back in and investigate a little. There isn't much to see. lemmy-ui was killed sometime during the event

IMAGE                        COMMAND                  CREATED      STATUS         PORTS                                              
nginx:1-alpine               "/docker-entrypoint.…"   9 days ago   Up 25 hours    80/tcp, 0.0.0.0:14252->8536/tcp, :::14252->8536/tcp
dessalines/lemmy-ui:0.18.0   "docker-entrypoint.s…"   9 days ago   Up 3 minutes   1234/tcp                                              
dessalines/lemmy:0.18.0      "/app/lemmy"             9 days ago   Up 25 hours                                                         
asonix/pictrs:0.4.0-rc.7     "/sbin/tini -- /usr/…"   9 days ago   Up 25 hours    6669/tcp, 8080/tcp                                    
mwader/postfix-relay         "/root/run"              9 days ago   Up 25 hours    25/tcp                                                
postgres:15-alpine           "docker-entrypoint.s…"   9 days ago   Up 25 hours

I still have no idea what's going on.

[–] [email protected] 1 points 1 year ago (3 children)

I had the same thing happen. Max CPU usage, couldn't even ssh in to fix it and had to reboot from aws console. Logs don't show anything unusual apart from postgres restarting 30 minutes into the spike, possibly from being killed by the system.

You say yours solved itself in 10 minutes, mine didn't seem to stop after 2 hours, so I reeboted. It could be that my vps is just 1 CPU, 1 GB RAM, so it took longer doing whatever it was doing.

Now I set up RAM and CPU limits following this question, and an alert so I can hopefully ssh in and figure out what's happening when it's happening.

Any suggestions on what I should be looking at if I manage to get into the system?

[–] [email protected] 1 points 1 year ago

I figured it out after a good night's sleep.

The UI doesn't let you send a request with empty allowed instances, it either sends an array with your picks or no array at all if you selected none. To reset allowed instances you need to send an empty array to the API.

The easiest way to do it is

  • Open browser devtools network tab or equivalent
  • Send a request with at least one allowed instance
  • Edit the request JSON body to empty the array
  • Resend the request

I think Chrome lets you copy the request with authentication to send with something like curl, I used Firefox which lets you edit and resend directly.

Peace ✌

8
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

Hello, everyone. I managed to set up my instance and started playing around with admin settings. I put an instance in the allowed instances list to figure out how that worked, now I can't undo it. The allowed instance doesn't show up in the field for editing, but it does in the instances page. I can overwrite the allowed instances with others, but I can't completely remove them. I'm at a loss about where to go from here, I would like to remove the allowed list or otherwise restore the ability to federate with all instances. Thanks 🙏

I commented a solution