this post was submitted on 13 Nov 2024
185 points (96.5% liked)

Selfhosted

40246 readers
573 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

I never could get Nix working but maybe someone will

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 42 points 5 days ago* (last edited 5 days ago) (1 children)

Wireguard is p2p.

EDIT: I guess the point is it's doing peer discovery without static public IPs or DNS. Pretty cool!

[–] [email protected] 10 points 5 days ago* (last edited 5 days ago) (3 children)

Or port forwarding. You have to open a udp port for wireguard

load more comments (3 replies)
[–] [email protected] 28 points 6 days ago (3 children)

Interesting, it's on AUR, I will try it.

So it doesn't need any port forwarding, and works on CGNAT? How the "NAT hole punching" works? Both clients connect to something on IPFS?

Afaik, for DHT with torrent, clients need to know at least one tracker, what is the "tracker" here? Something on IPFS? Who am I sending my IP addresses?

How much overhead does this add to speed? I love with Wireguard, that it's barely noticeable, really close to p2p speeds, OpenVPN was awful in this regard.

[–] [email protected] 1 points 1 day ago

DHT is autonomous and does not require a tracker. Usually it is only used as a fallback as a regular tracker is quicker. It's p2p, and is split accross people hosting it.

[–] possiblylinux127 11 points 6 days ago* (last edited 6 days ago) (1 children)

First off great find. I didn't think to check the AUR. I personally wouldn't use it as that version is 3 years out of date but its existence means that it might be entirely possible to get a non Nix version. I'm not sure I fully understand why it needs Nix OS but what do I know.

It is all libp2p magic

There have been lots if talks on libp2p and Nat traversal. I suggest you check them out. How it actually works is pretty complex and requires someone more knowledgeable than me to explain. One way it works is that both devices start a TCP connection at the same time which gets the proper ports to open up.

[–] [email protected] 14 points 5 days ago* (last edited 5 days ago) (1 children)

AUR packages ending with"-git" or "-svn" always pull the latest commit from source. The version number means that was the last time the packager had to change something on the PKGBUILD script, not the actual version which would be installed.

Where should I look? Where were these talks? I'm interested.

Edit: I found the whitepaper about hole punching: https://research.protocol.ai/publications/decentralized-hole-punching/

It says it connects to a "Hole Punch Coordination (DCUtR - Direct Connection Upgrade through Relay)". So for NAT traversal to work, you need a third party, this relay. As I expected. I guess you can self host this, but than you could just host a wireguard server. I guess if you are on a locked down network where you cannot connect to any relay (e.g. how the Chinese Great Firewall works technically they could block it) you can't initiate a connection behind a NAT.

Nonetheless it seems interesting, but no magic here. Maybe the big difference that the relay servers are distributed, so no central authority to block easily.

[–] [email protected] 2 points 3 days ago (1 children)

That doesn't match my experience with AUR at all. Usually it pulls a specific git revision and checks the hash. This also ensures that the build shouldn't suddenly fail to some extent.

Though it's entirely possible that it's not like this for all packages, though I find it kind of counterintuitive since your package manager wouldn't know when to perform an update in this case.

[–] [email protected] 3 points 3 days ago

It's documented in the wiki, they are called VCS packages, and it's not the usual, they work a bit differently: https://wiki.archlinux.org/title/VCS_package_guidelines

You can see in this instance, that it skips the sha checking for upstream source, in line 15 of the PKGBUILD it says 'SKIP': https://aur.archlinux.org/cgit/aur.git/tree/PKGBUILD?h=hyprspace-git#n15

sha1sums parameter is documented in the wiki: https://wiki.archlinux.org/title/PKGBUILD#sha1sums

In the PKGBUILD file you can list sources (line 12,13) and their respective checksums (line 14,15). In this PKGBUILD there are 2 sources: the first is the systemd unit file, it's coming from the package's AUR repo, not from upstream, you can see its checksum. The second source is the actual source, and you can see, it's checksum is 'SKIP' so it shouldn't be checked.

With these kind of packages you can't get notified if there is an update available, but if you install it again with your favorite AUR helper it would update itself for the latest version. It calculates version number from the latest commit hash, before building and installing, so if that is the same it won't update again.

[–] possiblylinux127 2 points 4 days ago (1 children)

The PKGBUILD looks like it is just building via go. I'm not sure how you would configure it without Nix. I'll try building it.

[–] [email protected] 2 points 4 days ago

Nix just calls the *.nix files, it's still go under the hood. PKGBUILD is similar to the flake.nix and package.nix files to me, but I have no experience with nix.

[–] [email protected] 13 points 5 days ago (2 children)

YAML?? (╯°□°)╯︵ ┻━┻)

[–] [email protected] 31 points 5 days ago* (last edited 5 days ago) (3 children)
what:
  is:
  your:
    - problem
    - with:
      YAML
# At least you can have comments unlike in json. Who need comments in a config file anyway.
[–] [email protected] 9 points 4 days ago

Hey did you know that any JSON file is also a valid YAML file? I bet you'll love YAML a lot more now that you have this information

[–] [email protected] 11 points 5 days ago (1 children)

Nothing too major about how it's usually used, but the yaml spec does allow arbitrary code execution when parsing a file and relies on the parser to have that feature disabled: https://en.m.wikipedia.org/wiki/YAML#Security

That's why for python, yaml.save_load() is a thing. That's fine for your local config files and may even be a feature for you, but it shouldn't be used to exchange information between services.

[–] [email protected] 8 points 5 days ago (2 children)

My general view is similar, yaml is better if it should be written by humans, json is better if it should be written and read only by a machine. but hyprspace uses json for configuration, so I don't really understand cellardoor's comment

[–] [email protected] 2 points 4 days ago

Xml has entered the chat

[–] [email protected] 4 points 5 days ago

Yeah I agree. Although recently I've become partial to toml... In the end I'll use what's common in the ecosystem I'm developing in

[–] [email protected] 12 points 5 days ago

Toml is superior to all.

[–] [email protected] 5 points 5 days ago

Careful. The yaml cult will come after you in a long and formless column, and only self destruct when one of them is a step too far to the left.

[–] [email protected] 5 points 5 days ago

This reminds me of nebula although nebula does require a central server to coordinate hosts.

[–] [email protected] 3 points 5 days ago (1 children)

Is this made by the same guy who does hyprland?

[–] [email protected] 9 points 5 days ago (1 children)

@semperverus @possiblylinux127 No, this other person has a working 'e' key on their keyboard.

[–] [email protected] 3 points 4 days ago

Eh what its hyprspace. The title is incorrect but the link says hypr

load more comments
view more: next ›