Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
93000 mails since 2008 are just 2,1 GB. I have an archive on my home server where I also host my main IMAP server. I just move them from the inbox to Archives.YEAR.
I've been using imap-backup for many years without issue, it backs up to mbox files that it can restore onto any IMAP server because it also stores IMAP metadata on the side. I then backup the dir itself using borg. It deduplicates and compresses so the backup archives themselves are extremely small.
I think that is the way I want to go! Thunderbird on my PC is the „central mail client“, so I just have to draw the archived years (imap) to a local folder. The advantages: If I look for an older mail, I do not have to search in seperate archived files (mbox/eml). And with backing up thunderbird, I have a backup of all my settings AND mails!
Sync to Thunderbird. Tools > Export.
I know it is not ideal, but it works as long as Thunderbird is around.
An interesting question, and something I never really thought about because I host my own mail server which has daily backups.
Do you actually have an option to export folders from Thunderbird? I couldn't find anything so maybe you're using a plugin to perform that function?
As for format, I think the .eml files are more universally recognized if you want to transfer your message to another client. I have avoided mbox for years because it packs everything into a single large file -- handy if you want to copy it somewhere else, but a pain to work with if you're trying to find a specific message and the more emails you have stored, the slower it gets. Another option which you didn't mention, but maybe you have available (this is what I use on my mail server), is the maildir format. This stores every email as individual files in their named folders, and in plaintext format so you can open them up in a text editor or search through the files with command line tools. Since there is no compression it takes up a lot of space but I find it worth the storage.
If you have mbox or maildir file backups, one option would be to spin up a local mailserver of your own that acts as a relay to your email provider (or even multiple providers or mailboxes). This option might also work to download a copy of all your folders without having to do a full backup from your client, but that probably depends on how the server is configured. The point, however, is that if you have a local mail server running with a full copy of all your emails, then you would now have the option to simply back up the server files as a whole. You can even do recursive backups from a daily script so the task is completely automated and then you don't have to remember to perform the task on a regular basis.
Anyway, just some things to think about.
MBOX is a standard format, which is text based, (like the emails themselves are) and should be compatible across multiple email clients. It can contain entire folders.
EML is also a standard text format, but usually contains a single email in each file.
In the worst case, you can just open up either one in a text editor if you need to find something.
I’ve been meaning for years to set up a solid archiving system that I don’t have to manually babysit. I’ve had my eye on mailpiler (https://www.mailpiler.org/), but haven’t found the time to get up to speed on it. I’m the meantime, I drag messages to a local folder like a barbarian.
Commenting because I too am interested in this. I also would like to see if anyone has solved the issue with Thunderbird and Yahoo email where only 10,000 emails are kept. I have an inbox with about 20+years of emails, and with the 10k cap, I realized Thunderbird was literally deleting the oldest ones. Since I wisely told it not to delete them on the server when it copied them, I didn't lose them, but with that volume of emails, I really don't want to have to manually move them into folders. Guess this turned into a ramble, but it would be nice to have a backup since you never know when one day you will wake up to be told service x is shutting down.
You could use mbsync to automate this. You can configure it so that it downloads new mail with IMAP, but keeps them even if they are deleted from the server.
Then you will have a Maildir that you can manage with any mail client, index with notmutch, etc.
It doesn't really matter, you should do it however the mail archive software wants it. Apparently there is a pretty big difference between eml and maildir, so you possibly need to try both ways to see what works with your software and workflow.
What email archive software do you use? I've often thought about spinning up an IMAP server locally that doesn't send/receive but allows me to copy all my old mail to it. I have a dozen or more email accounts across different providers and would want each kept separate in the archive. They also span 15+ years.
What does the Thunderbird logo have to do with this?
My Lemmy-client forces me to add a picture. I was pretty sure to find a solution with thunderbird - what I did