Dust0741

joined 1 year ago
[โ€“] [email protected] 2 points 1 day ago (1 children)
[โ€“] [email protected] 2 points 2 days ago (6 children)

Files won't change and are hundreds of GBs

 

Say I have a large txt or CSV file with data I want to search. And say I have several files.

What is the best way to index and make this data searchable? I've been using grep, but it is not ideal.

Is there any self hostable docker container for indexing and searching this? Or maybe should I use SQL?

[โ€“] [email protected] 1 points 2 weeks ago (1 children)

Yup! Just got it installed on my pi. Still gotta wire it in. Any documentation to help? I haven't found out which controller I have yet.

 

I'm wanting to heavily mod my 3D45. I basically want to use a raspberry pi to run it, but just repurpose the existing hardware. I am new to this area of 3d printing, and would love some suggestions to get started. I know of octoprint, but does it do all of the reading gcode?

[โ€“] [email protected] 3 points 3 weeks ago

Checkout my super recent post history. I'm doing something very very similar.

Basically I've decided on Debian for OS, docker plus Portainer and dashy for interface, and mdadm for raid 1.

I've tested a raid 1 failure and rebuild on two thumb drives I have, and have everything well documented. Feel free to ask any questions.

[โ€“] [email protected] 3 points 3 weeks ago

Yea I have a fully seperate backup solution

[โ€“] [email protected] 1 points 4 weeks ago (2 children)

Any recomended monitoring solutions? Or just proxmox and grafana?

[โ€“] [email protected] 10 points 4 weeks ago (5 children)
 

Its new homelab time. And with that, potentially a new OS time too.

I currently am very happy with Debian and Docker. The only issue is I am brand new to using data redundancy. I have a 2 bay NAS I'll use, and I want the two HDDs to be in raid 1.

Now I could definitely just use ZFS or BTRFS with Debian, and be able to use Docker just like I do currently.

Or I could use a dedicated NAS OS. That would help me with the raid part of this, but a requirement is Docker.

Any recommendations?

[โ€“] [email protected] 2 points 1 month ago (1 children)

I can see the data on windows, but not on linux

[โ€“] [email protected] 2 points 1 month ago
root@skynet:~# ntfsfix -b -d /dev/sda1  
Mounting volume... NTFS signature is missing.  
FAILED  
Attempting to correct errors... NTFS signature is missing.  
FAILED  
Failed to startup volume: Invalid argument  
NTFS signature is missing.  
Trying the alternate boot sector  
Unrecoverable error  
Volume is corrupt. You should run chkdsk.  

root@skynet:~# ntfsfix -b -d /dev/sda2  
Mounting volume... OK  
Processing of $MFT and $MFTMirr completed successfully.  
Checking the alternate boot sector... OK  
NTFS volume version is 3.1.  
Going to un-mark the bad clusters ($BadClus)... No bad clusters...OK  
NTFS partition /dev/sda2 was processed successfully.

turned off windows quick start ran chkdks D: and waited...then shut down and put drive back into linux and reboot. still no


any ideas? clearly not the larger partition, which is good.

 

I have nginx up and working with pihole and its great. I can get to: https://dashy.homelab.duckdns.org/ On my PC but not my phone. On my phone, pfsense blocks it and says "Potential DNS Rebind attack detected, see https://en.wikipedia.org/wiki/DNS_rebinding Try accessing the router by IP address instead of by hostname."

Why? I've disconnected and reconnected to WiFi, and waited a day.

 

I have a hdd attached to my server. It's sda but has 2 partitions so sda1 @16M and sda2 @3.6T It defaulted to being in the location /media/devmon so I kept that and it worked for ages. Suddenly the data is gone. I had files located here: /media/devmon/4tb_drive/kiwix/zim and that directory is now empty. But I put the drive into a Windows box, and everything was there.

When I run mount /dev/sda2 /media/devmon/ it says:

The disk contains an unclean file system (0, 0).
Metadata kept in Windows cache, refused to mount.
Falling back to read-only mount because the NTFS partition is in an
unsafe state. Please resume and shutdown Windows fully (no hibernation
or fast restarting.)
Could not mount read-write, trying read-only

I originally formatted this drive in Windows, is that the issue? Ideally I'd use btrfs or zfs not ntfs, but here we are.


How do I get access again?

 

I'm looking for 16TB HDDs. They'll be for fairly light usage. Immich will be the heaviest thing running on it.

New? Used? Certified? Like this?

 

Referencing: https://lemmy.world/post/17588348

I want to make a NAS with a 500GB boot drive and 2x16TB HDDs. Based on my previous post, btrfs is a good option. It also looks easy to get started. My plan for the NAS would be to purchase several 16TB drives, and only use 2 of them.

My first question is about different drives. Could I purchase two different brand drives and use them with btrfs? (I assume yes)

2nd question: how does the replacement process go? Like if drive A died, so I remove it, and put a brand new replacement in. What do I have to do with btrfs to get the raid 1 back going? Any links or guides would be amazing.

 

Goal:

  • 16TB mirrored on 2 drives (raid 1)
  • Hardware raid?
  • Immich, Jellyfin and Nextcloud. (All docker)
  • N100, 8+ GB RAM
  • 500gb boot drive ssd
  • 4 HDD bays, start with using 2

Questions:

  • Which os?
    • My though was to use hardware raid, and just set that up for the 2 hdds, then boot off an ssd with Debian (very familiar, and use it for current server which has 30+ docker containers. Basically I like and am good at docker so would like to stick to Debian+docker. But if hardware raid isn't the best option for HDDs now a days, I'll learn the better thing)
  • Which drives? Renewed or refurb are half the cost, so should I buy extra used ones, and just be ready to swap when the fail?
  • Which motherboard?
  • Which case?
 

Hi. Thermostats are expensive. I currently have this one, at my apartment.

I would like to replace it with one that connects to HA. First, is this a good idea since I'm in an apartment? I'll obviously keep the current one, and put it back before leaving. Second, what's a good one that is either open source or at least non internet based (but still works on HA)?

Thanks!

 

I want my self hosted things to use https. For example, I have Jellyfin installed via docker, and I want it to use https instead of http.

I don't care about necessarily doing this the "right" way, as I won't be making Jellyfin or any other service public, and will only be using it on my local network.

What is the easiest way to do this? Assume everything I host is in docker. Also a link to a tutorial would be great.

Thanks!

 

I have an RTL-SDR v4, and a Raspberry Pi. I am wondering if there is some way to get the ease of use that comes with the flipper zero with the pi. This is ignoring the packaging, and how small the flipper is. And also ignoring the replaying of signals, as additional hardware would be needed.

 

Looking for a docker containers or program to run on my server that looks at my list of subscribers (from google takeout or newpipe etc) and downloads them automatically. Ideally there'd be an option to delete after watching, and a nice interface to watch the videos as well.


Does anything like this exist? Thanks!

view more: next โ€บ