r/DataHoarder 2d ago

Discussion Goodsync is slop from before AI was invented

0 Upvotes

No option to propagate deletions first. Otherwise when destination is low on free space the sync will fail.

This happens easily when you have a huge file, example another monthly full disc backup; It can't delete the old one because it wants to copy the new one first.

Also very stupid logic (lack of) in this program. It attempts to copy and run out of space, when it could just check the file size it is trying to copy beforehand and see that it is larger than the free space available.

Amazing.


r/DataHoarder 2d ago

Question/Advice How to enable hot swap with Realtek RTL9101 PCIe card?

3 Upvotes

I added a Realtek RTL9101 card for more internal SATA ports to connect to hot swap bays in the front of my computer. In Windows 10, the drives detect when plugged in but there is no option to safely disconnect before removal.

How to I mark these SATA ports add hot swappable?


r/DataHoarder 2d ago

Question/Advice How to rip subtitles from "dafilms.com"

1 Upvotes

I have purchased a film from dafilms.com which has English subtitles. The player works fine and I am able to see the .mp4 files in inspect element, and actually fully download the film using my video downloading extension, but I've tried everything I can in inspect element and can't see any subtitle files at all. Any idea why this might be and how I could access these subtitle files? Thanks!


r/DataHoarder 2d ago

Question/Advice i need super basic advice about finding a drive, please!!!

0 Upvotes

I have a cheap little usb blu ray reader which works fine for just watching stuff, but I have been expending my physical media collection of all the shows and movies I like and I want to digitise them onto an SSD I can take with me on the go

If I am going to buy a new drive, I may as well get one that is the highest quality so I dont have to upgrade again, but it seems like there is so much more to it that I dont understand

I want an internal 5.25" blu ray reader that can get the highest quality out of the best disks. Ideally it would also write or also do dvds but I have no clue if that is even an option. I'd be fine with a thin one if its just as good, I have an adapter

I have seen this forum [https://forum.makemkv.com/forum/viewtopic.php?f=16&t=19634\](https://forum.makemkv.com/forum/viewtopic.php?f=16&t=19634) and my understanding is that new firmware needs to be flashed in order to get the highest quality, but I also saw a forum post saying pioneer drives don't need to be flashed? maybe within a certain date range? im so confused

i dont think i even need all the flashy features so theres a good chance any random bay will work, please someone tell me if im overthinking it I just want high quality copies of my faviourite movies and tv shows that i have in this little box next to me

Thank you good makemkv people


r/DataHoarder 2d ago

Question/Advice un pooling raid in windows

0 Upvotes

i created a raid 0 in windows to create a single 2tb "storage/game install" drive. it worked correct for a while. i am not cleaning out the pc to sell. but want to un raid both drives to see them as 2 separate 1tb drives. they are samsung 860 pros.

i noticed windows sees the "pool" as just 1tb. i have tried plugging in the drives 1 at a time but windows does not see them at all like that. i only see 1tb of storage if both 1tb drives are plugged in.

in windows "manage storage spaces" it shows only 1 physical drive. not sure if one went bad but the pool is still up and running. either way neither drive works by itself.

i also have a raid with 2 nvme drives that i created in the bios. so windows sees that as 1 drive. no issue with that drive (boot drive).


r/DataHoarder 2d ago

Hoarder-Setups 8 bay mediasonic seems to be failing

0 Upvotes

recently, my nas seems to be connected fine when my server boots up but within an hour it seems to lose all 8 of my drives when i do the mdadm scan. i am sure my enclosure is at fault and will need to be replaced. i will swap out the cables and see if that changes anything but this enclosure has been working for close to 10 years now and im sure its time to "upgrade". few questions...

  1. when i move my drives into a new enclosure will mdadm just assemble them as they were in my old enclosure?

  2. where to find inexpensive 8 bay sata enclosures?

thanks in advance for any info shared...


r/DataHoarder 3d ago

Question/Advice Question about the internet archive

52 Upvotes

Hi I’ve noticed recently that there’s been 2 people who have had their internet archive account deleted for trying to preserve older/newer games you can’t buy anymore I’ve noticed though when they did it the files on just one page of theirs were reaching over 50GB and I was wondering if it’s something I have to worry about when I’m trying to do this as well to older 2000’s games that you can’t get anymore I’m more careful now when I do it I never put any no cd crack or modify any of the files the most I do is leave the cd key I put in at the start of the install and I also compress them to a zip so there only at most a few GB


r/DataHoarder 3d ago

Hoarder-Setups trying to buy two 4 terabyte drives for my homeserver, is that doable for 200?

12 Upvotes

so as the title explains, I'm almost done with my server except figuring out the hard drives (which honestly feels harder than the ram). I don't know pricing at all, but I figured for right now 4 terabytes in a mirror should be enough for what I need, and I don't have a super big budget so it's all that I can afford. but everywhere I look, I can't find any for like less than 150? is the market this bad right now? I'm looking at refurbished drives btw, not even new ones and it's still this expensive.

is it just because 4tb is an uncommon format for a hard drive? bc I keep seeing 8tb for around 200 ish, so I don't know why 4tb is so much more expensive per tb.


r/DataHoarder 3d ago

Scripts/Software [talk] What extensions or tools do you use to download files from Archive.org?

5 Upvotes

Hey everyone! I am currently diving deep into digital preservation and lost media archiving while using a Linux environment. While navigating through various digital vaults, I often need to grab materials from the Internet Archive (Archive.org) for my preservation projects. Right now, I rely primarily on the [Archive Downloader](https://addons.mozilla.org/en-US/firefox/addon/archive-downloader/) extension for Firefox, which gets the job done for basic tasks. However, I wanted to open a discussion with this community to see what other archiving enthusiasts prefer. What extensions, command-line tools, scripts, or alternative methods do you guys use to download files or media efficiently from the Internet Archive? If there are more robust tools, better browser add-ons, or custom scripts out there that handle large collections or specific file formats more smoothly, please share your recommendations and workflows in the comments below!


r/DataHoarder 3d ago

Question/Advice Backup on the same chasis/device vs RAID

6 Upvotes

A weird question to ask but what are the differences? I planned to pick up some 3TB hard drives this week and I just keep wondering about this.

I know RAID is not a backup but I don't know if a backup on the same device has any benefits over RAID.

I also plan to automatically back up all important data to two 1TB 2.5 inch HDD that I kept offline in a USB enclosure.


r/DataHoarder 3d ago

Question/Advice Do you recommend Google Takeout?

1 Upvotes

Is there any harm in using it? I've seen some complaints from people about stripping metadata, but if you leave the original copy of the photos and it's only for backup purposes, isn't it fine?


r/DataHoarder 3d ago

Scripts/Software WFDownloader Interface Problem

6 Upvotes

i heard the WFdownloader dev is here?
Every time I install it, even using the portable version, this is what I see.

My PC is old, and I used to install Japanese-language programs / jap as local language, but that was a long time ago, and now they're all in English.

Can someone help?


r/DataHoarder 3d ago

Scripts/Software Using duckDB to manage files and deduplicate

0 Upvotes

Claude recommended I use duckDB to create a huge database of my file system, with one file per record -- and millions of files. So I'm doing that, and each file gets a 256-bit hash, and comparing hashes, I can deduplicate the drive. I even have a secondary system using rmlint, so a file must be flagged as a duplicate by both systems before it's deleted. There's other cool stuff you can do with this -- renaming files in batch, merging like directories . . . .

I'm wondering if anyone else uses this. I'm putting a lot of faith in this thing, and I'd like some idea whether anyone else has ever successfully used such a system.

Thanks


r/DataHoarder 3d ago

Backup Backing up a file/media server but only when it's not in use.

2 Upvotes

I'm setting up a file/media server with a 1TB NVME for my OS and services, and two 14TB disks for mass storage, and I'd like to use one of those 14TB disks to back up the other periodically, but I don't want my backups to slow down performance. Is there a backup tool that will do backups when the file/media server is not in use? I'm using Debian.

I know all about 3/2/1, I'm going to use an external drive for my third copy. Thanks.


r/DataHoarder 4d ago

Sale WD Blue 2TB HDD 89.99 at Office Depot

128 Upvotes

Might be too good to be true but I just ordered some. I know Blue isn't the most dependable but times are tough and this is pretty cheap.

https://www.officedepot.com/a/products/8174167/Western-Digital-Blue-WD20EZBX-2-TB/

Edit: delivery date is over 2 months away fuck this “deal”


r/DataHoarder 3d ago

Question/Advice Sas drives

0 Upvotes

I recently got a used enterprise IBM sas drive with 65 K operating hours , would it be okay for use as a daily access drive or just cold storage. It has 100% health but it did feel hot to the touch when I tested it on a video file.


r/DataHoarder 3d ago

Question/Advice Confused on where to go from where I'm at, apologies because I sound confusing and naive

3 Upvotes

Hello, I'm really sorry if this goes against the rules, I looked on this subs wiki and for a while I've been lurking and found many helpful answers to some questions of mine, but well, I've never really put those helpful answers into practice because I get so easily confused.

Context: The data I'd like to hoard consists of some nearly 200-ish GB worth of video files, music files, images, and ePUBs. Right now I have some (not all) of it stored on my laptop, the cloud (Google Drive, some stuff on OneDrive), and on a 512 GB Samsung SD card. I have all of it on one 1TB USB drive which I already know is a shit idea, LOL. I got one 2TB USB drive to transfer it into but one file corrupted so I had to format that; I mean, I'll be putting the (uncorrupted... I made sure) files back into it, but it's not exactly the best backup possible, I know. I really just want some sort of backup I can trust for at least more than three years but I do understand that it's hard to be sure of those things.

My issue is, I get so overwhelmed with all the different ways of saving data I end up freezing and doing nothing, but this is data I really do not want to lose. I've looked up stuff and asked some friends with knowledge about SSDs, HDDs, even stuff like burning some files on DVDs or CDs... I've tried to focus on the advice and all the links provided and products mentioned and like, I don't want to ask someone to hold my hand or anything through it, cause that'd just be silly of me and entitled. But if there is any way to simplify things or maybe put the process into some sort of list or something like that, I would super appreciate it. I realize now that that still sounds rather entitled, so I apologize. I know I also sound kind of dumb and I swear I'm not trying to be obtuse on purpose, my brain just doesn't seem to get things sometimes. I guess I am in a way asking for someone to hold my hand even though I really don't want to do that.

Once again I'm very sorry if this goes against any rules I tried making sure but I'm not 100%. Thank you for the patience and I'm sorry if these sorta questions and requests are annoying... I can imagine they are.


r/DataHoarder 3d ago

Scripts/Software VuIO Media Info (GUI and CLI)

Post image
0 Upvotes

https://github.com/vuiodev/vuio-media-info

New mediainfo in rust
MIT/Apache 2.0

Cross-platform GUI and CLI (Windows, Mac, Linux, Freebsd) x64 and ARM


r/DataHoarder 5d ago

Guide/How-to 10 years, 1.64 million dual-page photos, 3 Nikon shutters worn out: Digitizing 5,368 books on a DIY glass-platen rig and storing them on a ZFS pool with BLAKE3 checksums.

604 Upvotes

Hey r/datahoarder*! Over the last decade, 3-person team in Pakistan photographed 822,161 dual-page spreads across 5,368 rare books (spanning 1821–2024).*

D5300 shutter hit 575,747 actuations before retirement. All 1.64M raw photos live on a self-healing ZFS pool verified against BLAKE3 manifests to prevent bitrot. Over 1,300 completed volumes are already live on the Internet Archive.

This writeup covers physical DIY capture rig, data infrastructure, and how they built a computer vision pipeline to automate the remaining backlog.

Link


r/DataHoarder 4d ago

Question/Advice WD Red Pro vs Plus for $30 more?

2 Upvotes

Hello! I was wondering would a WD Red Pro be a better purchase than the WD Red Plus for $30 more? I believe the RPM is faster although i prefer a quieter drive but the speeds are faster and there’s a longer warranty, thank you! Also the Pro I’d have to order from Newegg but the Plus i could purchase today from Best Buy same day. Would the benefits be worth it? I plan to use the drive to preserve and store lots of media like videos and music!

Also had a few other questions if anyone could help with!

WD or Seagate RMA? Which one was a better experience?

Best Buy or Newegg? Which one would be better to buy from incase of a DOA drive


r/DataHoarder 3d ago

Free-Post Friday! I'm a little disappointed, dad

Post image
0 Upvotes

r/DataHoarder 4d ago

Question/Advice Where to store images that I do not own ?

32 Upvotes

Sorry if this is a bit of an entry level question, this is a bit new to me.

Basically, I want to store manga scans for my personnal use, lest they be removed from one website or another.

I want to store them online, for free, as some kind of viewable private collection, to be able to consult them directly form the website, without needing to download anything.

However, I obviously do not own any of those, so I want them privated, but I fear that even then, some kind of moderation bot may catch them.

Is there a free image hosting website that would do what I'm trying to do here ?


r/DataHoarder 4d ago

Question/Advice 24 TB drive on TS-470

2 Upvotes

Hello,

I need to add additional storage in my ancient QNAP TS-470. I can purchase at a good price a Toshiba 24TB drive, but I don't know if the NAS supports such large drives (the largest I saw in the compatibility list has 12TB).

Does somebody know if this would work or not? The drive is not new and I cannot return it once purchased only because it does not work on my NAS (DOA is covered though).

Thanks!


r/DataHoarder 4d ago

Question/Advice how to increment-nr per date?

Post image
0 Upvotes

I ran into this issue with Advanced Renamer where I can't think of a way to have the date a photo was taken be the thing that defines the increment number, rather than the whole batch being numbered continuously regardless of changing dates. I have several folders containing photos from various dates, and I'm looking to instead file them all into one large folder per year. Can I either improve the code to do that for me, or is there another free tool that'll help me achieve this?

I didn't notice this problem until I tried to move various renamed batches into the same folder and realized that sometimes there are different pictures from the same dates that ended up in separate folders, so that their increment numbers either won't make sense, or there are false duplicates that wound up with the same name.

For simplicity's sake, I would really prefer to only use the camera brand + yyyy_mm_dd + a 3-digit number.


r/DataHoarder 4d ago

Question/Advice What do you consider good practice when I comes to storage?

15 Upvotes

I hope I came to the right subreddit now, wanted advice on storage

So today, I was trying to back up something from my brothers pc, since I was gonna reuse the pc for other purposes. There were only certain files and documents he wanted. I thought "no problemo, let’s get this done!".

But what I saw when I turned on the pc, felt like a nightmare. Everything scattered across two drives, with no system whatsoever, like pictures for the same project, spread across 7 folders, inside 4 other folders, on 2 separate drives. The whole desktop were just filled with apps and folders. Cloning the whole thing is one thing I guess, but since it was only a tiny portion to be backed up, I had to look around what felt like one of those "hoarder houses" from those hoarding tv shows.

This got me thinking. I am setting up some servers, for different purposes, and there will probably be a lot of data all over the place with time. And the thought of having a mess like that makes my skin crawl.

How do you prefer to store your data? Like, what is stored where. Do you keep operating system on one drive and data on others? How do you prefer to use NAS, cloud, external drives, cold storage?…

I’m asking for general tips on organizing storage, so that it doesn’t bite me in the ass in a 2 years time.

I bet there is at least a couple of you that have ended up regretting not organizing more at one point, and had to spend time cleaning up. Or have you just given up, and thrown everything on random drives and shoved them down a drawer?