5 Matching Annotations
  1. Jan 2022
    1. Copying the file data over https://unix.stackexchange.com/q/30970/50703 # via rsync, file by file progress

      Good rsync command for copying data

  2. Aug 2021
    1. Let’s say I’m the client, and you’re the server. First, I send you a packet, but before I do I write down a timestamp. When you receive that packet, you write down a timestamp. Then, you send me a reply, and before you do you write down a timestamp. Finally, when I receive that reply, I write down a timestamp. It may not seem that groundbreaking, but with just those four timestamps I can compute two important numbers, the offset, and the delay. The offset is how far my clock is off from yours, so if you think it’s 12 pm and I think it’s 12:05 pm then the offset would be five minutes. The delay is how long it took those packets to traverse the network. To compute those numbers you basically take a system of equations, and for me, an important aspect was actually writing down, with a piece of paper and a pencil, and solving these equations myself, was understanding that there’s a sort of huge assumption in this protocol, that the delay for that first packet, where I timestamped then you did, and the delay for the second packet, where you timestamped and then I did, the assumption is that those times are the same and if they’re not the same they introduce what’s called error, and that is a sort of very important aspect. That is an assumption that is made so that you can actually solve those equations to get the offset and the delay.

      Good laymen’s description of NTP algorithm

    1. flipou83 · 24dI have a M1 but all my storage is on a TrueNAS and Unraid server. Doesn't trust external drive storage for the problems you listed on your post. I have a share for it's TimeMachine backups and big Photos library and iMovie Library which don't even fit on the internal SSD of the Mac mini.I would put the SSD you bought into an independent computer that acts as a NAS on your network. What about this solution?

      See this thread on using M1 to remote mount shares from a Linux ZFS TrueNAS server.

    1. 1. Back up data to an external drive, and sign out Apple ID if needed.2. Enable root user. Install OpenZFS.3. Delete user accounts including the home directories. Do not delete the Data APFS volume. 4. Partition disk. Choose a format other than ZFS dataset.5. Disable System Integrity Protection to allow mounting on /Users.6. Log in to root user.7. Create zpool on the new partition. I set the compression property to on.8. Create ZFS file system for /Users with mountpoint property set to /Users. You may create descendent file systems for each users.9. Verify the file systems are mounted after boot with root user.10. Add user accounts.11. Log in to user accounts and check if the home directory is a ZFS file system.12. Restore backed up data.

      Some good instructions on setting up an existing Mac for ZFS.

    1. Random Access Read-Only Tar Mount (Ratarmount)

      Investigate using this for mounting large TAR files

      Seriously, check out ratarmount if you haven't. Since the Google Takeout spans multiple 50GB tgz files (I'm at ~14, not including Google Drive in the takeout), ratarmount is brilliant. It merges all of the tgz contents into a single folder structure so /path/a/1.jpg and /path/a/1.json might be in different tgz folders but are mounted in to the same folder.