rsync

Why has rsync created many hidden files that duplicate my real file names?

Why has rsync created many hidden files that duplicate my real file names? I have a directory that I periodically rsync to via rsync -rva. Today I found out that for many files that I have, eg path/to/S00041.jpg, I also have an empty file with the name path/to/._S00041.jpg at the rsync destination. I imagine they …

Total answers: 1

How to submit the folder contents by Rsync with SSL keys protected by the passphrase?

How to submit the folder contents by Rsync with SSL keys protected by the passphrase? After has been recommended to stop to use Git for deploying to VPS, I have returned to Rsync method. Unfortunatly Rsync is very unfrendly, emits the unclear errors and sometime the error message does not matching with what actually wrong. …

Total answers: 1

Can you tell me why rsync is saying my files are different

Can you tell me why rsync is saying my files are different I’m using rsync to sync files from my NAS to a Remote Server. The files on the Remote Server appear to have the same user, group and permissions as the source. However rsync wants to copy the files anyhow. Here is the output …

Total answers: 1

rsync: need help resolving a "nomenclature" question

rsync: need help resolving a "nomenclature" question I’ve used rsync for a while, and it’s always performed very well. However, trying to rsync my macOS (source, APFS file system) with my Synology NAS (dest, btrfs filesystem) seems to always present "challenges" that I don’t find in other uses of rsync. Some of my "challenges" are …

Total answers: 1

The proper way to backup

The proper way to backup I want do regular, automated backups to a raspberry pi in my homenetwork. It is sufficient to do backups, when at home. Every singe guide I read on ‘how to do automated backups’ tells me to put a passwordless ssh-key on my pi. I don’t want to do this, because …

Total answers: 3

Rsync throwing errors but files appear to be fine

Rsync throwing errors but files appear to be fine I am doing a massive 200TB transfer with rsync. I used a shell script I found off the internet to spawn a few processes but here is the relevant rsync command itself: rsync –recursive –whole-file –inplace –sparse –no-compress –max-alloc=8GiB –size-only –human-readable –info=progress2 –log-file="$rsync_file_basename.log" –log-file-format="%o=%-7”’b | total=%-7”’l …

Total answers: 1

Cannot find out which files were not copied with rsync

Cannot find out which files were not copied with rsync I copied files using rsync with: rsync -trvh "/media/user/HDD/Arch/" "/media/user/my_drv/Arch/" && rsync -trvhc "/media/user/HDD/Arch/" "/media/user/my_drv/Arch/" After rsync completed its run, the last lines of output were: sent 218.26G bytes received 1.37M bytes 5.48M bytes/sec total size is 218.20G speedup is 1.00 rsync error: some files/attrs …

Total answers: 1

create bootable Image from Rsync System Backup

create bootable Image from Rsync System Backup i’ve copied a Linux System Rootfolder (/) using Rsync to a local Folder. (Excluding 500GB Data) Is it possible to create a Bootable System Image that boots in Virt-manager? Rsync Command: Rsync -aAXv Rsync excluding /dev/* /proc/* /sys/* /tmp/* /usr/tmp/* /run/* /mnt/* /media/* /var/cache/* /lost+found /var/www/ /root/ Asked …

Total answers: 1

How to hide rsync output for existing and synced files?

How to hide rsync output for existing and synced files? I have the output: sent 66 bytes received 12 bytes 156.00 bytes/sec total size is 204 speedup is 2.62 sending incremental file list sent 67 bytes received 12 bytes 158.00 bytes/sec total size is 204 speedup is 2.58 sending incremental file list sent 66 bytes …

Total answers: 1

Does the rsync –archive option override the –exclude option?

Does the rsync –archive option override the –exclude option? I am running an rsync -avz command which excludes a large 32GB file by using –exclude=/file/path and no matter what I do rsync transfers the file. I understand that logically the –archive option means mirror everything, but the examination of the -rlptgoD options the –archive option …

Total answers: 1

rsync not copying files when using –include flag

rsync not copying files when using –include flag I have the following files: 1/2/abc.txt 1/2/def.txt 1/1/abc.txt 2/1/abc.txt 2/2/def.txt 3/1/hij.txt I’d like to copy all abc.txt files and preserve the directory tree. I tried the following command: rsync -R -P -a -m –include=’*/*/abc.txt’ remote@server:/target/directory but this doesn’t copy any files. Any ideas? Would be much appreciated. …

Total answers: 1

rsync –recursive –ignore-existing: what (if any) additional flags are needed to resume/repair/overwrite any partially copied files?

rsync –recursive –ignore-existing: what (if any) additional flags are needed to resume/repair/overwrite any partially copied files? Assume an rsync –recursive –ignore-existing foo bar copy command was being run for a large directory tree named foo, but that that command got prematurely interrupted. For example, because of a sudden power failure on the target machine. Running …

Total answers: 1

rsync –dry-run paged output – how to achieve?

rsync –dry-run paged output – how to achieve? I am syncing two large folders from local pc to remote server and the output from the –dry-run is several pages long, too long for terminal reading. What is the syntax to add the directive >>foo to: sudo /usr/bin/rsync -avx –delete –append-verify [source] [destination] This will enable …

Total answers: 2

How do you synchronize files with partially failed download using rsync?

How do you synchronize files with partially failed download using rsync? I’m trying to synchronize literally thousands of files of various sizes and I would like to have a 1:1 copy of the files. That means that already present files should be checked for their integrity and if there’s a wrong checksum, the file needs …

Total answers: 1

rsync files-from and directory structure

rsync files-from and directory structure I have been copying some files and folders by building an rsync command manually using a string list in the shell. For remote file structure like: /home/foo/ media/ bigfile.bin somedir/ a.txt b.json I would write: rsync -Pavz my_remote:/home/foo/{media/bigfile.bin,somedir} . The resulting local file structure is ./bigfile.bin ./somedir/ a.txt b.json The …

Total answers: 1

Rsync doesn't handle time correctly on a mounted folder on MacOS

Rsync doesn't handle time correctly on a mounted folder on MacOS I have a mounted a folder from my NAS with mount -t smbfs -o -d=755,-f=755 //nas.local/backup ~/backup. I now try to rsync a local folder to this distant folder with something like rsync –modify-window=30 -irvt –info=progress2 –delete-after test-dir ~/backup. I’ve tried a lot of …

Total answers: 1

rsync – does it run read/read/compare before attempting to write (locally)?

rsync – does it run read/read/compare before attempting to write (locally)? My understanding of rsync (and it might be completely wrong) is that it would first try to read the files (source and destination if it exists) to compare them before attempting to write something on the destination (which I would expect to be slower …

Total answers: 1

Dolphin context menu exec command, cp will duplicate selected folder if already copied

Dolphin context menu exec command, cp will duplicate selected folder if already copied So I’m trying to automate some tasks and I’m making some dolphin ServiceMenus. Exec=for file in %f; do new_path=$(echo "$file" | sed "s|^/home/$(whoami)||"); mkdir -p ~/Dropbox/.Home"$(dirname "$new_path")" && cp -pur "$file" ~/Dropbox/.Home"$new_path"; done The above line will work perfectly fine for what …

Total answers: 1