[Support] Rclone (beta)


Recommended Posts

  • 3 weeks later...

Alright, migrated here from https://forums.lime-technology.com/topic/56921-support-rclone-mount-with-exposable-fuse-support-for-plex-beta/

 

Here is the error I am getting:

https://forums.lime-technology.com/topic/56921-support-rclone-mount-with-exposable-fuse-support-for-plex-beta/

 

[cont-init.d] executing container initialization scripts...
[cont-init.d] 10-adduser: executing...

GID/UID
-------------------------------------
User uid:    911
User gid:    911
-------------------------------------

[cont-init.d] 10-adduser: exited 0.
[cont-init.d] 40-config: executing...
crontab => * * * * * /app/rclone.sh
[cont-init.d] 40-config: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
Executing => rclone sync /data backblaze:/''
2017/06/13 16:14:00 ERROR : Attempt 1/3 failed with 1 errors and: failed to create bucket: bucketName is required (400 bad_json)
2017/06/13 16:14:01 ERROR : Attempt 2/3 failed with 1 errors and: failed to create bucket: bucketName is required (400 bad_json)
2017/06/13 16:14:01 ERROR : Attempt 3/3 failed with 1 errors and: failed to create bucket: bucketName is required (400 bad_json)
2017/06/13 16:14:01 Failed to sync: failed to create bucket: bucketName is required (400 bad_json)

My docker run:

docker run -d 
  --name="rclone" 
  --net="bridge" 
  -e TZ="America/Chicago" 
  -e HOST_OS="unRAID" 
  -e "SYNC_DESTINATION"="backblaze"
  -e "CRON_SCHEDULE"="* * * * *"
  -v "/mnt/user/docker/rclone/":"/config":rw 
  -v "/mnt/user/NAS/Backups/ubnt/":"/data":ro 
  tynor88/rclone:dev

 

My rclone config:

[backblaze]
type = b2
account = [redacted]
key = [redacted]
endpoint =

 

Link to comment
1 hour ago, ryanborstelmann said:

Alright, migrated here from https://forums.lime-technology.com/topic/56921-support-rclone-mount-with-exposable-fuse-support-for-plex-beta/

 

Here is the error I am getting:

https://forums.lime-technology.com/topic/56921-support-rclone-mount-with-exposable-fuse-support-for-plex-beta/

 


[cont-init.d] executing container initialization scripts...
[cont-init.d] 10-adduser: executing...

GID/UID
-------------------------------------
User uid:    911
User gid:    911
-------------------------------------

[cont-init.d] 10-adduser: exited 0.
[cont-init.d] 40-config: executing...
crontab => * * * * * /app/rclone.sh
[cont-init.d] 40-config: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
Executing => rclone sync /data backblaze:/''
2017/06/13 16:14:00 ERROR : Attempt 1/3 failed with 1 errors and: failed to create bucket: bucketName is required (400 bad_json)
2017/06/13 16:14:01 ERROR : Attempt 2/3 failed with 1 errors and: failed to create bucket: bucketName is required (400 bad_json)
2017/06/13 16:14:01 ERROR : Attempt 3/3 failed with 1 errors and: failed to create bucket: bucketName is required (400 bad_json)
2017/06/13 16:14:01 Failed to sync: failed to create bucket: bucketName is required (400 bad_json)

My docker run:


docker run -d 
  --name="rclone" 
  --net="bridge" 
  -e TZ="America/Chicago" 
  -e HOST_OS="unRAID" 
  -e "SYNC_DESTINATION"="backblaze"
  -e "CRON_SCHEDULE"="* * * * *"
  -v "/mnt/user/docker/rclone/":"/config":rw 
  -v "/mnt/user/NAS/Backups/ubnt/":"/data":ro 
  tynor88/rclone:dev

 

My rclone config:


[backblaze]
type = b2
account = [redacted]
key = [redacted]
endpoint =

 

 

This is rclone specific. See this forum post for more instructions: https://forum.rclone.org/t/why-cant-i-sync-to-b2-encrypted/2172

 

apperantly you need to specify a valid bucketname

Link to comment
9 minutes ago, thomast_88 said:

 

This is rclone specific. See this forum post for more instructions: https://forum.rclone.org/t/why-cant-i-sync-to-b2-encrypted/2172

 

apperantly you need to specify a valid bucketname

How can I add the bucketname in there? Looks like rclone wants the following:

rclone sync /home/local/directory remote:bucket

 

But in the container, the /app/rclone.sh script runs this:

rclone sync /data $SYNC_DESTINATION:/'$SYNC_DESTINATION_SUBPATH'

 

I changed the command manually in the container to include the bucket and it works. My worry is that if the docker gets updated, this will get wiped. 

rclone sync /data $SYNC_DESTINATION:mybucket/

 

Thanks!

 

Link to comment
3 minutes ago, ryanborstelmann said:

How can I add the bucketname in there? Looks like rclone wants the following:


rclone sync /home/local/directory remote:bucket

 

But in the container, the /app/rclone.sh script runs this:


rclone sync /data $SYNC_DESTINATION:/'$SYNC_DESTINATION_SUBPATH'

 

I changed the command manually in the container to include the bucket and it works. My worry is that if the docker gets updated, this will get wiped. 


rclone sync /data $SYNC_DESTINATION:mybucket/

 

Thanks!

 

Use the environement variable SYNC_COMMAND from Advanced Settings.

 

  • -e SYNC_COMMAND A custom rclone command which will override the default value of: rclone sync /data $SYNC_DESTINATION:/$SYNC_DESTINATION_SUBPATH
Link to comment
  • 3 weeks later...
  • 2 months later...

Im getting this when I try to update rclone
 

plugin: updating: rclone.plg
plugin: downloading: http://beta.rclone.org/rclone-beta-latest-linux-amd64.zip ... done

+==============================================================================
| Skipping package rclone-2016.11.19-bundle (already installed)
+==============================================================================


Archive: /boot/config/plugins/rclone-beta/install/rclone-beta-latest.zip
creating: /boot/config/plugins/rclone-beta/install/rclone-v1.37-157-g5a3a56ab#U03b2-linux-amd64/
inflating: /boot/config/plugins/rclone-beta/install/rclone-v1.37-157-g5a3a56ab#U03b2-linux-amd64/rclone 
inflating: /boot/config/plugins/rclone-beta/install/rclone-v1.37-157-g5a3a56ab#U03b2-linux-amd64/README.txt 
inflating: /boot/config/plugins/rclone-beta/install/rclone-v1.37-157-g5a3a56ab#U03b2-linux-amd64/README.html 
inflating: /boot/config/plugins/rclone-beta/install/rclone-v1.37-157-g5a3a56ab#U03b2-linux-amd64/rclone.1 
inflating: /boot/config/plugins/rclone-beta/install/rclone-v1.37-157-g5a3a56ab#U03b2-linux-amd64/git-log.txt 
Copy failed - rclone running
plugin: run failed: /bin/bash retval: 1

 

How can I stop rclone and update?

Edited by GilbN
  • Like 1
Link to comment
  • 3 weeks later...
On 10/14/2017 at 10:40 AM, Oxy said:

hello,

I encountered some bugs with Onedrive that are supposed to be fixed in latest rclone version. Could you please build a new version of you docker image ?

thank you.

Hi there,

 

You can actually just pass this environment variable to the container:

"RCLONE_VERSION="<version>"

(default is "current") and it will download the specified version for you.

 

I've kickstarted a build aswell though.

 

See Docker file: https://github.com/tynor88/docker-rclone/blob/dev/Dockerfile

Link to comment

Hi,

I am far from being an expert on docker matter :)

So how am i supposed to pass that version parameter ? I saw it in the docker file however i thought it was being used when building the docker image. What you said make me think it would somehow be possible to choose the RCLONE version when creating the container ? So I tried to add the environment variable when creating the container and the system is not complaining even when I put something stupid in the variable (dummy for example)

 

Currently  when creating a container from the main branch i am getting a rclone 1.35 whereas when creating the container from the dev branch I am getting the 1.38 

 

Thank you for the build.

 

Link to comment
  • 2 weeks later...
  • 4 months later...
  • 5 months later...
14 hours ago, MindRazorblade said:

Is this docker functional for anyone still? It's not looking for the config file where the template assigns (in appdata). I've played around with a workaround but nothing worthwhile.

I  don't think so - the plugin version works very well

Link to comment
On 8/25/2018 at 12:02 AM, MindRazorblade said:

Is this docker functional for anyone still? It's not looking for the config file where the template assigns (in appdata). I've played around with a workaround but nothing worthwhile.

 

I'm using it just fine. What do you mean? The config is in /config/.rclone.conf

Link to comment
  • 1 month later...

I don't have a lot to add other than to say thanks @Waseh for creating the original rclone plugin.  It works perfectly.

 

Just finished connecting to my AWS S3 buckets and doing a couple of quick tests.  Does exactly what it says on the tin.

 

Here's how I'm using this (nothing to do with Docker, though):

 

- Raspberry Pi with HD camera attached

- Camera takes a pic every 'n' seconds and saves it to unRAID via NFS share (using a Python script I wrote that runs as a service on the Raspberry Pi)

- rclone runs periodically and syncs all camera images from unRAID to AWS S3 bucket with a replica to a DigitalOcean "Spaces" bucket (S3-compatible).

- Next step is write a quick front-end for the images that are on AWS so I can view them from anywhere (I'm sure an existing one exists but I like writing my own for this sort of stuff)

 

Command to do the sync after setting up the remote is very simple:

 

rclone copy <path> <remote_name>:<s3_bucket_name>

 

Very useful.  :)

 

Edited by digitalformula
Link to comment
3 hours ago, digitalformula said:

 

- Next step is write a quick front-end for the images that are on AWS so I can view them from anywhere (I'm sure an existing one exists but I like writing my own for this sort of stuff)

 

 

rclone mount <remote_name>:<s3_bucket_name> <mount_path>

for <mount_path> use something like /mnt/user/picture_archive.

 

There are lots of other options for mount, but that'll do the job

 

https://rclone.org/commands/rclone_mount/

Link to comment
2 hours ago, DZMM said:

rclone mount <remote_name>:<s3_bucket_name> <mount_path>

for <mount_path> use something like /mnt/user/picture_archive.

 

There are lots of other options for mount, but that'll do the job

 

https://rclone.org/commands/rclone_mount/

 

Hmm sorry I'm not sure what you mean.  If I'm going to run a front end somewhere, why would I need rclone to mount the S3 bucket?  I'm sure I missed something.  :)

Link to comment
4 minutes ago, DZMM said:

oh sorry, you want to be able to view the S3 files.

 

Found this on google - https://aws.amazon.com/es/customerapps/s3fm-a-free-online-file-manager-for-amazon-s3/?nc1=f_ls

Ah yep.  That's correct.

 

I've run into a bigger issue, though ... even at 720x480 it's 622MB per hour (changed the delay between captures to 1s).  Adding 14.5GB per day would be not only expensive but death for my Internet connection.  :)

Link to comment
On 10/15/2017 at 12:39 PM, thomast_88 said:

Hi there,

 

You can actually just pass this environment variable to the container:


"RCLONE_VERSION="<version>"

(default is "current") and it will download the specified version for you.

 

I've kickstarted a build aswell though.

 

See Docker file: https://github.com/tynor88/docker-rclone/blob/dev/Dockerfile

It looks like there is an extra variable in your code.

 

https://downloads.rclone.org/v${RCLONE_VERSION}/rclone-v${RCLONE_VERSION}-linux-${PLATFORM_ARCH}.zip

 

Where the actual url should be. https://downloads.rclone.org/rclone-current-linux-amd64.zip

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.