User Tools

Site Tools


using_rclone

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
using_rclone [2022/02/14 20:07] – created deadlineusing_rclone [2022/02/15 20:02] (current) – [More Information about rclone] deadline
Line 7: Line 7:
 The following steps must also be performed using a terminal window on one of the DSL Lab workstations. Once configured, however, the ''rclone'' commands can be run within Notebooks like Zeppelin. The following steps must also be performed using a terminal window on one of the DSL Lab workstations. Once configured, however, the ''rclone'' commands can be run within Notebooks like Zeppelin.
  
-Open text window under your account and enter ''rclone'' config. The follwing will guide the Google Drive configuration.+Open text window under your account and enter ''rclone'' config. The following will guide the Google Drive configuration.
  
 <code> <code>
-rclone config+rclone config
 2022/02/14 13:32:45 NOTICE: Config file "/home/USER/.config/rclone/rclone.conf" not found - using defaults 2022/02/14 13:32:45 NOTICE: Config file "/home/USER/.config/rclone/rclone.conf" not found - using defaults
 No remotes found - make a new one No remotes found - make a new one
Line 20: Line 20:
 </code> </code>
  
-Enter **''n''** for new and the **''name''** of your "remote" drive (in this case ''mygdrive''+Enter **''n''** for new and the **''name''** of your "remote" drive (in this case ''mygdrive''
 Also ''USER'' will be your account name. Also ''USER'' will be your account name.
  
Line 189: Line 189:
 Enter **''N''** for "No auto config" Enter **''N''** for "No auto config"
  
-link will be provided, enter this in a browser on your workstation. It will ask you to authenticate your Google account and provide a verification code. +long URL will be provided, enter this in a browser on the workstation. It will ask you to authenticate your Google account and provide a verification code. 
  
 <code> <code>
Line 196: Line 196:
 </code> </code>
  
-Copy the verification code from the web browser and past it in this dialog+Copy the verification code from the web browser and past it into this dialog
  
 <code> <code>
Line 244: Line 244:
 If the configuration was successful ''rclone'' should be able to "see" your remote drive. If the configuration was successful ''rclone'' should be able to "see" your remote drive.
  
-**  
  
-rclone lsd mygdrive: +===== Example Commands===== 
- 1029  rclone lsd mygdrive:YARN Book + 
- 1030  rclone lsd mygdrive:"YARN Book" +** List top level directories in my Google Drive ** 
- 1031  rclone lsd mygdrive: + 
- 1033  rclone copy bank.csv mygdrive:data +  rclone lsd mygdrive: 
- 1034  rclone lsd mygdrive:data +   -1 2017-01-16 12:33:25        -1 Data Science book 
- 1035  rclone ls mygdrive:data +   -1 2021-09-07 13:39:13        -1 Logicmoo_Devel 
- 1036  rclone ls +   -1 2022-02-14 13:55:03        -1 data 
- 1037  rclone ls -h + 
- 1038  rclone lsf mygdrive:data +** List files in the ''data'' directory** 
- 1039  rclone lsl mygdrive:data + 
- 1042  rclone copy mygdrive:data:bank.csv . +  rclone ls mygdrive:data 
- 1043  rclone copy -h +     461474 bank.csv 
- 1044  rclone copy mygdrive:data/bank.csv .+    
 +** Long list the files in the ''data'' directory** 
 + 
 +  rclone lsl mygdrive:data 
 +     461474 2019-09-05 11:52:36.000000000 bank.csv 
 +  
 +** Copy the file (''bank.csv'') from Google Drive data directly to the local directory on the cluster** 
 + 
 +  rclone copy mygdrive:data/bank.csv 
 + 
 +** Create a copy (''bank2.csv'') and copy it to the Google Drive, list files in ''data'' directory** 
 +  cp bank.csv bank2.csv  
 +  rclone copy bank2.csv mygdrive:data 
 +  rclone ls mygdrive:data 
 +     461474 bank2.csv 
 +     461474 bank.csv 
 +      
 +**Delete a file (''bank2.csv'') in the ''data'' directory on the Google Drive (list the files before and after)** 
 +  rclone ls mygdrive:data 
 +     461474 bank2.csv 
 +     461474 bank.csv 
 +  rclone delete  mygdrive:data/bank2.csv  
 +  rclone ls mygdrive:data 
 +     461474 bank.csv 
 + 
 +=====More Information about rclone===== 
 + 
 +There are other command options and features of ''rclone'' available. The examples shown here are for basic file transfer. See the [[https://rclone.org/| rclone page]] for more information 
  
using_rclone.1644869255.txt.gz · Last modified: 2022/02/14 20:07 by deadline

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki