Objective
Establish a connection and configure your Spinup S3 bucket.
Introduction
Spinup offers a service around Amazon Simple Storage Service (S3) for university researchers. With Spinup, an S3 bucket in AWS is provided, accompanied by an access key granting full permissions. There are two primary methods for connecting: the AWS Command Line Interface (CLI) and the graphical user interface (GUI) via Cyberduck.
Remember to always handle access keys and secret keys with care, ensuring they remain confidential to prevent unauthorized access. |
Navigate to Spinup and either create a new S3 bucket or open an existing one.
In the ‘Users’ Panel, click on the “+” icon to add a new bucket user.
Edit the name of the user (if desired), then press the “Save” icon to the right to save the newly created user.
Proceed to the “Access Keys” section and select “Create Key”. This will generate a public key (which is always retrievable from your Spinup bucket) and a one-time visible private key. Ensure you note down the private key immediately as it won't be displayed again. Both keys are essential for connecting to your S3 Bucket.
If you have lost access to your private key, select “Reset Key” from the Access Keys section, and a new key pair will be generated. |
Download Cyberduck from Cyberduck's Official Website.
Access Spinup and open the desired S3 bucket.
Click on the “Connect (Cyberduck)” button located at the top. This action will download a Cyberduck configuration file.
Once downloaded, double-click on the configuration file to open it with Cyberduck.
Follow the prompted steps and input your access key pair to establish a connection with the S3 bucket.
To bookmark your configuration in Cyberduck, simply drag and drop the config file into Cyberduck (while you are not connected to an instance). |
Initiate Cyberduck and select the gear icon. From the dropdown, opt for 'New Bookmark'.
From the provided options, choose "Amazon S3".
Click "More Options". Here, specify your S3 bucket's path in the "Path" field. Make sure to also input your Secret Access Key and Access Key ID obtained from Spinup.
In the "Path" section of Cyberduck, prefix your bucket name with a slash (/).
Save your settings by closing the dialog. You can now connect via your bookmark by double clicking the instance, and connecting via your access key pair.
Uploading: To upload a file or folder to your S3 Bucket, simply drag and drop it from your computer's directory directly into the Cyberduck interface. You can also create folders within Cyberduck to keep your content organized. You can upload any file type—images, backups, data, movies, and so on—into an S3 bucket.
Downloading: To retrieve a file, you can either drag it from Cyberduck to a preferred location on your computer or right-click the desired file and choose the “Download” option.
Deleting: To remove a file from your bucket, right-click on the item and choose the “Delete” option. Always exercise caution when deleting: by default, buckets are unversioned, meaning deletions are irreversible. For a deeper understanding of S3 versioning, please refer to How do I enable versioning for an S3 bucket?.
Managing files in an S3 Glacier Archive bucket comes with more restrictions and costs. For more information, please review How do I manage files in a S3 Deep Archive Bucket . |
Connecting to S3 via AWS CLI:
Installation:
Download and install the AWS CLI from AWS CLI Installation Guide.
Configuration:
From your terminal or command line, input:
$ aws configure --profile <BUCKET-NAME> |
Replace <BUCKET-NAME> with your actual bucket name found in the "Storage details" panel, e.g., spinup000123-mybucket.
Input the requested details, which include key, secret, region, and desired output format.
Commands:
Use the AWS CLI for various tasks like copying, listing, deleting, or syncing files. Always remember to specify your profile name using the --profile option.
Examples for a bucket named spinup000123-mybucket:
Upload a file:
$ aws s3 --profile spinup000123-mybucket cp test.png s3://spinup000123-mybucket |
This command uploads a file named test.png from your local directory to the specified S3 bucket.
List all files in the bucket:
$ aws s3 --profile spinup000123-mybucket ls s3://spinup000123-mybucket |
Displays a list of all files and directories within the specified S3 bucket.
View size of all objects:
$ aws s3 --profile spinup000123-mybucket ls --summarize --human-readable --recursive s3://spinup000123-mybucket |
Provides a detailed summary of all objects in the bucket, including their sizes in a human-readable format.
Delete a file:
$ aws s3 --profile spinup000123-mybucket rm s3://spinup000123-mybucket/test.png |
Removes the specified file (test.png in this case) from the S3 bucket. Exercise caution when deleting files, especially if backups are not in place.
For a comprehensive list of command options and detailed explanations, input aws s3 help.