View Attach (4) Info

Add new attachment

Only authorized users are allowed to upload new attachments.

List of attachments

Kind Attachment Name Size Version Date Modified Author Change note
png
 ftp_example.png 28.6 kB 2 05-Dec-2023 05:32 Sandor
png
 new_remote.png 9.7 kB 1 05-Dec-2023 05:32 Ben Spink
png
 s3_example.png 76.7 kB 1 05-Dec-2023 05:32 Ben Spink
png
 sftp_example.png 51.0 kB 2 05-Dec-2023 05:32 Sandor

This page (revision-5) was last changed on 26-Feb-2024 08:57 by Ben Spink

This page was created on 05-Dec-2023 05:32 by Ben Spink

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Difference between version and

At line 20 added 49 lines
CrushFTP supports many different protocols for the VFS that a user can access.
!!FILE://
This is your standard type of folders on your local drives. This could also reference a UNC location on windows if the service is running as a domain user that can access the UNC locations.
!!FTP:// FTPS:// FTPES://
This allows you to use a remote FTP server as the VFS for a user. Some people use an already established IIS FTP server as the back end, but put CrushFTP as the front end giving more controls and protocols.
!!SFTP://
This allows you to use a SFTP server as the back end. OpenSSH on a Linux server is often used as the back end.
!!SMB://
This allows you to connect to a Samba or Windows file server as the backend and provide the credentials. Usually in the format of "smb://domain\user:pass@servername/share/" or "smb://user@domain.com:pass@servername/share/".
!!HTTP:// HTTPS://
This allows you to point to another CrushFTP server and use that as the back end. The HTTP methods used are only valid to another CrushFTP server. It uses specific calls a CrushFTP server expects for file management.
!!WEBDAV:// WEBDAVS://
This allows you to use a standard webdav server as the back end. It makes all the queries about files and dir listings using the webdav XML calls.
!!GDRIVE://
Allows you to use google drive resources with Crush as the front end. Initial setup is not for the faint of heart though. [GDriveSetup]
!!RFILE://
Special VFS method that launches new "shells" impersonating the user logging in. Its not super fast, and has a lot of overhead, but some unique scenarios need this method of impersonation if the SMB:// method doesn't work for them.
!!MEMORY://
Implements a VFS in memory, but if the server is restarted, all the data disappears too. Temporary usage, and frequently just for special cases in Jobs.
!!S3://
Allows you to use a S3 bucket as the backend filesystem. However since S3 isn't hierarchical, you only get simulated folders, and no ability to rename, and some other gotchas about how S3 works. These aren't limitations we impose, but just due to the design decisions S3 made in that its intended for static item consumption and not as a location for holding and manipulating file names.\\
\\
We support the IAM auth scenario too, its just not the default mode. Setting the S3 username to "iam_lookup" and S3 password to "lookup" will use this method.\\
\\
The following policy permissions are needed on S3:\\
{{{
s3:GetBucketLocation
s3:ListAllMyBuckets
s3:ListBucket
s3:ListBucketMultipartUploads
s3:PutObject
s3:AbortMultipartUpload
s3:ListMultipartUploadParts
}}}
!!S3CRUSH://
This still uses an S3 bucket for storage, however we only use S3 as the storage for the object. We hold a special "s3" folder on the CrushFTP server which has the folder structure simulated, and "file" items which are XML pointers to the real S3 data. The difference is its *much* faster than the normal S3 since dir listings are fast, renames are instantaneous, etc. It uses S3 in the way it was designed for. The downside though is that if you make changes to the data in S3 and don't go through CrushFTP, now CrushFTP doesn't know what your data is in S3...you are out of sync, and technically "corrupted". So if you want to use S3 and have a fast and unlimited storage solution, S3Crush is perfect for that if you won't be changing the data from another tool that hits the bucket directly.
Version Date Modified Size Author Changes ... Change note
5 26-Feb-2024 08:57 4.72 kB Ben Spink to previous
4 05-Dec-2023 05:32 4.566 kB Sandor to previous | to last
3 05-Dec-2023 05:32 4.772 kB Halmagyi Arpad to previous | to last
2 05-Dec-2023 05:32 1.278 kB Halmágyi Árpád to previous | to last
1 05-Dec-2023 05:32 1.166 kB Ben Spink to last
« This page (revision-5) was last changed on 26-Feb-2024 08:57 by Ben Spink
G’day (anonymous guest)
CrushFTP11 | What's New

Referenced by
LeftMenu

JSPWiki