I'm looking for a MacOS X GUI AWS S3 client to handle listing of very large number of files and downloading some files from it.
S3 Browser is a Mac OS X administration tool for the Amazon S3 data storage service. My goal is to build a small application useful in itself for developers or users subscribed to the S3 service, but also to provide example code showing how to access S3 through the REST API in a OS X Objective-C. S3 Browser is a simple and lightweight Amazon S3 client software for Windows that you can use. It is a dedicated software that works in a very straightforward manner. It simply lets you connect to your S3 bucket and lists all the files from it.
Context
I work in a company where we have a cloud-based product that store files on S3. Our buckets have millions of files now. Sometimes I need to be able to list those buckets and to pick some files to help me debug our application. Since the list is very long I would like to filter it to browse it more easily with a MacOS X GUI application. I would like to be able to download some files, and since the buckets are protected, it needs the HTTP header AWS signature. Ideally the client would treat the bucket as read-only, to prevent from making mistakes.
Problem
I've searched on the internet for MacOS X clients with such features, but they all try to make some kind of hierarchical file system analogy which does not really stick with S3 API. In their analogy they have the concept of folders where the delimiter is /. If a 'folder' contains a lot of keys, then browsing it will either needs to list all the keys, or some clients will list more keys as you scroll down.
For example I might have millions of keys which start with data/ but only a few which start with data/555 (note that the string does not end with a / character, the whole problem relies here)
Solution
I'm considering writing a GUI client for MacOS X (and maybe Windows) that uses the prefix and delimiter query parameters of the S3 GET bucket listing :
Typically in the previous example, I would put the prefix as data/555
I want to know if I've overlooked a S3 GUI client which would have such features.
Features
- GUI client for MacOS X (ie not a command line : I need non-tech coworkers to be able to use it)
- List bucket with arbitrary
prefixanddelimiterquery parameters filter - Be able to select files from filtered list and download them
- S3 Authorization (clients managing only one S3 account are welcome)
- Ideally a read-only client (would not contain code which could modify the bucket)
Mac Client For Lync
Thanks in advance for any info on that matter,
S3 Gui
Raphael