Jacob Tomlinson's profile picture Jacob Tomlinson
Home Blog Talks Newsletter About

Accessing S3 from FUSE

UKRI Cloud Working Group London, UK Talk Abstract

My data lives in an object store, but my tools expect a POSIX file path, what do I do? In the Informatics Lab we have been experimenting with using FUSE filesystems on a distributed compute cluster to provide parallel access to files on AWS S3. We have also created a library called pysssix which provides a slim and intentionally minimal access to S3 for fast data access.