Storage Management

Contributors

Authors: Nate Coraor Martin Čech Helena Rasche

Questions

• How does Galaxy locate data?

• How can I have Galaxy use multiple storage locations?

Objectives

• Setup Galaxy with both the Hierarachical and Distributed Object Storages

Object Store Plugins

Direct:

• Disk
• Amazon S3/OpenStack Swift
• Experimental
  • Azure
  • CloudBridge → S3, Swift, Azure, GCE

Object Storage Strategies

.pull-left[ Hierarchical

• Choose between options based on priority
• Always uses first (unless max_pct_full + too full)

]

.pull-right[ Distributed

• Randomly choose between several storage options
• Can fill up at same rate, or different (weighting) ]

Key Points

• The distributed object store configuration allows you to easily expand that storage that is attached to your Galaxy.
• You can move data around without affecting users.

Thank you!