storage-and-databases
Storage Types on AWS

Storage Types on AWS

AWS storage services are grouped into three different categories: block storage, file storage, and object storage.

FILE STORAGE

You may be familiar with file storage if you’re interacted with file storage systems like Windows File Explorer or Finder on MacOS. You place your files in a tree-like hierarchy that consists of folders and subfolders. For example, if you have hundreds of cat photos on your laptop, you may want to create a folder called Cat photos, and place those images that folder to organize them. Since you know these images will be used in an application, you may want to place the cat photos folder inside another folder called Application files.

k_RYerm_Rj6QsokMmSPCqQ_6afe8907758a4b6c8ab0e25c09b4e6f1_image.png

Each file has metadata such as file name, file size, and the date file was created. The file has also has a path, for example, computer/Application_file/Cat_photos/cats-03.png. When you need to retrieve a file, your system can use the path to find it in the file hierarchy.

File storage is ideal when you require centralized access to files that need to be easily shared and managed by multiple host computers. Typically, this storage is mounted onto multiple hosts and requires file locking and integration with existing file system communication protocols. Common use cases for file storage include:

  • Large content repositories
  • Development environments
  • User home directories

BLOCK STORAGE

While file storage treats files as a singular unit, block storage splits files into fixed-size chunks of data called blocks that have their own addresses. Since each block is addressable, blocks can be retrieved efficiently.

When data is requested, these addresses are used by the storage system to organized the blocks in the correct order to form a complete file to present back to the requestor. Outside of the address, there is no additional metadata associated with each block. So, when you want to change a character in a file, you just change the block, or the piece of the file, that contains the character. This ease of access is why block storage solutions are fast and use less bandwidth.

GehxGoTAQ96qJzseXCRFCg_127885f29fc24885b4d4eaf6c48bfdf1_image.png

Since the block is optimized for low-latency operations, it is a typical storage choice for high-performance enterprise workloads, such as databases or enterprise resource planning (ERP) systems, that require low-latency storage.

OBJECT STORAGE

Objects, much like files, are also treated as a single unit of data when stored. however, unlike file storage, these objects are stored in a flat structure instead of a hierarchy. Each object is a file with a unique identifier. This identifier, along with any additional metadata, is bundled with the data and stored.

Changing just one character in an object is more difficult than with block storage. When you want to change one character in a file, the entire file must be updated.

0K51zw-HQPuM8Go6dtyF4A_ba5cb6c839bd4cdaa27345709a5025f1_image.png

With object storage, you can store almost any type of data, and there is no limit to the number of objects stored, making it easy to scale. Object storage is generally useful when storing large data sets, unstructured files like media assets, and static assets, such as photos.

RELATED BACK to TRADITIONAL STORAGE SYSTEMS

If you’ve worked with storage on-premises, you may already be familiar with block ,file, and object storage. Consider the following technologies and how they relate to the systems you may have bene before.

  • Block storage in the cloud is analogous to direct-attached storage (DAS) or a storage area network (SAN).
  • File storage systems are often supported with a network attached storage (NAS) server.

Adding more storage in a traditional data center environment is a more rigid process, as you need to purchase, install, and configure these storage solutions. With cloud computing, the process is more flexible. You can create, delete, and modify storage solutions all within a matter of minutes.