Streaming chunked files in a federated file system

Date

2009-05

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

This paper presents the framework for a distributed, chunk-based file streaming federation. This framework will be built upon the SILENUS file system and FICUS extensions for support of chunked files and the specific implementation will use the Java Media Framework. Instead of the traditional model of streaming which is from a single monolithic file on a single node, the goal of this work is to stream from a file that is split into chunks, uploaded and replicated across the different nodes on the network. The major benefit of this approach is to reduce the bandwidth costs on the individual nodes and seeks to eliminate the single-point-of-failure that can occur when using traditional streaming models. This leads to quicker and more reliable access to the files that are being streamed. The final objective is to address the lack of replication for chunked files that was not implemented in the FICUS framework. With this implemented the benefits of replication that are provided by the SILENUS file system will be available for files that are stored on the network in chunks.

Description

Citation