After research…

Continued research on hadoop lead me to a quite interesting site(will link later) appearently the ‘Lustre distributed file system’ has been used as an alternative to hdfs, haven’t done any experiments yet but will update you soon..