Total views : 255

A Distributed File Transfer using Message Broker in Cloud


  • School of Computing, SASTRA University, Tirumalaisamudram, Thanjavur – 613401, Tamilnadu, India


Objectives: Everyday millions of users are downloading files through internet. It usually takes more amount of time and often leads to internet traffic in order to satisfy various clients in distributed environment. At present, cloud provides vital storage solution for both enterprises and the individual users. Methods: The existing system uses dual direction file transfer technique to transfer a file from its either end of the direction in order to enhance the download speed. But this approach does not guarantee reliability and it also increases latency for file transfer if the servers are too far from each other. Moreover, this technique was invented for single client. If multiple servers want to download the same file it will increase the total time required for download. Findings: A novel file transfer tool using a message broker. Kafka has been proposed to transfer large sized file with enhanced reliability and security. Kafka is one of the latest message broker used by many enterprises. This technique reduces the time required for replicating the files on many servers and downloading into the target server. If there are multiple clients, Kafka makes use of its mirroring technique to make a copy of files on many servers and we can download it easily. Applications: File transfer using Kafka can be used by many companies for managing their log files and to transfer it quickly from one data center to another. It also ensures reliability and secure file transfer across the data centers in the world.


Cloud Computing, Distributed System, Kafka, Message Broker, Reliability.

Full Text:

 |  (PDF views: 156)


  • Madhu babu Ch, Chandana OL. File transfer protocol in cloud computing. International Journal on Recent and Innovation Trends in Computing and Communication. 2014 Mar; 2(3):665–7.
  • Zhang Q, Li Z. Data transfer based on multiple replicas in the grid environment. In the Proceedings of Fifth Annual ChinaGrid Conference (ChinaGrid), Institute of Electrical and Electronics Engineers (IEEE); 2010 Jul 16. p. 240–4.
  • Lim SB, Fox G, Kaplan A, Pallickara S, Pierce M. Grid FTP and parallel TCP support in narada brokering. Springer Berlin Heidelberg; 2005 Oct. p. 93–102.
  • Mohamed N, Jaroodi JA, Eid A. A dual-direction technique for fast file downloads with load balancing in the cloud. Journal of Network and Computer Applications. 2013 Jul; 36(4):1116–30.
  • Kawano A, Funasaka J, Ishida K. Parallel downloading using variable length blocks for proxy servers. In Proceedings of the 27th International Conference on Distributed Computing Systems Workshops (ICDCSW07); 2007 Jun. p. 59.
  • Allcock B, Foster I, Nefedova V, Chervenak A, Deelman E, Kesselman C, Lee J, Sim A, Shoshani A, Drach B, Williams D. High-performance remote access to climate simulation data grid technologies. In Proceedings of the Association for Computing Machinery (ACM)/ Institute of Electrical and Electronics Engineers (IEEE) conference on supercomputing; 2001. p. 46.
  • Jeon H, Min YG, Seo KK. A performance measurement framework of cloud storage services. Indian Journal of Science and Technology. 2015 Apr; 8(S8):105–11.
  • Broberg J, Buyya R, Tari Z. Meta CDN: harnessing storage clouds for high performance content delivery. Journal of Network and Computer Applications. 2009 Sep; 32(5):1012–22.
  • Newman H. Data-intensive grids for high-energy physics. Nuclear Physics B - Proceedings Supplements. 2003 Jun; 120:109–12.
  • Rajathi A, Saravanan N. A survey on secure storage in cloud computing. Indian Journal of Science and Technology. 2013 Apr; 6(4):1–6.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.