MeSH: Merkle based Similarity Hashing

Introduction

Existing Tools

• dcfldd

• ssdeep

• sdhash

• bbhash

• mvhash-B

• mrsh_v2

• FbHash

• LZJD

Proposed Algorithm

Click Here to view.

Acknowledgement

We would like to acknowldge the support provided by TIFAC-CORE in Cyber Security, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, India in carrying out this work as part of "M.Tech Cyber Security" Thesis.

References

• Kornblum, J. (2006, September). Identifying almost identical files using context triggered piecewise hashing. Digital Investigation. Elsevier BV. Vol. 3, pp. 91-97. http://doi.org/10.1016/j.diin.2006.06.015
• Roussev, V. (2011, August). An evaluation of forensic similarity hashes. Digital Investigation. Elsevier BV. Vol. 8, S34-S41 http://doi.org/10.1016/j.diin.2011.05.005
• Breitinger, F., Stivaktakis, G., & Baier, H. (2013, August). FRASH: A framework to test algorithms of similarity hashing. Digital Investigation. Elsevier BV. Vol. 10, S50-S58. http://doi.org/10.1016/j.diin.2013.06.006
• Breitinger, F., Stivaktakis, G., & Roussev, V. (2014, June). Evaluating detection error trade-offs for bytewise approximate matching algorithms. Digital Investigation. Elsevier BV. Vol. 11(2), pp. 81-89. http://doi.org/10.1016/j.diin.2014.05.002
• Raff, E., & Nicholas, C. (2018, March). Lempel-Ziv Jaccard Distance, an effective alternative to ssdeep and sdhash. Digital Investigation. Elsevier BV. Vol. 24, pp. 34-49. http://doi.org/10.1016/j.diin.2017.12.004
• Chang, D., Ghosh, M., Sanadhya, S. K., Singh, M., & White, D. R. (2019, July). FbHash: A New Similarity Hashing Scheme for Digital Forensics. Digital Investigation. Elsevier BV. Vol. 29, S113-S123. http://doi.org/10.1016/j.diin.2019.04.006
• Martín-Pérez, M., Rodríguez, R. J., & Breitinger, F. (2021, April). Bringing order to approximate matching: Classification and attacks on similarity digest algorithms. Forensic Science International: Digital Investigation. Elsevier BV. Vol. 36, 301120. http://doi.org/10.1016/j.fsidi.2021.301120
• Singh, M., Khunteta, A., Ghosh, M., Chang, D., & Sanadhya, S. K. (2022, June). FbHash-E: A time and memory efficient version of FbHash similarity hashing algorithm. Forensic Science International: Digital Investigation. Elsevier BV. Vol. 41, 301375. http://doi.org/10.1016/j.fsidi.2022.301375
• Prathamudeshmukh. Merkle Tree Visualization. Retrieved from https://prathamudeshmukh.github.io/merkle-tree-demo/

Publication

TBD