The fast-growing innovations within the field of digital media provide a platform where the sizes of the digital contents are expanding aggressively without proper management. Management of such kind of digital data needs proper techniques to facilitate easy retrieval of specific objects intelligently out of stored materials. Object detection and labelling with a proper term are one of the main issues within the field of multimedia. This has led to a problem of how these contents can be effectively managed. The management of these digital contents has not gotten as much attention as compared to the production and technology development. A lot of useful information goes to wastage due to the poor management of digital contents. This paper focusses on the Semantic Intensity (SI), which is an approach to arrange the identical object�s images in the dataset. SI can easily be calculated for each of the single object in the images bases on their polygon point representation. The SI-values represent the degree of contribution of each of the object towards semantics of the image. From the experimental work, our algorithm performance was good in terms of calculating the SI-value of the objects inside the image. © Springer International Publishing Switzerland 2015.