The information overload problem has posed great challenge to internet users to retrieve relevant information accurately for the past decades. It is a tedious task for machine to intuitively mimic human linguists to summarize documents into meaningful text in abstractive manner. Quite often, the summarized text lacks cohesion and becomes difficult to comprehend. The objective of this paper is to investigate the proposed Swarm LSA-PSO model performs better than alternative methods. In this study, terms matrix was constructed from co-occurrence of terms using Bag-of-Words (BOW). The huge dimensions of terms were reduced using Singular Value Decomposition followed by K-Means PSO clustering for acquiring optimal number of concepts clusters. These key concepts were used to identify the main gist in documents for text summarization. The input text documents were downloaded from Document Understanding Conference (DUC) 2002 dataset. The preliminary results show that the swarm LSA-PSO model shows promising results in context based text summarization using BOW clustering approach.