Kanyakumari Temple is one of the 52 Shakti Peetham, located in Cape Kanya Kumari in Tamil Nadu, at the southern tip of main land India, there by located on the confluence of the Bay of Bengal, the Arabian Sea, and the Indian Ocean. Basically it is believed that the right shoulder and (back) spine area of Sati’s corpse fell here creating the presence of kundalini sakthi in the region. There is a temple of Lord Ganesha near the pucca ghat at the confluence of the three seas/oceans, which one must visit before entering the temple.
Devi Kanyakumari is the goddess of virginity and penance and is believe to be the one who removes rigidity of the mind. She is goddess Parvati in the form of an adolescent girl child. Another names include Shree Baala Bhadra, Shree Baala, Kanya Devi and Devi Kumari. She is also worship as Shree Bhadra kali by devotees. Some believe that the Bhadra Kali Temple within Kanya Kumari Temple is the Shakti Peeth. Additionally Devi Kanya Kumari has been mention in Ramayana, Mahabharata, and the Sangam works Manimekalai, Puranaanooru and Narayana Upanishad, a Vaishnava upanishad in the Taittiriya Samhita of Krishna Yajur Veda.
The mythological story dates back to the prehistoric Tamil period. Bana an asura by birth was the ruler of his land. He was a very powerful king. He practiced tapasya and obtained a boon from Lord Brahma that his death will only be by an adolescent young girl. With this powerful boon, he became fearless and wreaked havoc on the entire world. He went on to conquer and oust Lord Indra from his throne. He banished all the devas’ from there. The devas’ who were the personification of the basic natural elements, Agni (fire), Varuna (water), Vayu (air) went uncoordinated and havoc spread in the universe, because Indra (ether) was not able to administer and coordinate the Pancha bootha.
Bhagavathy manifested herself in the Southern tip of the Aryavartha, to kill Bana and recur the balance of nature. As an adolescent girl, she had immense devotion towards Lord Shiva. The Lord decided to marry her. All arrangements were made for the marriage. Lord Shiva started the journey from Shuchindram for the marriage. The marriage muhurat (auspicious time) was in the Brahma muhurtam early in the morning. Narada made the sound of a cock sending wrong information that the Sun had already risen and the auspicious time passed. The marriage procession returned. Sage Narada realize Bana could only be kill by a young girl and thus interrupt Shiva’s marriage with Bhagavathy.
Devi waited for the Lord and finally, she thought that she had been snubbed. With unbearable insult, pain, grief, and anger she destroyed everything she saw. She threw away all the food and broke her bangles. When she finally gained her composure she undertook continuous penance. Ages later Bana, tried to lure and approach the goddess without realizing who she was. The infuriated Bhagavathy, who was the Bhadrakali herself, slaughtered Bana at once. Moments before his death Bana realized that the one before him was Sakti, the Almighty itself. He prayed her to absolve him of his sins. Bhagavathy maintained her divine presence in the place, in the Devi Kanyakumari Temple.
Information Source: Link 1