Rotherwood Mansion is associated with the legend of the "White Lady," believed to be Rowena Ross, who is said to search for her drowned fiancé in the Holston River. Another story concerns the cruel former owner Joshua Phipps, who is said to haunt the grounds along with a hellhound and swarm of flies, the same pests that allegedly suffocated him after his death. The mansion also features tales of other paranormal activity, including wailing voices and evil laughter. Rowena Ross, the daughter of the original owner, Reverend Frederick A. Ross. She is said to have drowned in the Holston River after hearing the spirit of her first love calling to her. Many visitors and locals have reported seeing a "lady in white" wandering the grounds. Her spirit is said to be particularly active along the riverbank area. Joshua Phipps, a later owner of the mansion, known for his cruelty. Phipps died a horrible death after being covered by a swarm of flies that suffocated him. His coffin was reportedly followed by a black dog with red eyes from a hearse after the hearse became immobile. A large black dog with glowing red eyes is sometimes seen, along with the flies. Some stories include reports of wailing voices and evil laughter heard around the property. A variation of the Rowena story includes wet footprints leading to the front door, though a resident claims never to have seen them.