Thiruvattar Amma Veedu is situated just outside the West Fort in Thiruvananthapuram. The name Thiruvattar is derived from a place of the same name near Padmanabhapuram. The family shifted from there to Thiruvananthapuram but retained the family name. Swathi Thirunal married a lady, Narayani Pillai, from this house.

It is believed that Narayani Pillai actually belonged to an ordinary Nair household in Kollam district and when the Maharaja decided to marry her she was adopted by the Thiruvattar house as the tradition prescribes so. Narayani Pillai was a good veena player and a very beautiful lady. The Maharaja gave her a lot of presents including landed property. But later,when he got involved with Sugandhavalli, the dancer from Thanjavoor, his relationship with Narayani came under strain. Today Thiruvattar Amma Veedu houses a Government office.