It's good to know that you believe in gratitude and humanity, which makes you a spiritual person. So you have mentioned that you spend 1/4th of your day at temple or worshiping. So it is alright as long as you and people around you are benefiting from it.Is this routine affecting your day today life in any manner or your work life? It's also important to maintain the balance between work and your hobbies and interests. If these activities inspire and motivate you, its perfectly fine. As per you, are these activities making you strong and positive? These are some of the questions you may want to ask yourself.
Also people respond to their own way of thinking and beliefs so better to follow your own way of thinking and beliefs rather than be affected by what others comment on you.
So please do some self introspection and decide for yourself , if these activities are something you would consciously want to pursue.
All the best!