I think it can be worth it but you must be careful to not default on your loan or pay too much for your home. There is maintenance on a home and that can get costly. Your house may not appreciate if there is too much to do to it.
On the other hand there is a sense of pride in owning your home. If you get a loan for under what you can afford, you can potentially pay it off and own it outright. That can make you feel really good and you have a place without that monthly cost. You will still have maintenance.
In the end, you must feel good about it and can handle the mortgage.