If I get a link from my relevant niche blog whose content quality is not so good. Will it be harmful for my site??
As long as the links are relevant they are not going to hurt you. But if the content of the hosting blog is of low quality then the link juice will be also much less.
It will not harm your site if it is not that good enough and always bear in mind that linking to relevant sites is enough to contribute into your site.