Hello and welcome to 2017, I have noticed that Signing Agents fees have gone down. This could be due to companies like SnapDocs and NotarySerch.
I recommend you stick to your guns. Fees of $100 for a Refinance is appropriate. I would add to your fee for fax backs, documents over 150 pages, after hours, Sundays, holidays and distance.
Have a great year.