Usually depending on what wallet you use you can set the time the payment takes to go through. From ‘fast’ around 30 mins to ‘medium’ a couple of hours or ‘slow’ for 24 hours. Of course the fee is higher the quicker the transaction. The OPs charges sound really high. Mine is around £7 for the 30 min option and I use Mercuryo wallet and bittylicious for purchasing Bitcoin. Both very good and reasonably priced compared to others. Also both have really good help/chat service that can walk you through any issues.
Put in an order over the weekend for $100 and the transaction fee was around £7.
Strongly advise the OP ditches whatever service he’s using as it sounds expensive.
And yes, later in the evening/early hours is a much better time to do any transactions.