Rationale behind Forward price = Stock price compounded at the risk free rate

Dear all,

Can someone please help with reminding me of the rationale behind this non-arbitrage formula :

Why would paying for more than the non-arbitrage price constitute an arbitrage opportunity?

Is it because the seller can borrow at the risk free rate, to hedge his short forward position by buying the stock, so we are paying him exactly the cost of his hedge?