Are sales from a store located in an EU member state to a customer located in the same state also to be reported within the framework of the OSS?

No. Deliveries by an online seller (from a warehouse in an EU member state) to a customer located in the same state are not to be reported via the OSS, but via the standard VAT return process in the same member state.