Highly likely IMO. Based on what MC said about the game's story, the one always "invading" territory is the Goddess. And according to the game's lore, because of that the Demon Lord always has to go out himself and drive her and her zealot believers away. If it's the template "good vs evil" story game, the setting would be different and the demons would be the ones invading human lands on the constant. And then as a last-resort the Goddess would have to summon Heroes to save the day. Here it's reverse.

Also, according to MC, the Demon Lord was portrayed to be benevolent in the game, and is only cruel to his enemies. If we consider the fact that the Priestess with the Heroine was secretly torturing that lizardman scout she caught, and was hiding that fact from the Heroine, there is clearly something up with the "good guys" in this isekai world.

Well, theres also a chance our Ogre-MC is fated to claim the goddess as his woman too!