In a small bowl add the oregano, salt and pepper and rub the meat with the mixture. Place the goat in a baking dish, drizzle with the lemon juice and olive oil. Scatter the bay leaves around the meat.