Open the front gates, then jump down into the moat. Inside the cave is a lift up to a secret.

Leaving secret #1, go left and follow the moat (if you go right, you find a lift up to the entryway) around the building. Keep going, it's pretty far. There is some stairs up, leading to another secret.

Notice the elevated pathway with the yellow armour. That's the path to secret #3.

Get out of the window here. You will land on the ledge you saw, heading for secret #2. Follow it, and pick up the goodies. A slipgate will take you back.