ANSWER:

You can perform salah there anytime except during Fard congregation and while in the middle of doing tawaf. When you pray there, you are praying inside the kaabah. 

When should we perform salah at the semi circle around the Ka’bah? Is it possible to perform prayers in the semi circle around the Ka’bah while performing tawaf??