This sounds like an amazing day to yourself and you already had two of those. You are living the life out there. An olive tree can certainly live in a pot, you might need to replant it once it outgrows its pot but that’s about it really. It loves sunshine, the more the better. An olive tree also loves a sheltered position, against a hedge or a wall for instance. I would recommend Gordal Sevillano, Manzanilla or Nocellara Del Belice. You better get two olive trees actually. I personally love seeing them in pairs.