So I should wear warm colors with my olive skin tone?

Yes that's correct, also gold will go well your skin tone as long as it's a shimmery type of gold. Where pastel colors but with a shimmer to them.