Yes, it tastes a little like the flower smells. The flavour is also reminiscent of the floral taste found in turkish delight. I believe the compound responsible for the flavour is called beta-ionone. To my taste buds it is usually a very subtle flavour found on the mid-palate. I can usually pick it out by passing the vapour of the wine over my sides of my tongue after swallowing (sorry I don't know how to describe it any better than that). I don't think it is a particularly common note in Australian wines, so you may need to keep trying more wines to find it. Maybe search out some wines that are renowned for their violet notes.
However, if you happen to be a non-taster, as opposed to a super-taster, or a regular-taster, then you may not have the right taste buds to properly discern the flavour. Apparently 25% of the population are classed as non-tasters.