Next time say to the person, "Sorry, mate. Im a big unit and as you know theres not much room. When I come back, can you put your seat up so I can get in and not bump you? I'll try to keep my getting up and down to a minimum".
Sometimes its easier to diffuse a situation before it becomes a...