Then _definitely_ try both options Early optimization isn't vital, moreover its usually harmful. Make a working prototype first.
I'd disagree with your "early optimization" comment here - getting buffer object updates correct is not "early optimization" - it's a fundamental requirement.