Answer:
After "or".
Shall I pick up a birthday cake at the grocery store or, would you like to try making one ourselves?
Step-by-step explanation:
The comma would go after "or", as this is a conjugation, and the comma helps to connect "Shall I pick up a birthday cake at the grocery store or" and "would you like to try making one ourselves?"
Hope this helps!