Yup if I run 

docker compose run --rm app bundle install

Then the gem installs in the container and I'm able to start the app. Though I thought the bundle volume would mean I wouldn't have to do that? Or am I misunderstanding?