You bet! Unfortunately, they were not all into what Brian wanted to do. The Beach Boys had a lot of the normal band friction, made more complicated by being (mostly) family. Some of them were very against
Pet Sounds and
Smile, which is one reason
Smile is unfinished. He said they argued so much over whether to release a song called "Surf's Up," they almost broke up. (It's not about surfing, of course.). There were a lot of lyrics about American colonization, too, which they would resist singing.
He has a lot of shame and bad memories from this period, and wouldn't allow
Smile music to be released for a long time. Whereas, if he talks about
Pet Sounds, he's clearly reliving the happiest time of his life. He got to finish an album that was very personal for him, even with some band resistance. I think the car and surfing songs were more an excuse to make music, but aren't him. He hates surfing. (I like those songs, so I'm not bashing them. This is just the impression I get of Brian's attitude.)
It's a big subject, but Brian tried hard to destroy The Beach Boys' image and didn't really get to. He still oversaw the next few albums in the last 60s, but then stopped giving them much music. And he thought about leaving the band a lot since the late 60s. I think he felt he couldn't express himself with them, anymore. They also had him institutionalized because he kept working on a (brilliant) version of "Old Man River," without finishing it. Lots of drama.
As you can see, I can go on about this