I think omiting details is not a good idea
Indeed building “patterns” for walls, floors, roofs, etc that are so close to their reality is the answer
How many different walls we have in the world? Just we need build their “pattern” then in software just you select the pattern you want and draw your wall
Also, these patterns have the ability to add or remove their “layers” and “details” too
There’s a long time I know its name “ATOMIC DESIGN”