Brick-and-mortar refers to a physical location. It can be a store, apartment building, or office.
If a business needs physical space, it needs to have upfront investments in a property (rental area), fixtures/equipment (desks, chairs, etc.), inventory (products), staff (employees), etc.
It’s more difficult for some businesses to scale up if they are not fully prepared for the additional overhead.