It means the material is fragile and can break/collapse easily. For example, some cookies are brittle because they flake off when you touch them.
Hope I could help! :)
6.5m questions
8.5m answers